# US 2026/0087643 A1 · Video instance segmentation

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0087643 A1
- Document ID: US20260087643A1
- Status: Published application
- Kind: A1
- Application number: 19/400,885
- Filed: 2025-11-25
- Published: 2026-03-26
- Earliest claimed: 2022-08-01
- Assignees: NVIDIA Corporation
- Applicants: NVIDIA Corporation
- Inventors: De-An Huang; Zhiding Yu; Anima Anandkumar
- Web page: https://patentgrep.com/patent/US20260087643A1

## CPC

- G06F 18/214: Generating training patterns; Bootstrap methods, e.g. bagging or boosting
- G06T 7/20: Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51)
- G06T 5/20: using local operators
- G06T 7/246: using feature-based methods, e.g. the tracking of corners or segments
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G06V 10/761: {Proximity, similarity or dissimilarity measures}
- G06V 10/774: Generating sets of training patterns; Bootstrap methods, e.g. bagging or boosting
- G06V 10/82: using neural networks
- G06V 20/695: {Preprocessing, e.g. image segmentation}
- G06T 2207/20081: Training; Learning
- G06V 2201/07: Target detection
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Apparatuses, systems, and techniques to track one or more objects in one or more frames of a video. In at least one embodiment, one or more objects in one or more frames of a video are tracked based on, for example, one or more sets of embeddings.

## Claims

### Claim 1

A system, comprising:
at least one processor; and
at least one memory comprising instructions that, in response to execution by the at least one processor, cause the system to at least:
obtain a plurality of masks by convolving a set of embeddings with a set of features obtained from a plurality of images, the set of embeddings to correspond to an object and to have been obtained using the set of features; and
track the object across at least a portion of the plurality of images using the plurality of masks.

### Claim 2 (depends on 1)

The system of claim 1, wherein the instructions, in response to execution by the at least one processor, cause the system to cause a device to perform one or more actions based at least in part on the tracking of the object.

### Claim 3 (depends on 2)

The system of claim 2, wherein the device is an autonomous vehicle,
the plurality of images was captured by one or more sensors of the autonomous vehicle; and
the one or more actions are to cause the autonomous vehicle to at least one of move or avoid collision with the object.

### Claim 4 (depends on 2)

The system of claim 2, wherein the device is a robot, and the one or more actions are to at least one of grasp or manipulate the object.

### Claim 5 (depends on 2)

The system of claim 2, wherein the device is a medical system, and the one or more actions are to at least one of process the object or calculate information associated with the object.

### Claim 6 (depends on 1)

The system of claim 1, wherein the instructions, in response to execution by the at least one processor, cause the system to cause at least one machine learning process to use the plurality of images to obtain the set of features.

### Claim 7 (depends on 1)

The system of claim 1, wherein the instructions, in response to execution by the at least one processor, cause the system to track the object using bipartite matching to match different portions of the set of embeddings obtained using different portions of the set of features obtained for different images in the plurality of images.

### Claim 8

A computer-implemented method comprising:
obtaining a plurality of masks by convolving a set of embeddings with a set of features obtained from a plurality of images, the set of embeddings to correspond to an object and to have been obtained using the set of features; and
tracking the object across at least a portion of the plurality of images using the plurality of masks.

### Claim 9 (depends on 8)

The computer-implemented method of claim 8, further comprising:
causing an autonomous vehicle to at least one of move or avoid collision with the object based at least in part on the tracking of the object.

### Claim 10 (depends on 8)

The computer-implemented method of claim 8, further comprising:
causing a robot to at least one of grasp or manipulate the object based at least in part on the tracking of the object.

### Claim 11 (depends on 8)

The computer-implemented method of claim 8, further comprising:
causing a medical system to at least one of process the object or calculate information associated with the object based at least in part on the tracking of the object.

### Claim 12 (depends on 8)

The computer-implemented method of claim 8, further comprising:
causing at least one machine learning process to use the plurality of images to obtain the set of features.

### Claim 13 (depends on 8)

The computer-implemented method of claim 8, wherein the tracking comprises using bipartite matching to match different portions of the set of embeddings obtained using different portions of the set of features obtained for different images in the plurality of images.

### Claim 14

One or more processors, comprising:
circuitry to:
obtain a plurality of masks by convolving a set of embeddings with a set of features obtained from a plurality of images, the set of embeddings to correspond to an object and to have been obtained using the set of features; and
track the object across at least a portion of the plurality of images using the plurality of masks.

### Claim 15 (depends on 14)

The one or more processors of claim 14, wherein the circuitry is further to cause a device to perform one or more actions based at least in part on the tracking of the object.

### Claim 16 (depends on 15)

The one or more processors of claim 15, wherein the device is an autonomous vehicle, and the one or more actions are to cause the autonomous vehicle to at least one of move or avoid collision with the object.

### Claim 17 (depends on 15)

The one or more processors of claim 15, wherein the device is a robot, and the one or more actions are to at least one of grasp or manipulate the object.

### Claim 18 (depends on 15)

The one or more processors of claim 15, wherein the device is a medical system, and the one or more actions are to at least one of process the object or calculate information associated with the object.

### Claim 19 (depends on 14)

The one or more processors of claim 14, wherein the circuitry is further to cause at least one machine learning process to use the plurality of images to obtain the set of features.

### Claim 20 (depends on 14)

The one or more processors of claim 14, wherein the circuitry is to track the object using bipartite matching to match different portions of the set of embeddings obtained using different portions of the set of features obtained for different images in the plurality of images.
