# US 2025/0209657 A1 · Method and electronic device for tracking object

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0209657 A1
- Document ID: US20250209657A1
- Status: Published application
- Kind: A1
- Application number: 19/076,426
- Filed: 2025-03-11
- Published: 2025-06-26
- Earliest claimed: 2022-09-29
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Jaeyong JU
- Web page: https://patentgrep.com/patent/US20250209657A1

## CPC

- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G06F 18/00: Pattern recognition
- G06T 7/246: using feature-based methods, e.g. the tracking of corners or segments
- G06T 7/73: using feature-based methods
- G06V 10/40: Extraction of image or video features
- G06V 10/62: relating to a temporal dimension, e.g. time-based feature extraction; Pattern tracking
- G06V 10/74: Image or video pattern matching; Proximity measures in feature spaces
- G06V 10/764: using classification, e.g. of video objects
- G06V 10/82: using neural networks
- G06V 40/10: Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06T 2207/10016: Video; Image sequence
- G06T 2207/10024: Color image
- G06T 2207/20081: Training; Learning
- G06T 2207/20084: Artificial neural networks [ANN]
- G06T 2207/30196: Human being; Person
- G06T 2207/30241: Trajectory
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A method of tracking at least one object, includes: obtaining an image; extracting, from the image, a feature map for performing a plurality of tasks related to object tracking; extracting, by using the extracted feature map, location information indicating a location of the at least one object, an identification feature for identifying the at least one object, and a body orientation angle at which a body of the at least one object is oriented; and tracking the at least one object, based on the location information, the identification feature, and the body orientation angle of the at least one object.

## Claims

### Claim 1

A method of tracking at least one object, the method comprising:
obtaining an image;
extracting, from the image, a feature map for performing a plurality of tasks related to object tracking;
extracting, by using the extracted feature map, location information indicating a location of the at least one object, an identification feature for identifying the at least one object, and a body orientation angle at which a body of the at least one object is oriented; and
tracking the at least one object, based on the location information, the identification feature, and the body orientation angle of the at least one object.

### Claim 2 (depends on 1)

The method of claim 1, further comprising performing, by using an object tracking model, the extracting of the feature map and the extracting of the location information, the identification feature, and the body orientation angle,
wherein the object tracking model is a multi-task artificial intelligence model configured to perform the plurality of tasks related to object tracking,
wherein the object tracking model includes:
a backbone network configured to extract the feature map,
a detection head configured to extract the location information of the at least one object,
an identification head configured to extract the identification feature of the at least one object, and
a body orientation head configured to extract the body orientation angle of the at least one object, and
wherein each of the backbone network, the detection head, the identification head, and the body orientation head includes at least one layer.

### Claim 3 (depends on 1)

The method of claim 1, wherein the extracting of the location information, further comprises:
extracting, by using the feature map, a heat map indicating a central location of the at least one object on the feature map, a bounding box size of the at least one object, and a center offset for obtaining a central location of the at least one object on the image;
obtaining, from the heat map, the central location of the at least one object on the feature map; and
extracting the location information of the at least one object, based on the central location of the at least one object on the feature map, the bounding box size of the at least one object, and the center offset of the at least one object,
wherein the heat map includes a heat map score corresponding to each pixel of the heat map, and
wherein the heat map includes a peak heat map score at the central location of the at least one object on the feature map.

### Claim 4 (depends on 1)

The method of claim 1, wherein the extracting of the identification feature, comprises:
extracting identification features by using the feature map; and
extracting the identification feature of the at least one object from the identification features, based on the central location of the at least one object on the feature map.

### Claim 5 (depends on 1)

The method of claim 1, wherein the extracting of the body orientation angle, comprises:
extracting body orientation embedding vectors by using the feature map;
extracting a body orientation embedding vector of the at least one object from the body orientation embedding vectors, based on the central location of the at least one object on the feature map; and
extracting the body orientation angle of the at least one object, based on an element having a maximum value among elements of the body orientation embedding vector of the at least one object,
wherein the body orientation embedding vector includes the elements corresponding to respective representative angles of body orientation, and
wherein values of the elements are scores for the respective representative angles of body orientation.

### Claim 6 (depends on 1)

The method of claim 1, wherein the tracking of the at least one object, comprises:
determining whether an identification feature corresponding to the body orientation angle of the at least one object exists in an identification feature list of each of objects being tracked;
when the identification feature list includes an identification feature corresponding to the body orientation angle of the at least one object, comparing, with the identification feature of the at least one object, the identification feature corresponding to the body orientation angle of the at least one object, which is included in the identification feature list,
when the identification feature list does not include an identification feature corresponding to the body orientation angle of the at least one object, comparing, with the identification feature of the at least one object, an identification feature corresponding a representative angle closest to the body orientation angle of the at least one object, which is included in the identification feature list; and
tracking the at least one object, based on a result of the comparing of the identification feature corresponding to the body orientation angle of the at least one object with the identification feature of the at least one object, and
wherein the identification feature list includes a latest identification feature of the object and at least one identification feature of the object corresponding to each representative angle of body orientation.

### Claim 7 (depends on 6)

The method of claim 6, further comprising, when the at least one object is matched with at least one of the objects being tracked, updating, by using the identification feature of the at least one object, a latest identification feature and an identification feature corresponding to the body orientation angle of the at least one object, which are included in an identification feature list of the at least one object.

### Claim 8

An electronic device configured to track at least one object, the electronic device comprising:
a communication interface;
memory storing at least one instruction; and
at least one processor operatively connected with the memory,
wherein the at least one processor is configured to execute the at least one instruction to:
obtain an image;
extract, from the image, a feature map for performing a plurality of tasks related to object tracking;
extract, by using the extracted feature map, location information indicating a location of the at least one object, an identification feature for identifying the at least one object, and a body orientation angle at which a body of the at least one object is oriented; and
track the at least one object, based on the location information, the identification feature, and the body orientation angle of the at least one object.

### Claim 9 (depends on 8)

The electronic device of claim 8, wherein the at least one processor is configured to execute the at least one instruction to perform, by using an object tracking model, a first operation of extracting the feature map and a second operation of extracting the location information, the identification feature, and the body orientation angle,
wherein the object tracking model is a multi-task artificial intelligence model configured to perform the plurality of tasks related to object tracking,
wherein the object tracking model comprises:
a backbone network configured to extract the feature map,
a detection head configured to extract the location information of the at least one object,
an identification head configured to extract the identification feature of the at least one object, and
a body orientation head configured to extract the body orientation angle of the at least one object, and
wherein each of the backbone network, the detection head, the identification head, and the body orientation head includes at least one layer.

### Claim 10 (depends on 8)

The electronic device of claim 8, wherein the at least one processor is further configured to execute the at least one instruction to:
extract, by using the feature map, a heat map indicating a central location of the at least one object on the feature map, a bounding box size of the at least one object, and a center offset for obtaining a central location of the at least one object on the image;
obtain, from the heat map, the central location of the at least one object on the feature map; and
extract the location information of the at least one object based on the central location of the at least one object on the feature map, the bounding box size of the at least one object, and the center offset of the at least one object,
wherein the heat map comprises a heat map score corresponding to each pixel of the heat map, and
wherein the heat map comprises a peak heat map score at the central location of the at least one object on the feature map.

### Claim 11 (depends on 8)

The electronic device of claim 8, wherein the at least one processor is further configured to execute the at least one instruction to:
extract identification features by using the feature map, and
extract the identification feature of the at least one object from the identification features, based on the central location of the at least one object on the feature map.

### Claim 12 (depends on 8)

The electronic device of claim 8, wherein the at least one processor is further configured to execute the at least one instruction to:
extract body orientation embedding vectors by using the feature map;
extract a body orientation embedding vector of the at least one object from the body orientation embedding vectors, based on the central location of the at least one object on the feature map; and
extract the body orientation angle of the at least one object based on an element having a maximum value among elements of the body orientation embedding vector of the at least one object,
wherein the body orientation embedding vector comprises the elements corresponding to respective representative angles of body orientation, and
wherein values of the elements are scores for the respective representative angles of body orientation.

### Claim 13 (depends on 8)

The electronic device of claim 8, wherein the at least one processor is further configured to execute the at least one instruction to:
determine whether an identification feature corresponding to the body orientation angle of the at least one object exists in an identification feature list of each of objects being tracked;
when the identification feature list comprises an identification feature corresponding to the body orientation angle of the at least one object, compare, with the identification feature of the at least one object, the identification feature corresponding to the body orientation angle of the at least one object, which is included in the identification feature list;
when the identification feature list does not comprise an identification feature corresponding to the body orientation angle of the at least one object, compare, with the identification feature of the at least one object, an identification feature corresponding a representative angle closest to the body orientation angle of the at least one object; and
track the at least one object based on a result of a comparison of the identification feature corresponding to the body orientation angle of the at least one object and the identification feature of the at least one object, and
wherein the identification feature list comprises a latest identification feature and at least one identification feature corresponding to each representative angle of body orientation.

### Claim 14 (depends on 8)

The electronic device of claim 8, wherein the at least one processor 2100 is further configured to execute the at least one instruction to, when the at least one object is matched with at least one of the objects being tracked, update, by using the identification feature of the at least one object, a latest identification feature and an identification feature corresponding to the body orientation angle of the at least one object, which are included in an identification feature list of the at least one object.

### Claim 15

A non-transitory computer-readable recording medium having recorded thereon a program for performing, on a computer, a method of tracking at least one object, comprising:
obtaining an image;
extracting, from the image, a feature map for performing a plurality of tasks related to object tracking;
extracting, by using the extracted feature map, location information indicating a location of the at least one object, an identification feature for identifying the at least one object, and a body orientation angle at which a body of the at least one object is oriented; and
tracking the at least one object, based on the location information, the identification feature, and the body orientation angle of the at least one object.
