# US 2019/0168870 A1 · System and method for tracking targets

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0168870 A1
- Document ID: US20190168870A1
- Status: Published application
- Kind: A1
- Application number: 16/263,708
- Filed: 2019-01-31
- Published: 2019-06-06
- Earliest claimed: 2016-08-06
- Assignees: Sz Dji Technology Co., Ltd.
- Applicants: Sz Dji Technology Co., Ltd.
- Inventors: Peiliang LI; Cong ZHAO; Xuyang FENG; Jie QIAN; Qifeng WU
- Web page: https://patentgrep.com/patent/US20190168870A1

## CPC

- G05D 1/12: Target-seeking control
- G05D 1/0094: {involving pointing a payload, e.g. camera, weapon, sensor, towards a fixed or moving target}
- G05D 1/683: Intercepting moving targets (docking at a base station G05D1/661)
- G05D 1/689: Pointing payloads towards fixed or moving targets (positioning towed, pushed or suspended implements G05D1/672)
- B64U 10/13: Flying platforms
- B64U 20/87: Mounting of imaging devices, e.g. mounting of gimbals
- B64U 2101/31: for surveillance
- B64U 2201/10: autonomous, i.e. by navigating independently from ground or air stations, e.g. by using inertial navigation systems [INS]
- G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- B64U: UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR

## Abstract

A method of tracking a movement of a target by an unmanned aerial vehicle (UAV) includes determining a distance between the target and the UAV, acquiring image data of the target by a camera of the UAV, determining two-dimensional pixel coordinate data associated with a plurality of features of the target from the image data, determining a physical dimension based on the two-dimensional pixel coordinate data and the distance, and determining three-dimensional location coordinate data of the target with respect to the UAV based on the physical dimension and at least one of the two-dimensional pixel coordinate data or the distance.

## Claims

### Claim 1

A method of tracking a movement of a target by an unmanned aerial vehicle (UAV), the method comprising:
determining a distance between the target and the UAV;
acquiring, by a camera of the UAV, image data of the target;
determining, from the image data, two-dimensional pixel coordinate data associated with a plurality of features of the target;
determining a physical dimension based on the two-dimensional pixel coordinate data and the distance; and
determining, based on the physical dimension and at least one of the two-dimensional pixel coordinate data or the distance, three-dimensional location coordinate data of the target with respect to the UAV.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
receiving absolute three-dimensional location coordinate data of the UAV;
receiving absolute two-dimensional location coordinate data of the target;
wherein the distance between the target and the UAV is a horizontal distance, which is determined based on the absolute three-dimensional location coordinate data of the UAV and the absolute two-dimensional location coordinate data of the target.

### Claim 3 (depends on 2)

The method of claim 2, wherein the absolute three-dimensional location coordinate data of the UAV is acquired from a global positing system (GPS) receiver included in the UAV.

### Claim 4 (depends on 2)

The method of claim 2, wherein the absolute two-dimensional location coordinate data of the target includes data acquired from a GPS receiver that collocates with the target.

### Claim 5 (depends on 4)

The method of claim 4, wherein the absolute two-dimensional location coordinate data of the target further includes data generated from information provided by an inertia measurement unit (IMU).

### Claim 6 (depends on 1)

The method of claim 1, further comprising:
extracting the plurality of features of the target from the image data; and
determining pixel locations for the plurality of features;
wherein the two-dimensional pixel coordinate data is determined based on the pixel locations.

### Claim 7 (depends on 1)

The method of claim 1, wherein the physical dimension is determined also based on a focal distance of the camera.

### Claim 8 (depends on 1)

The method of claim 1, wherein the physical dimension is determined also based on a pitch angle of at least one of the UAV or the camera.

### Claim 9 (depends on 1)

The method of claim 1, further comprising:
receiving updated image data of the target;
determining whether pixels associated with the plurality of features are included within the updated image data; and
in response to the pixels associated with the plurality of the features being not included within the updated image data: determining, based on the physical dimension and the three-dimensional location coordinate data, updated three-dimensional location coordinate data of the target with respect to the UAV.

### Claim 10 (depends on 1)

The method of claim 1, further comprising: adjusting a speed and a direction of movement of the UAV based on a location of the target indicated by the three-dimensional location coordinate data.

### Claim 11

A tracking system configured to track a movement of a target, the tracking system comprising:
a memory storing executable instructions;
a camera configured to acquire image data of the target; and
at least one processor configured to execute the stored instructions to:
determine a distance between the target and an unmanned aerial vehicle carrying the tracking system;
determine, from the image data, two-dimensional pixel coordinate data associated with a plurality of features of the target;
determine a physical dimension based on the two-dimensional pixel coordinate data and the distance; and
determine, based on the physical dimension and at least one of the two-dimensional pixel coordinate data or the distance, three-dimensional location coordinate data of the target with respect to the UAV.

### Claim 12 (depends on 11)

The tracking system of claim 11, wherein the at least one processor is further configured to execute the stored instructions to:
receive absolute three-dimensional location coordinate data of the UAV;
receive absolute two-dimensional location coordinate data of the target;
wherein the distance between the target and the UAV is a horizontal distance, which is determined based on the absolute three-dimensional location coordinate data of the UAV and the absolute two-dimensional location coordinate data of the target.

### Claim 13 (depends on 12)

The tracking system of claim 12, wherein the absolute three-dimensional location coordinate data of the UAV is acquired from a global positing system (GPS) receiver included in the UAV.

### Claim 14 (depends on 12)

The tracking system of claim 12, wherein the absolute three-dimensional location coordinate data of the target includes data acquired from a GPS receiver that collocates with the target.

### Claim 15 (depends on 14)

The tracking system of claim 14, wherein the absolute three-dimensional location coordinate data of the target further includes data generated from information provided by an inertia measurement unit (IMU).

### Claim 16 (depends on 11)

The tracking system of claim 11, wherein the at least one processor is further configured to execute the stored instructions to:
extract the plurality of features of the target from the image data; and
determine pixel locations for the plurality of features;
wherein the two-dimensional pixel coordinate data is determined based on the pixel locations.

### Claim 17 (depends on 11)

The tracking system of claim 11, wherein the physical dimension is determined also based on at least one of:
a focal distance of the camera, or
a pitch angle of at least one of the UAV or the camera.

### Claim 18 (depends on 11)

The tracking system of claim 11, wherein the at least one processor is further configured to execute the stored instructions to:
receive updated image data of the target;
determine whether pixels associated with the plurality of features are included within the updated image data; and
in response to the pixels associated with the plurality of the features being not included within the updated image data: determine, based on the physical dimension and the three-dimensional location coordinates, updated three-dimensional location coordinate data of the target with respect to the UAV.

### Claim 19 (depends on 11)

The tracking system of claim 11, wherein the at least one processor is further configured to execute the stored instructions to: cause the UAV to adjust a speed and a direction of movement based on a location of the target indicated by the three-dimensional location coordinate data.

### Claim 20

A movable object, comprising:
one or more propellers;
one or more sensors configured to obtain speed and direction information of the movable object;
a camera configured to acquire image data of a target;
a radio communication system configured to receive signals from a satellite navigation system; and
a controller comprising:
a memory storing executable instructions;
a camera configured to acquire image data of the target; and
at least one processor configured to execute the stored instructions to:
determine a distance between the target and the movable object based on the signals received from the radio communications system,
determine, from the image data, two-dimensional pixel coordinate data associated with a plurality of features of the target,
determine a physical dimension based on the two-dimensional pixel coordinate data and the distance,
determine, based on the physical dimension and at least one of the two-dimensional pixel coordinate data or the distance, three-dimensional location coordinate data of the target with respect to the mobile object, and
control the one more propellers based on the three-dimensional location coordinate data, and the speed and direction information of the movable object.
