# US 2019/0172358 A1 · Methods and systems for obstacle identification and avoidance

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0172358 A1
- Document ID: US20190172358A1
- Status: Published application
- Kind: A1
- Application number: 16/261,714
- Filed: 2019-01-30
- Published: 2019-06-06
- Earliest claimed: 2016-08-04
- Assignees: Sz Dji Technology Co., Ltd.
- Applicants: Sz Dji Technology Co., Ltd.
- Inventors: You ZHOU; Zhenyu ZHU; Jiexi DU; Canlong LIN; Jiahang YING
- Web page: https://patentgrep.com/patent/US20190172358A1

## CPC

- G05D 1/106: {Change initiated in response to external conditions, e.g. avoidance of elevated terrain or of no-fly zones}
- G06V 20/13: Satellite images
- G06V 20/17: taken from planes or by drones
- G08G 5/55: for a single aircraft
- G08G 5/57: for unmanned aircraft
- G08G 5/59: in accordance with predefined flight zones, e.g. to avoid prohibited zones
- G08G 5/80: Anti-collision systems
- B64U 2101/30: for imaging, photography or videography
- B64U 2201/10: autonomous, i.e. by navigating independently from ground or air stations, e.g. by using inertial navigation systems [INS]
- B64U 2201/20: Remote controls
- G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G08G: TRAFFIC CONTROL SYSTEMS (guiding railway traffic, ensuring the safety of railway traffic B61L; arrangement of road signs or traffic signals E01F9/00; radar or analogous systems, sonar systems, lidar systems specially adapted for traffic control G01S13/91, G01S15/88, G01S17/88; {radar or analogous systems, sonar systems, lidar systems specially adapted for anti-collision purposes G01S13/93, G01S15/93, G01S17/93})
- B64U: UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR

## Abstract

A method of controlling a movable object includes obtaining an image of a surrounding of the movable object, obtaining a plurality of depth layers based on the image; projecting a safety zone of the movable object onto at least one of the depth layers, determining whether an object is an obstacle based on a position of the object on the at least one of the depth layers relative to the projected safety zone, and adjusting a travel path of the movable object to travel around the obstacle.

## Claims

### Claim 1

A method of controlling a movable object, comprising:
obtaining an image of a surrounding of the movable object;
obtaining a plurality of depth layers based on the image;
projecting a safety zone of the movable object onto at least one of the depth layers;
determining whether an object is an obstacle based on a position of the object on the at least one of the depth layers relative to the projected safety zone; and
adjusting a travel path of the movable object to travel around the obstacle.

### Claim 2 (depends on 1)

The method of claim 1, further comprising determining a size of the safety zone based on a size of the movable object and a current velocity of the movable object.

### Claim 3 (depends on 1)

The method of claim 1,
wherein the safety zone includes at least one of a flying tunnel or a crash tunnel, and
wherein determining whether the object is the obstacle includes analyzing the position of the object with the at least one of the flying tunnel or the crash tunnel as projected onto the at least one of the depth layers.

### Claim 4 (depends on 3)

The method of claim 3, further comprising obtaining depth information of pixels of the image.

### Claim 5 (depends on 4)

The method of claim 4, wherein obtaining the plurality of depth layers includes generating the depth layers based on the depth information of the pixels, each depth layer including pixels having a predetermined depth or a predetermined range of depth.

### Claim 6 (depends on 5)

The method of claim 5, further comprising projecting the at least one of the flying tunnel or the crash tunnel onto the at least one of the depth layers.

### Claim 7 (depends on 6)

The method of claim 6, wherein determining whether the object is the obstacle based on the position of the object on the at least one of the depth layers relative to the projected safety zone includes counting a total number of pixels of the object within a projection of the at least one of the flying tunnel or the crash tunnel on the at least one of the depth layers.

### Claim 8 (depends on 7)

The method of claim 7, wherein counting the total number of pixels includes using a first weight to adjust a first number of pixels in a projection of the flying tunnel on the at least one of the depth layers and a second weight to adjust a second number of pixels in a projection of the crash tunnel on the at least one of the depth layers.

### Claim 9 (depends on 7)

The method of claim 7, further comprising:
detecting at least one of ground or a wall within the projection of the at least one of the flying tunnel or the crash tunnel,
wherein counting the total number of pixels includes excluding the pixels of the at least one of the ground or the wall within the projection of the at least one of the flying tunnel or the crash tunnel.

### Claim 10 (depends on 1)

The method of claim 1, wherein adjusting the travel path includes imposing a repulsive field onto at least one of a velocity field or an acceleration field of the movable object when the movable object is within a predetermined distance to the object.

### Claim 11 (depends on 1)

The method of claim 1, wherein determining whether the object is the obstacle includes determining that the object is a large object by determining that the object will occupy a predetermined percentage of an image frame in an amount of travel time, and
wherein adjusting the travel path includes adjusting the travel path to avoid getting too close to the object before the object occupies the predetermined percentage of the image frame.

### Claim 12

A system for a movable object, comprising:
a controller including one or more processors configured to:
obtain an image of a surrounding of the movable object;
obtain a plurality of depth layers based on the image;
project a safety zone of the movable object onto at least one of the depth layers;
determine whether an object is an obstacle based on a position of the object on the at least one of the depth layers relative to the projected safety zone; and
adjust a travel path of the movable object to travel around the obstacle.

### Claim 13 (depends on 12)

The system of claim 12,
wherein the safety zone includes at least one of a flying tunnel or a crash tunnel, and
wherein determining whether the object is the obstacle includes analyzing the position of the object with the at least one of the flying tunnel or the crash tunnel as projected onto the at least one of the depth layers.

### Claim 14 (depends on 13)

The system of claim 13, wherein the one or more processors are further configured to obtain depth information of pixels of the image.

### Claim 15 (depends on 14)

The system of claim 14, wherein obtaining the plurality of depth layers includes generating the depth layers based on the depth information of the pixels, each depth layer including pixels having a predetermined depth or a predetermined range of depth.

### Claim 16 (depends on 15)

The system of claim 15, wherein the one or more processors are further configured to project the at least one of the flying tunnel or the crash tunnel onto the at least one of the depth layers.

### Claim 17 (depends on 16)

The system of claim 16, wherein determining whether the object is the obstacle based on the position of the object on the at least one of the depth layers relative to the projected safety zone includes counting a total number of pixels of the object within a projection of the at least one of the flying tunnel or the crash tunnel.

### Claim 18 (depends on 16)

The system of claim 16, wherein the one or more processors are further configured to determine that at least a portion of the object is within the safety zone when the total number of pixels is greater than a predetermined threshold.

### Claim 19 (depends on 12)

The system of claim 12, wherein determining whether the object is the obstacle includes determining that the object is a large object by determining that the object will occupy a predetermined percentage of an image frame in an amount of travel time, and
wherein adjusting the travel path includes adjusting the travel path to avoid getting too close to the object before the object occupies the predetermined percentage of the image frame.

### Claim 20

An unmanned aerial vehicle (UAV) system, comprising:
one or more propulsion devices; and
a controller in communication with the one or more propulsion devices and including one or more processors configured to:
obtain an image of a surrounding of the UAV;
obtain a plurality of depth layers based on the image;
project a safety zone of the UAV onto at least one of the depth layers;
determine whether an object is an obstacle based on a position of the object on the at least one of the depth layers relative to the projected safety zone; and
adjust a travel path of the UAV to travel around the obstacle.
