# US 2023/0391372 A1 · Method of detecting moving objects, device, electronic device, and storage medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0391372 A1
- Document ID: US20230391372A1
- Status: Published application
- Kind: A1
- Application number: 18/144,048
- Filed: 2023-05-05
- Published: 2023-12-07
- Earliest claimed: 2022-06-02
- Assignees: Hon Hai Precision Industry Co., Ltd.
- Applicants: Hon Hai Precision Industry Co., Ltd.
- Inventors: YU-HSUAN CHIEN; CHIN-PIN KUO
- Web page: https://patentgrep.com/patent/US20230391372A1

## CPC

- B60W 60/0025: {specially adapted for specific operations}
- G06T 1/20: Processor architectures; Processor configuration, e.g. pipelining
- G06T 1/60: Memory management
- G06T 7/20: Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51)
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G06V 10/25: Determination of region of interest [ROI] or a volume of interest [VOI]
- G06V 10/42: Global feature extraction by analysis of the whole pattern, e.g. using frequency domain transformations or autocorrelation
- G06T 2207/10028: Range image; Depth image; 3D point clouds
- G06T 2207/20084: Artificial neural networks [ANN]
- G06T 2207/30196: Human being; Person
- G06T 2207/30261: Obstacle
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A method of detecting moving objects is provided. The method obtains point cloud data set of a target scene and an image of the target scene. The method detects one or more stationary object areas from the image. The method records point cloud data, which corresponds to the stationary object areas in the point cloud data set, to be first point cloud data. The method determines a velocity range of the first point cloud data according to the first point cloud data. The method further determines whether one or more moving objects are present in the target scene according to second point cloud data and the velocity range of the first point cloud data. The second point cloud data is the point cloud data of the point cloud data set excluding the first point cloud data. A related electronic device and a non-transitory storage medium are provided.

## Claims

### Claim 1

A method of detecting moving objects comprising:
obtaining a point cloud data set of a target scene and an image of the target scene;
detecting one or more stationary object areas from the image;
recording point cloud data, which corresponds to the stationary object areas in the point cloud data set, to be first point cloud data;
determining a velocity range of the first point cloud data according to the first point cloud data; and
determining whether one or more moving objects are present in the target scene according to second point cloud data and the velocity range of the first point cloud data, wherein the second point cloud data is the point cloud data of the point cloud data set excluding the first point cloud data.

### Claim 2 (depends on 1)

The method according to claim 1, wherein the recording the point cloud data corresponding to the stationary object areas in the point cloud data set to be first point cloud data comprises:
converting the point cloud data of the point cloud data set into two-dimensional coordinates, and to obtain a two-dimensional coordinates set corresponding to the point cloud data set;
determining, for any one of the two-dimensional coordinates in the two-dimensional coordinates set, whether the two-dimensional coordinates correspond to one of the stationary object areas;
if any one of the two-dimensional coordinates in the two-dimensional coordinates set is determined to correspond to the one of the stationary object areas, recording the point cloud data corresponding to the two-dimensional coordinates to be the first point cloud data.

### Claim 3 (depends on 2)

The method according to claim 2, wherein the determining, for any one of the two-dimensional coordinates in the two-dimensional coordinates set, whether the two-dimensional coordinates corresponds to one of the stationary object areas comprises:
obtaining a range of coordinates of the one or more stationary object areas, wherein the one or more stationary object areas are one or more areas where a ground is;
determining, for any one of the two-dimensional coordinates in the two-dimensional coordinates set, whether the two-dimensional coordinates are within the range of the coordinates of the one or more stationary object areas;
determining that the two-dimensional coordinates correspond to the one or more stationary object areas if the two-dimensional coordinates are within the range of the coordinates of the one or more stationary object areas.

### Claim 4 (depends on 3)

The method according to claim 3, wherein the determining the velocity range of the first point cloud data according to the first point cloud data comprises:
obtaining a velocity of each of the first point cloud data;
determining the velocity range of the first point cloud data according to the velocity of each of the first point cloud data.

### Claim 5 (depends on 1)

The method according to claim 1, wherein the determining whether one or more moving objects are existed in the target scene according to the second point cloud data and the velocity range of the first point cloud data comprises:
determining whether the velocities of the second point cloud data are within the velocity range of the first point cloud data;
recording one or more target objects corresponding to the second point cloud data to be the one or more moving objects if the velocities of the second point cloud data are within the velocity range of the first point cloud data, wherein the one or more target objects are one or more objects in the target scene.

### Claim 6 (depends on 5)

The method according to claim 5, wherein the method further comprises:
determining one or more target pixels of the image according to the two-dimensional coordinates corresponding to the second point cloud data, if the velocities of the second point cloud data are out of the velocity range of the first point cloud data;
determining one or more areas where the one or more target pixels are to be one or more moving object areas.

### Claim 7 (depends on 1)

The method according to claim 1, wherein the obtaining the point cloud data set of the target scene and the image of the target scene comprises:
obtaining the point cloud data set of the target scene via a radar, the radar collecting the point cloud data set of the target scene;
obtaining the image of the target scene via an imaging device, the imaging device capturing the image of the target scene; wherein the imaging device captures the image of the target scene and the radar collects the point cloud data set of the target scene simultaneously.

### Claim 8

An electronic device comprising:
a storage device;
at least one processor; and
the storage device storing one or more programs, which when executed by the at least one processor, cause the at least one processor to:
obtain a point cloud data set of a target scene and an image of the target scene;
detect one or more stationary object areas from the image;
record point cloud data, which corresponds to the stationary object areas in the point cloud data set, to be first point cloud data;
determine a velocity range of the first point cloud data according to the first point cloud data; and
determine whether one or more moving objects are present in the target scene according to second point cloud data and the velocity range of the first point cloud data, wherein the second point cloud data is the point cloud data of the point cloud data set excluding the first point cloud data.

### Claim 9 (depends on 8)

The electronic device according to claim 8, further causing the at least one processor to:
convert the point cloud data of the point cloud data set into two-dimensional coordinates, and to obtain a two-dimensional coordinates set corresponding to the point cloud data set;
determine, for any one of the two-dimensional coordinates in the two-dimensional coordinates set, whether the two-dimensional coordinates correspond to one of the stationary object areas;
if any one of the two-dimensional coordinates in the two-dimensional coordinates set is determined to correspond to the one of the stationary object areas, record the point cloud data corresponding to the two-dimensional coordinates to be the first point cloud data.

### Claim 10 (depends on 9)

The electronic device according to claim 9, further causing the at least one processor to:
obtain a range of coordinates of the one or more stationary object areas, wherein the one or more stationary object areas are one or more areas where a ground is;
determine, for any one of the two-dimensional coordinates in the two-dimensional coordinates set, whether the two-dimensional coordinates are within the range of the coordinates of the one or more stationary object areas;
determine that the two-dimensional coordinates correspond to the one or more stationary object areas if the two-dimensional coordinates are within the range of the coordinates of the one or more stationary object areas.

### Claim 11 (depends on 10)

The electronic device according to claim 10, further causing the at least one processor to:
obtain a velocity of each of the first point cloud data;
determine the velocity range of the first point cloud data according to the velocity of each of the first point cloud data.

### Claim 12 (depends on 8)

The electronic device according to claim 8, further causing the at least one processor to:
determine whether the velocities of the second point cloud data are within the velocity range of the first point cloud data;
record one or more target objects corresponding to the second point cloud data to be the one or more moving objects if the velocities of the second point cloud data are within the velocity range of the first point cloud data, wherein the one or more target objects are one or more objects in the target scene.

### Claim 13 (depends on 12)

The electronic device according to claim 12, further causing the at least one processor to:
determine one or more target pixels of the image according to the two-dimensional coordinates corresponding to the second point cloud data, if the velocities of the second point cloud data are out of the velocity range of the first point cloud data;
determine one or more areas where the one or more target pixels are to be one or more moving object areas.

### Claim 14 (depends on 8)

The electronic device according to claim 8, further causing the at least one processor to:
obtain the point cloud data set of the target scene via a radar, the radar collecting the point cloud data set of the target scene;
obtain the image of the target scene via an imaging device, the imaging device capturing the image of the target scene; wherein the imaging device captures the image of the target scene and the radar collects the point cloud data set of the target scene simultaneously.

### Claim 15

A non-transitory storage medium storing a set of commands, when the commands being executed by at least one processor of an electronic device, causing the at least one processor to:
obtain a point cloud data set of a target scene and an image of the target scene;
detect one or more stationary object areas from the image;
record point cloud data, which corresponds to the stationary object areas in the point cloud data set, to be first point cloud data;
determine a velocity range of the first point cloud data according to the first point cloud data; and
determine whether one or more moving objects are present in the target scene according to second point cloud data and the velocity range of the first point cloud data, wherein the second point cloud data is the point cloud data of the point cloud data set excluding the first point cloud data.

### Claim 16 (depends on 15)

The non-transitory storage medium according to claim 15, further causing the at least one processor to:
convert the point cloud data of the point cloud data set into two-dimensional coordinates, and to obtain a two-dimensional coordinates set corresponding to the point cloud data set;
determine, for any one of the two-dimensional coordinates in the two-dimensional coordinates set, whether the two-dimensional coordinates correspond to one of the stationary object areas;
if any one of the two-dimensional coordinates in the two-dimensional coordinates set is determined to correspond to the one of the stationary object areas, record the point cloud data corresponding to the two-dimensional coordinates to be the first point cloud data.

### Claim 17 (depends on 16)

The non-transitory storage medium according to claim 16, further causing the at least one processor to:
obtain a range of coordinates of the one or more stationary object areas, wherein the one or more stationary object areas are one or more areas where a ground is;
determine, for any one of the two-dimensional coordinates in the two-dimensional coordinates set, whether the two-dimensional coordinates are within the range of the coordinates of the one or more stationary object areas;
determine that the two-dimensional coordinates correspond to the one or more stationary object areas if the two-dimensional coordinates are within the range of the coordinates of the one or more stationary object areas.

### Claim 18 (depends on 17)

The non-transitory storage medium according to claim 17, further causing the at least one processor to:
obtain a velocity of each of the first point cloud data;
determine the velocity range of the first point cloud data according to the velocity of each of the first point cloud data.

### Claim 19 (depends on 15)

The non-transitory storage medium according to claim 15, further causing the at least one processor to:
determine whether the velocities of the second point cloud data are within the velocity range of the first point cloud data;
record one or more target objects corresponding to the second point cloud data to be the one or more moving objects if the velocities of the second point cloud data are within the velocity range of the first point cloud data, wherein the one or more target objects are one or more objects in the target scene.

### Claim 20 (depends on 19)

The non-transitory storage medium according to claim 19, further causing the at least one processor to:
determine one or more target pixels of the image according to the two-dimensional coordinates corresponding to the second point cloud data, if the velocities of the second point cloud data are out of the velocity range of the first point cloud data;
determine one or more areas where the one or more target pixels are to be one or more moving object areas.
