# US 2023/0273976 A1 · Systems and methods for object detection using stereovision information

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0273976 A1
- Document ID: US20230273976A1
- Status: Published application
- Kind: A1
- Application number: 18/311,407
- Filed: 2023-05-03
- Published: 2023-08-31
- Earliest claimed: 2020-12-11
- Assignees: Ford Global Technologies, LLC
- Applicants: Ford Global Technologies, LLC
- Inventors: Xiaoyan Hu; Lingyuan Wang; Michael Happold; Jason Ziglar
- Web page: https://patentgrep.com/patent/US20230273976A1

## CPC

- G06F 18/2193: {based on specific statistical tests}
- H04N 13/239: using two two-dimensional [2D] image sensors having a relative position equal to or related to the interocular distance (H04N13/243 takes precedence)
- G06F 18/24323: {Tree-organised classifiers}
- G06V 10/26: Segmentation of patterns in the image field; Cutting or merging of image elements to establish the pattern region, e.g. clustering-based techniques; Detection of occlusion
- G06V 10/462: {Salient features, e.g. scale invariant feature transforms [SIFT]}
- G06V 10/764: using classification, e.g. of video objects
- G06V 20/58: Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
- H04N 13/161: Encoding, multiplexing or demultiplexing different image signal components (for multi-view video sequence encoding H04N19/597)
- H04N 2013/0081: {Depth or disparity estimation from stereoscopic image signals}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Systems and methods for object detection. The methods include, by a computing device: obtaining a plurality of intensity values denoting at least a difference in a first location of at least one object in a first image and a second location of the at least one object in a second image; converting the intensity values to 3D position values; inputting the 3D position values into a classifier algorithm to obtain classifications for data points of a 3D point cloud (each of the classifications comprising a foreground classification or a background classification); and using the classifications to detect at least one object which is located in a foreground or a background.

## Claims

### Claim 1

A method for object detection, comprising:
obtaining, by a computing device, a plurality of intensity values denoting at least a difference in a first location of at least one object in a first image and a second location of the at least one object in a second image;
converting, by the computing device, the intensity values to 3D position values;
inputting, by the computing device, the 3D position values into a classifier algorithm to obtain classifications for data points of a 3D point cloud, each of the classifications comprising a foreground classification or a background classification, wherein the classifier algorithm comprises a hierarchical decision tree classifier; and
using, by the computing device, the classifications to detect at least one object which is located in a foreground or a background.

### Claim 2 (depends on 1)

The method according to claim 1, further comprising using the classifications to control operations of an autonomous vehicle.

### Claim 3 (depends on 1)

The method according to claim 1, wherein the plurality of intensity values is obtained from a stereo disparity image that is generated based on the first and second images captured concurrently by stereo cameras.

### Claim 4 (depends on 1)

The method according to claim 1, wherein each of the intensity values denotes a position difference between coordinates of a pixel in the first image and coordinates of a corresponding pixel in the second image.

### Claim 5 (depends on 1)

The method according to claim 1, wherein each of the intensity values denotes a distance between a pixel of the first or second image and a location of a camera that captured the first or second image.

### Claim 6 (depends on 1)

The method according to claim 1, wherein the converting comprises projecting each of said intensity values into an xyz-position in a 3D road map.

### Claim 7 (depends on 6)

The method according to claim 6, wherein the projecting is based on a time of image capture, a location of a vehicle at the time of image capture, positions of cameras relative to the vehicle, pixel pointing directions, and distances of the pixels from the cameras.

### Claim 8 (depends on 1)

The method according to claim 1, further comprising estimating a height of each said 3D position value from ground using a 3D road map and inputting the estimated heights into the classifier algorithm along with the 3D position values.

### Claim 9 (depends on 1)

The method according to claim 1, wherein each of the intensity values comprises a scalar value.

### Claim 10

A system, comprising:
a processor; and
a non-transitory computer-readable storage medium comprising programming instructions that are configured to cause the processor to implement a method for object detection, wherein the programming instructions comprise instructions to:
obtain a plurality of intensity values denoting at least a difference in a first location of at least one object in a first image and a second location of the at least one object in a second image;
convert the intensity values to 3D position values;
input the 3D position values into a classifier algorithm to obtain classifications for data points of a 3D point cloud, each of the classifications comprising a foreground classification or a background classification, wherein the classifier algorithm comprises a hierarchical decision tree classifier; and
use the classifications to detect at least one object which is located in a foreground or a background.

### Claim 11 (depends on 10)

The system according to claim 10, wherein the programming instructions comprise instructions to use the classifications to control operations of an autonomous vehicle.

### Claim 12 (depends on 10)

The system according to claim 10, wherein the plurality of intensity values is obtained from a stereo disparity image that is generated based on the first and second images captured concurrently by stereo cameras.

### Claim 13 (depends on 10)

The system according to claim 10, wherein each of the intensity values denotes a position difference between coordinates of a pixel in the first image and coordinates of a corresponding pixel in the second image.

### Claim 14 (depends on 10)

The system according to claim 10, wherein each of the intensity values denotes a distance between a pixel of the first or second image and a location of a camera that captured the first or second image.

### Claim 15 (depends on 10)

The system according to claim 10, wherein the converting comprises projecting each of said intensity values into an xyz-position in a 3D road map.

### Claim 16 (depends on 15)

The system according to claim 15, wherein the projecting is based on a time of image capture, a location of a vehicle at the time of image capture, positions of cameras relative to the vehicle, pixel pointing directions, and distances of the pixels from the cameras.

### Claim 17

A non-transitory computer-readable medium that stores instructions configured to, when executed by at least one computing device, cause the at least one computing device to perform operations comprising:
obtaining a plurality of intensity values denoting at least a difference in a first location of at least one object in a first image and a second location of the at least one object in a second image;
converting the intensity values to 3D position values;
inputting the 3D position values into a classifier algorithm to obtain classifications for data points of a 3D point cloud, each of the classifications comprising a foreground classification or a background classification, wherein the classifier algorithm comprises a hierarchical decision tree classifier; and
using the classifications to detect at least one object which is located in a foreground or a background.

### Claim 18 (depends on 17)

The non-transitory computer-readable medium according to claim 17, wherein each of the intensity values denotes a position difference between coordinates of a pixel in the first image and coordinates of a corresponding pixel in the second image.

### Claim 19 (depends on 17)

The non-transitory computer-readable medium according to claim 17, wherein the converting comprises projecting each of said intensity values into an xyz-position in a 3D road map.

### Claim 20 (depends on 17)

The non-transitory computer-readable medium according to claim 17, wherein each of the intensity values comprises a scalar value.
