# US 2009/0244263 A1 · Object Detecting System

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2009/0244263 A1
- Document ID: US20090244263A1
- Status: Published application
- Kind: A1
- Application number: 12/260,538
- Filed: 2008-10-29
- Published: 2009-10-01
- Earliest claimed: 2007-10-29
- Assignees: Fuji Jukogyo Kabushiki Kaisha
- Inventors: Toru Saito
- Web page: https://patentgrep.com/patent/US20090244263A1

## CPC

- G01C 3/08: Use of electric radiation detectors
- G06T 7/593: from stereo images
- G06V 20/58: Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
- G06T 2207/30261: Obstacle
- G08G 1/166: {for active traffic, e.g. moving vehicles, pedestrians, bikes}
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G08G: TRAFFIC CONTROL SYSTEMS (guiding railway traffic, ensuring the safety of railway traffic B61L; arrangement of road signs or traffic signals E01F9/00; radar or analogous systems, sonar systems, lidar systems specially adapted for traffic control G01S13/91, G01S15/88, G01S17/88; {radar or analogous systems, sonar systems, lidar systems specially adapted for anti-collision purposes G01S13/93, G01S15/93, G01S17/93})

## Abstract

An object detecting system includes stereo-image taking means for outputting a reference image and a comparative image, stereo matching means for performing stereo matching, object detecting means for detecting an object in the reference image, estimated-region setting means for setting estimated regions of the object in the current frame in the reference image and the comparative image, on the basis of a distance of the object in the reference image in the previous frame, and determination means for correlating information about the object detected in the estimated region of the reference image or information that the object is not detected with information that noise is included, when an absolute value of a difference between average luminances of the estimated regions is more than or equal to a predetermined threshold value.

## Claims

### Claim 1

An object detecting system comprising:
stereo-image taking means including a pair of image taking means mounted inside a front glass, the stereo-image taking means simultaneously taking images of an object around a vehicle in which the object detecting system is mounted and outputting the images as a reference image and a comparative image;
stereo matching means for performing, in the comparative image, stereo matching of a reference pixel block set in the reference image and having a predetermined number of pixels, and for calculating a parallax between the reference pixel block and a comparative pixel block specified in the comparative image, the parallax being calculated for each reference pixel block;
object detecting means for calculating a distance to the vehicle on the basis of the parallax and for detecting the object in the reference image on the basis of the distance;
estimated-region setting means for setting, in the reference image and the comparative image, estimated regions where images of the object are expected to be taken in a current frame, on the basis of the distance of the object in the reference image in the previous frame and a speed of the object relative to the vehicle calculated from the distance; and
determination means for determining whether an absolute value of a difference between an average luminance of the estimated region in the reference image and an average luminance of the corresponding estimated region in the comparative image is more than or equal to a predetermined threshold value, and for correlating information about the object detected in the estimated region of the reference image or information that the object is not detected, with information that noise is included.

### Claim 2 (depends on 1)

The object detecting system according to claim 1, wherein the determination means decreases reliability of information about the parallax or the distance calculated for the object detected in the estimated region of the reference image, or decreases reliability of the information that the object is not detected in the estimated region of the reference image when the object is not detected in the estimated region.

### Claim 3 (depends on 1)

The object detecting system according to claim 1,
wherein the object detecting means calculates a position of the detected object relative to the vehicle on the basis of the distance of the object, and stores the relative position in time series,
wherein the estimated-region setting means estimates a relative position of the object in the current frame on the basis of the relative position and the relative speed of the object in the previous frame, and sets, in the reference image, an estimated region where an image of the object is expected to be taken, and
wherein the estimated-region setting means estimates a parallax in the current frame on the basis of the estimated relative position of the object, and sets an estimated region in the comparative image on the basis of the parallax and the estimated region set in the reference image.

### Claim 4 (depends on 3)

The object detecting system according to claim 3, wherein the relative speed in the next frame is calculated by smoothing filtering in which the relative speed of the object used in the current frame and a difference between the relative positions in the previous frame and the current frame are subjected to weighted addition by an addition ratio.

### Claim 5 (depends on 4)

The object detecting system according to claim 4, wherein, when the object correlated with the information that noise is included is detected in the estimated region of the reference image, the addition ratio of the difference is decreased for the object in the smoothing filtering in the current frame.

### Claim 6 (depends on 4)

The object detecting system according to claim 4, wherein, when the object correlated with the information that noise is included is not detected in the estimated region of the reference image, the relative speed used for the object in the current frame is set as the relative speed in the next frame.

### Claim 7 (depends on 1)

The object detecting system according to claim 1, wherein the determination means deletes information about the object when the object is not detected in the estimated region set in the reference image.

### Claim 8 (depends on 1)

The object detecting system according to claim 1, wherein, when the information about the object detected in the estimated region of the reference image or the information that the object is not detected is correlated with the information that noise is included, the determination means tightens a criterion of stereo matching performed by the stereo matching means.

### Claim 9 (depends on 1)

The object detecting system according to claim 1, wherein, when the average luminance in one of the estimated region of the reference image and the estimated region of the comparative image is less than the average luminance of the other estimated region by the threshold value only for about one frame, the determination means determines that a wiper cuts in front of the image taking means that takes the reference image or the comparative image to which the estimated region having the lower average luminance belongs.

### Claim 10 (depends on 1)

The object detecting system according to claim 1, wherein, when a state in which an absolute value of a difference between the average luminance in one of the estimated region of the reference image and the average luminance in the estimated region of the comparative image is more than or equal to the threshold value continues for a predetermined number of frames or more, the determination means determines that a substance adheres to the front glass in front of the image taking means that takes the reference image or the comparative image.
