# US 2018/0321030 A1 · Image processing device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0321030 A1
- Document ID: US20180321030A1
- Status: Published application
- Kind: A1
- Application number: 15/500,127
- Filed: 2015-08-17
- Published: 2018-11-08
- Earliest claimed: 2014-09-11
- Assignees: Hitachi Automotive Systems, Ltd.
- Applicants: Hitachi Automotive Systems, Ltd.
- Inventors: Hideaki KIDO; Haruki MATONO; Takeshi NAGASAKI; Shinji KAKEGAWA
- Web page: https://patentgrep.com/patent/US20180321030A1

## CPC

- G01C 3/085: {with electronic parallax measurement}
- G01C 3/00: Measuring distances in line of sight; Optical rangefinders (tapes, chains or wheels for measuring length G01B3/00; active triangulation systems, i.e. using the transmission and reflection of electromagnetic waves other than radio waves, G01S17/48)
- G06T 7/248: {involving reference images or patches}
- G06T 7/593: from stereo images
- G06T 7/74: {involving reference images or patches}
- G06V 20/56: exterior to a vehicle by using sensors mounted on the vehicle
- G06T 2207/10012: Stereo images
- G06T 2207/30252: Vehicle exterior; Vicinity of vehicle
- H04N 13/239: using two two-dimensional [2D] image sensors having a relative position equal to or related to the interocular distance (H04N13/243 takes precedence)
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Provided is an image processing device capable of maintaining recognition accuracy for distance, and the like, while meeting conflicting demands such as suppressing the response delay from image input from a camera to calculation result output, enhancing recognition accuracy, reducing calculation load (enhancing processing efficiency), and enhancing response speed. The time of the starting of the processing (S105) of a first distance calculation unit (105) for calculating the relative distance to an object on the basis of current position information determined on the basis of a left or right image and past position information for the object is set to an earlier time than the ending of the processing (S107) of an object detection unit (107) for determining current position information for an object on the basis of parallax information obtained from the left and right images and detecting the object.

## Claims

### Claim 1

An image processing device that measures a relative distance to an object or a relative speed by processing a plurality of images synchronously captured by a plurality of cameras, the object being present in the plurality of images, the image processing device comprising:
an object pursuing unit that performs a pursuing process for deriving current position information of the object on the basis of one of the plurality of images and past position information of the object;
a first distance calculation unit that calculates the relative distance to the object on the basis of the current position information and at least two of the plurality of images;
an object detection unit that detects the object by deriving the current position information of the object on the basis of parallax information obtained from at least two of the plurality of images;
a second distance calculation unit that calculates the relative distance to the object on the basis of a detection result of the object; and
a correction processing unit that corrects at least one of the current position information and the relative distance on the basis of at least one of the current position information derived by the object pursuing unit and the current position information derived by the object detection unit, and the relative distance calculated by the first distance calculation unit and the relative distance calculated by the second distance calculation unit,
wherein a processing start timing of the first distance calculation unit is set to before a processing ending timing of the object detection unit.

### Claim 2 (depends on 1)

The image processing device according to claim 1, wherein the processing start timing of the first distance calculation unit is set to before a processing start timing of the object detection unit.

### Claim 3 (depends on 1)

The image processing device according to claim 1, further comprising a calculation result output unit that outputs a calculation result of the first distance calculation unit to an outside.

### Claim 4 (depends on 1)

The image processing device according to claim 1, wherein the object pursuing unit performs the pursuing process by using, as the past position information of the object, the at least one of the current position information and the relative distance corrected by the correction processing unit.

### Claim 5 (depends on 1)

The image processing device according to claim 1, further comprising
a parallax information obtaining unit that obtains the parallax information from at least two of the plurality of images,
wherein a processing start timing of the object pursuing unit is set to before a processing ending timing of the parallax information obtaining unit.

### Claim 6 (depends on 5)

The image processing device according to claim 5, wherein the processing start timing of the object pursuing unit is set to before a processing start timing of the parallax information obtaining unit.

### Claim 7 (depends on 5)

The image processing device according to claim 5, wherein the processing start timing of the first distance calculation unit is set to after the processing ending timing of the parallax information obtaining unit.

### Claim 8 (depends on 5)

The image processing device according to claim 5, wherein the processing start timing of the first distance calculation unit is set to before the processing ending timing of the parallax information obtaining unit.

### Claim 9 (depends on 1)

The image processing device according to claim 1, wherein processing by the object pursuing unit and the first distance calculation unit and processing by the object detection unit and the second distance calculation unit are performed in parallel.

### Claim 10 (depends on 1)

The image processing device according to claim 1, further comprising a relative speed calculation unit that calculates the relative speed of the object on the basis of the relative distance calculated by the first distance calculation unit.

### Claim 11 (depends on 10)

The image processing device according to claim 10, wherein the correction processing unit corrects the relative speed of the object on the basis of the relative distance calculated by the first distance calculation unit and the relative distance calculated by the second distance calculation unit.
