# US 2020/0402249 A1 · Object distance measurement apparatus and method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0402249 A1
- Document ID: US20200402249A1
- Status: Published application
- Kind: A1
- Application number: 16/908,084
- Filed: 2020-06-22
- Published: 2020-12-24
- Earliest claimed: 2019-06-24
- Assignees: Hyundai Autron Co., Ltd.
- Applicants: Hyundai Autron Co., Ltd.
- Inventors: Kee-Beom KIM
- Web page: https://patentgrep.com/patent/US20200402249A1

## CPC

- G06T 7/579: from motion
- G01S 17/42: Simultaneous measurement of distance and other co-ordinates (indirect measurement G01S17/46)
- G01S 17/86: Combinations of lidar systems with systems other than lidar, radar or sonar, e.g. with direction finders
- G01S 17/931: of land vehicles
- G05D 1/024: {in combination with a laser (lasers per se H01S)}
- G05D 1/0253: {extracting relative motion information from a plurality of images taken successively, e.g. visual odometry, optical flow (determining position or orientation from images G06T7/70)}
- G06T 2207/30261: Obstacle
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES

## Abstract

An object distance measurement apparatus may include: a camera to capture an image of an area around a vehicle; a distance sensor to detect a distance from an object by scanning around the vehicle; and a distance measurement unit that detects a vehicle moving distance using vehicle information generated by operation of the vehicle, and measures the distance from the object in response to each of frames between scan periods of the distance sensor, among frames of the image, based on the vehicle moving distance and the location pixel coordinates of the object within the images before and after the vehicle moves.

## Claims

### Claim 1

An object distance measurement apparatus comprising:
a camera configured to capture an image of an area around a vehicle;
a distance sensor configured to detect a distance from the vehicle to an object by scanning around the vehicle; and
a distance measurement unit configured to:
detect a vehicle moving distance using vehicle information of the vehicle, and
measure the distance from the object in response to each frame among frames of the captured image between scan periods of the distance sensor based on the vehicle moving distance and location pixel coordinates of the object within captured images before and after the vehicle moves.

### Claim 2 (depends on 1)

The object distance measurement apparatus of claim 1, further comprising: a determination unit configured to:
compare a camera frequency of the camera with a scan frequency of the distance sensor, and
determine whether to interpolate the distance from the object for each frame of the frames of the image.

### Claim 3 (depends on 1)

The object distance measurement apparatus of claim 1, wherein the vehicle information comprises at least one of the vehicle moving distance, a steering angle, a vehicle speed, or a travel time.

### Claim 4 (depends on 1)

The object distance measurement apparatus of claim 1, further comprising: a mapping unit configured to map the distance from the object, corresponding to each of the frames between the scan periods of the distance sensor among the frames of the image, to each of the frames between the scan periods of the distance sensor.

### Claim 5 (depends on 1)

The object distance measurement apparatus of claim 1, wherein:
the distance measurement unit is configured to calculate the vehicle moving distance based on a moving distance, a steering angle and a moving angle among the vehicle information, received from an Electronic Control Unit (ECU) of the vehicle, and
the vehicle moving distance is a length of a straight line connecting a first location of the vehicle before the vehicle starts to move to a second location of the vehicle after the vehicle has moved.

### Claim 6 (depends on 5)

The object distance measurement apparatus of claim 5, wherein:
the distance measurement unit is configured to generate a first virtual triangle including: a first side which is set to the calculated vehicle moving distance and a second side which is set to a radius of a virtual circle corresponding to a circular arc along which the vehicle moves, and
the moving angle is calculated based on a length and the radius of the circular arc along which the vehicle moves, and the radius of the circular arc is determined based on the steering angle and previously stored information in a memory.

### Claim 7 (depends on 6)

The object distance measurement apparatus of claim 6, wherein:
apexes of the first virtual triangle respectively correspond to a first location of the camera before the vehicle moves, a second location of the camera after the vehicle has moved, and a location of a contact point between parallel lines tangent to a bumper of the vehicle before the vehicle moves and the bumper of the vehicle after the vehicle has moved, respectively, when the parallel lines are extended toward an inside of the steering angle,
the inside of the steering angle corresponds to an inside of the virtual circle when the vehicle moves in a circular arc shape.

### Claim 8 (depends on 6)

The object distance measurement apparatus of claim 6, wherein when the first virtual triangle is generated, the distance measurement unit is configured to:
generate a second virtual triangle that shares one side with the first virtual triangle, and
calculate the distance from the object based on information of the first virtual triangle.

### Claim 9 (depends on 8)

The object distance measurement apparatus of claim 8, wherein the shared side of the second virtual triangle corresponds to a straight line connecting the locations of the camera of the vehicle before and after the vehicle moves, among three sides forming the first virtual triangle, and apexes of the second virtual triangle are respectively set to the location of the camera before the vehicle moves, the location of the camera after the vehicle has moved, and a center location of the object corresponding to a distance measurement target.

### Claim 10 (depends on 8)

The object distance measurement apparatus of claim 8, wherein the distance measurement unit is configured to:
calculate a length of two sides among three sides forming the second virtual triangle by applying locations of the object in captured images by the camera before and after the vehicle moves, to an epipolar geometry, and
calculate, as the distance from the object, a length of a side corresponding to a straight line connecting a center location of the object to the location of the camera after the vehicle moves, among the three sides of the second virtual triangle.

### Claim 11 (depends on 1)

The object distance measurement apparatus of claim 1, wherein the distance sensor is a lidar sensor.

### Claim 12

An object distance measurement method comprising:
capturing, by a camera, an image of an area around a vehicle;
sensing, by a distance sensor, a distance from an object to the vehicle by scanning around the vehicle; and
detecting, by a distance measurement unit, a vehicle moving distance using vehicle information of the vehicle, and measuring the distance from the object in response to each of frames between scan periods of the distance sensor, among frames of the captured image, based on the vehicle moving distance and location pixel coordinates of the object within captured images before and after the vehicle moves.
