# US 2023/0273033 A1 · Method, apparatus, electronic device, computer program, and computer readable recording medium for measuring inter-vehicle distance based on vehicle image

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0273033 A1
- Document ID: US20230273033A1
- Status: Published application
- Kind: A1
- Application number: 18/144,333
- Filed: 2023-05-08
- Published: 2023-08-31
- Earliest claimed: 2020-01-21
- Assignees: Thinkware Corporation
- Applicants: Thinkware Corporation
- Inventors: Shin Hyoung Kim; Tae Kyu Han
- Web page: https://patentgrep.com/patent/US20230273033A1

## CPC

- G01C 21/3602: {Input other than that of destination using image analysis, e.g. detection of road signs, lanes, buildings, real preceding vehicles using a camera}
- B60W 60/001: {Planning or execution of driving tasks}
- G06F 18/213: Feature extraction, e.g. by transforming the feature space; Summarisation; Mappings, e.g. subspace methods
- G06F 18/214: Generating training patterns; Bootstrap methods, e.g. bagging or boosting
- G06N 3/08: Learning methods
- G06V 10/25: Determination of region of interest [ROI] or a volume of interest [VOI]
- G06V 10/50: by performing operations within image blocks; by using histograms, e.g. histogram of oriented gradients [HoG]; by summing image-intensity values; Projection analysis
- G06V 10/764: using classification, e.g. of video objects
- G06V 20/41: {Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items (segmenting video sequences G06V20/49)}
- G06V 20/58: Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
- B60W 2420/403: Image sensing, e.g. optical camera
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06V 2201/08: Detecting or categorising vehicles
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A method for measuring an inter-vehicle distance includes acquiring a driving image photographed by a photographing device of a first vehicle which is being driven; detecting a second vehicle from the acquired driving image; detecting first feature points of a second vehicle region in a first frame corresponding to a frame in which the second frame is detected before a frame in which the second vehicle is not detected among a plurality of frames constituting the driving image, when the second vehicle is not detected from the driving image; detecting second feature points in a second frame corresponding to a current frame by tracking the detected first feature points; calculating a feature point change value between the first feature points and the second feature points; and calculating an inter-vehicle distance from the photographing device of the first vehicle to the second vehicle based on the calculated feature point change value.

## Claims

### Claim 1

An apparatus configured to be installed in a first vehicle, the apparatus comprising:
a camera configured to acquire at least one of image in unit of frame; and
a processor configured to detect in the image a second vehicle which is located in front of the first vehicle, and configured to calculate a distance to the second vehicle by using a first procedure or a second procedure which is different from the first procedure,
wherein the first procedure is used in case when the second vehicle is detected in a current frame, and
wherein the second procedure is used in case when the second vehicle is not detected in the current frame.

### Claim 2 (depends on 1)

The apparatus of claim 1, wherein the first procedure is based on machine learning or deep learning and the second procedure is based on feature points tracking in the image.

### Claim 3 (depends on 1)

The apparatus of claim 1, wherein the processor is further configured to detect in the image at least one feature point of the second vehicle.

### Claim 4 (depends on 3)

The apparatus of claim 3, wherein the second procedure comprising the instructions of:
if the second vehicle is not detected in the current frame, calculating the distance to the second vehicle based on first feature points of the second vehicle in a previous frame where the second vehicle is detected.

### Claim 5 (depends on 3)

The apparatus of claim 3, wherein the second procedure comprising the instructions of:
predicting a size of the second vehicle in the current frame where the second vehicle is not detected, based on first feature points of the second vehicle in a previous frame where the second vehicle is detected; and
calculating a distance to the second vehicle based on a plurality of variables including the predicted size of the second vehicle.

### Claim 6 (depends on 5)

The apparatus of claim 5, wherein the size of the second vehicle includes width of the second vehicle in the current frame.

### Claim 7 (depends on 5)

The apparatus of claim 5, wherein the first feature points are in the middle region of the second vehicle.

### Claim 8 (depends on 3)

The apparatus of claim 3, wherein the second procedure comprising the instructions of:
predicting a size of the second vehicle in the current frame where the second vehicle is not detected, based on first feature points of the second vehicle in a previous frame where the second vehicle is detected and based on second feature points of the second vehicle in the current frame, wherein the second feature points are obtained by tracking the first feature points; and
calculating a distance to the second vehicle based on a plurality of variables including the predicted size of the second vehicle.

### Claim 9 (depends on 8)

The apparatus of claim 8, wherein the plurality of variables further includes a first average pixel distance obtained by averaging pixel distances between average pixel position of the first feature points and the first feature points, and a second average pixel distance obtained by averaging pixel distances between average pixel position of the second feature points and the second feature points.

### Claim 10 (depends on 9)

The apparatus of claim 9, wherein the plurality of variables further includes focal length of the camera, and a size class of the second vehicle.

### Claim 11

A method performed by an apparatus configured to be installed in a first vehicle, the method comprising:
acquiring at least one of image in unit of frame;
detecting in the image a second vehicle which is located in front of the first vehicle; and
calculating a distance to the second vehicle by using a first procedure or a second procedure which is different from the first procedure,
wherein the first procedure is used in case when the second vehicle is detected in a current frame, and
wherein the second procedure is used in case when the second vehicle is not detected in the current frame.

### Claim 12 (depends on 11)

The method of claim 11, wherein the first procedure is based on machine learning or deep learning and the second procedure is based on feature points tracking in the image.

### Claim 13 (depends on 11)

The method of claim 11 further comprising:
detecting in the image at least one feature point of the second vehicle.

### Claim 14 (depends on 13)

The method of claim 13, wherein the second procedure comprising the instructions of:
if the second vehicle is not detected in the current frame, calculating the distance to the second vehicle based on first feature points of the second vehicle in a previous frame where the second vehicle is detected.

### Claim 15 (depends on 13)

The method of claim 13, wherein the second procedure comprising the instructions of:
predicting a size of the second vehicle in the current frame where the second vehicle is not detected, based on first feature points of the second vehicle in a previous frame where the second vehicle is detected; and
calculating a distance to the second vehicle based on a plurality of variables including the predicted size of the second vehicle.

### Claim 16

A non-transitory computer readable storage medium configured to be installed in a first vehicle, the storage medium containing instructions to perform a method comprising:
acquiring at least one of image in unit of frame;
detecting in the image a second vehicle which is located in front of the first vehicle; and
calculating a distance to the second vehicle by using a first procedure or a second procedure which is different from the first procedure,
wherein the first procedure is used in case when the second vehicle is detected in a current frame, and
wherein the second procedure is used in case when the second vehicle is not detected in the current frame.

### Claim 17 (depends on 16)

The storage medium of claim 16, wherein the first procedure is based on machine learning or deep learning and the second procedure is based on feature points tracking in the image.

### Claim 18 (depends on 16)

The storage medium of claim 16, wherein the method further comprises:
detecting in the image at least one feature point of the second vehicle.

### Claim 19 (depends on 18)

The storage medium of claim 18, wherein the second procedure comprising the instructions of:
if the second vehicle is not detected in the current frame, calculating the distance to the second vehicle based on first feature points of the second vehicle in a previous frame where the second vehicle is detected.

### Claim 20 (depends on 18)

The storage medium of claim 18, wherein the second procedure comprising the instructions of:
predicting a size of the second vehicle in the current frame where the second vehicle is not detected, based on first feature points of the second vehicle in a previous frame where the second vehicle is detected; and
calculating a distance to the second vehicle based on a plurality of variables including the predicted size of the second vehicle.
