# US 2024/0199028 A1 · Vehicle equipped with a sensor information fusion device and a merging method using the same

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0199028 A1
- Document ID: US20240199028A1
- Status: Published application
- Kind: A1
- Application number: 18/526,665
- Filed: 2023-12-01
- Published: 2024-06-20
- Earliest claimed: 2022-12-16
- Assignees: Hyundai Motor Company; Kia Corporation
- Applicants: Hyundai Motor Company; Kia Corporation
- Inventors: Bo Young Yun; In Sun Lee
- Web page: https://patentgrep.com/patent/US20240199028A1

## CPC

- B60W 40/02: related to ambient conditions
- B60W 60/0027: {using trajectory prediction for other traffic participants}
- G01S 17/86: Combinations of lidar systems with systems other than lidar, radar or sonar, e.g. with direction finders
- G01S 17/931: of land vehicles
- B60W 2420/408: Radar; Laser, e.g. lidar
- B60W 2554/4041: Position
- B60W 2556/35: Data fusion
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES

## Abstract

A vehicle includes a sensing device including one or more sensors configured to obtain information on a target object present around the vehicle. The vehicle also includes a sensor information fusion device including a processor configured to generate or maintain a sensor fusion track using the information on the target object provided by the sensing device. The processor is configured to generate one or more tracks using the information on the target object provided by the one or more sensors. The processor is also configured to determine a similarity between the generated one or more tracks and generate the sensor fusion track. The processor is further configured to manage the generated sensor fusion track.

## Claims

### Claim 1

A vehicle, comprising:
a sensing device comprising one or more sensors configured to obtain information on a target object present around the vehicle; and
a sensor information fusion device comprising a processor configured to generate or maintain a sensor fusion track using the information on the target object provided by the sensing device, wherein the processor is configured to:
generate one or more tracks using the information on the target object provided by the one or more sensors,
determine a similarity between the generated one or more tracks,
generate the sensor fusion track, and
manage the generated sensor fusion track.

### Claim 2 (depends on 1)

The vehicle of claim 1, wherein the processor is further configured to:
assign an identifier (ID) and an age of a dynamic object fusion (DOF) track to identify the DOF track in the sensor fusion track;
update the age of the DOF track to maintain the DOF track; and
when the DOF track satisfies a coasting age, control the DOF track to disappear.

### Claim 3 (depends on 2)

The vehicle of claim 2, wherein the age of the DOF track increases as the updating is performed.

### Claim 4 (depends on 3)

The vehicle of claim 3, wherein the processor is configured to:
convert the DOF track to a coasting DOF track when the coasting age is satisfied, and
delete the coasting DOF track when the coasting age reaches a preset value.

### Claim 5 (depends on 4)

The vehicle of claim 4, wherein the processor is configured to:
in response to two different DOF tracks overlapping with each other, use a longitudinal position of a smaller DOF track of the two different DOF tracks that are different in a longitudinal direction when a specific condition is satisfied.

### Claim 6 (depends on 5)

The vehicle of claim 5, wherein the processor is configured to:
in response to the two different DOF tracks overlapping with each other, add a size of a length of the other remaining DOF track, among the two different DOF tracks, to the longitudinal position of the smaller DOF track and output a result therefrom as a single DOF track.

### Claim 7 (depends on 6)

The vehicle of claim 6, wherein a condition for entry into absorbing and merging the two different DOF tracks is satisfied when:
indices of the two different DOF tracks are different,
respective IDs of the two different DOF tracks are valid,
a status of the DOF tracks is not an initial value, and
the two different DOF tracks correspond to the vehicle.

### Claim 8 (depends on 7)

The vehicle of claim 7, wherein a condition for application of absorbing and merging the two different DOF tracks is satisfied when:
an overlapping area of the two different DOF tracks is greater than 0.1 square meters,
a longitudinal position of each of the two different DOF tracks is less than 6 meters (m),
respective horizontal positions of the two different DOF tracks are left/right side lanes,
a difference in horizontal position between the two different DOF tracks is less than 0.7 m,
a longitudinal position of a DOF track to be absorbed of the two different DOF tracks is greater than a longitudinal position of an absorbing DOF track of the two different DOF tracks,
a difference between a longitudinal position of a center point of a front bumper of a corner radar (CR) track of one of the two different DOF tracks and a longitudinal position of a center point of a rear bumper of the CR track of the other one of the two different DOF tracks is within 2 m,
a difference between the longitudinal position of the center point of the front bumper of the CR track of one of the two different DOF tracks and a longitudinal position of a center point of the rear bumper of a front corner lidar (FCL) track of the other one of the two different DOF track is within 1.3 m, and
a CR is comprised in each of the two different DOF tracks, an FCL is comprised in each of the two different DOF tracks, or an FCL is only in the DOF track to be absorbed.

### Claim 9 (depends on 8)

The vehicle of claim 8, wherein a condition for execution of absorbing and merging the two different DOF tracks is satisfied when:
the absorbing and merging have been completed on the two different DOF tracks,
a length of the DOF track to be absorbed is added to an absolute value of a difference in longitudinal position between the two different DOF tracks,
the FCL is not present in the absorbing DOF track of the two different DOF tracks, and the FCL is present in the DOF track to be absorbed of the two different DOF tracks,
in the presence of the FCL in both the two different DOF tracks, a length of the FCL in the absorbing DOF track is smaller than a length of the FCL in the DOF track to be absorbed, and
a longitudinal position of the DOF track on which the absorbing and merging have been completed is set to a longitudinal position of the absorbing DOF track.

### Claim 10 (depends on 9)

The vehicle of claim 9, wherein the processor is configured to:
when the absorbing and merging have been completed on the two different DOF tracks, delete the DOF track, among the two different DOF tracks, that has been absorbed and merged.

### Claim 11

A method for absorbing and merging sensor fusion tracks using a sensor information fusion device of a vehicle, the method comprising:
generating, by a processor of the sensor information fusion device, one or more tracks using information on a target object around the vehicle, the information provided by one or more sensors,
determining, by the processor, a similarity between the generated one or more tracks,
generating, by the processor, the sensor fusion track, and
managing, by the processor, the generated sensor fusion track.

### Claim 12 (depends on 11)

The method of claim 11, further comprising:
assigning, by the processor, an identifier (ID) and an age of a dynamic object fusion (DOF) track to identify the DOF track in the sensor fusion track;
updating, by the processor, the age of the DOF track to maintain the DOF track; and
when the DOF track satisfies a coasting age, controlling, by the processor, the DOF track to disappear.

### Claim 13 (depends on 12)

The method of claim 12, wherein the age of the DOF track increases as the updating is performed.

### Claim 14 (depends on 13)

The method of claim 13, wherein:
when the coasting age is satisfied, the DOF track is converted to a coasting DOF track, and
when the coasting age reaches a preset specific value, the coasting DOF track is deleted.

### Claim 15 (depends on 14)

The method of claim 14, further comprising:
in response to two different DOF tracks overlapping each other, of the two different DOF tracks that are different in a longitudinal direction, using, by the processor, a longitudinal position of a smaller DOF track when a specific condition is satisfied.

### Claim 16 (depends on 15)

The method of claim 15, further comprising:
in response to the two different DOF tracks overlapping each other, adding, by the processor, a size of a length of the other remaining DOF track, among the two different DOF tracks, to the longitudinal position of the smaller DOF track and outputting a result therefrom as a single DOF track.

### Claim 17 (depends on 16)

The method of claim 16, wherein a condition for entry into absorbing and merging the two different DOF tracks is satisfied when:
indices of the two different DOF tracks are different, respective IDs of the two different DOF tracks are valid, a status of the DOF tracks is not an initial value, and
the two different DOF tracks correspond to the vehicle.

### Claim 18 (depends on 17)

The method of claim 17, wherein a condition for application of absorbing and merging the two different DOF tracks is satisfied when:
an overlapping area of the two different DOF tracks is greater than 0.1 square meters,
a longitudinal position of each of the two different DOF tracks is less than 6 meters (m),
respective horizontal positions of the two different DOF tracks are left/right side lanes,
a difference in horizontal position between the two different DOF tracks is less than 0.7 m,
a longitudinal position of a DOF track to be absorbed of the two different DOF tracks is greater than a longitudinal position of an absorbing DOF track of the two different DOF tracks,
a difference between a longitudinal position of a center point of a front bumper of a corner radar (CR) track of one of the two different DOF tracks and a longitudinal position of a center point of a rear bumper of the CR track of the other one of the two different DOF tracks is within 2 m,
a difference between the longitudinal position of the center point of the front bumper of the CR track of one of the two different DOF tracks and a longitudinal position of a center point of the rear bumper of a front corner lidar (FCL) track of the other one of the two different DOF track is within 1.3 m, and
a CR is comprised in each of the two different DOF tracks, an FCL is comprised in each of the two different DOF tracks, or an FCL is only in the DOF track to be absorbed.

### Claim 19 (depends on 18)

The method of claim 18, wherein a condition for execution of absorbing and merging the two different DOF tracks is satisfied when:
the absorbing and merging have been completed on the two different DOF tracks,
a length of the DOF track to be absorbed is added to an absolute value of a difference in longitudinal position between the two different DOF tracks,
the FCL is not present in the absorbing DOF track of the two different DOF tracks, and the FCL is present in the DOF track to be absorbed of the two different DOF tracks,
in the presence of the FCL in both the two different DOF tracks, a length of the FCL in the absorbing DOF track is smaller than a length of the FCL in the DOF track to be absorbed, and
a longitudinal position of the DOF track on which the absorbing and merging have been completed is set to a longitudinal position of the absorbing DOF track.

### Claim 20 (depends on 19)

The method of claim 19, further comprising when the absorbing and merging have been completed on the two different DOF tracks, deleting, by the processor, a DOF track that has been absorbed and merged, of the two different DOF tracks.
