# US 2019/0291642 A1 · Driver assistance apparatus and vehicle having the same

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0291642 A1
- Document ID: US20190291642A1
- Status: Published application
- Kind: A1
- Application number: 16/316,948
- Filed: 2016-10-13
- Published: 2019-09-26
- Earliest claimed: 2016-07-11
- Assignees: LG Electronics Inc.
- Applicants: LG Electronics Inc.
- Inventors: Kyuyeol CHAE; Kwon LEE
- Web page: https://patentgrep.com/patent/US20190291642A1

## CPC

- B60R 1/27: providing all-round vision, e.g. using omnidirectional cameras
- B60W 30/18163: {Lane change; Overtaking manoeuvres}
- B60R 1/31: providing stereoscopic vision
- B60W 40/02: related to ambient conditions
- B60W 50/14: Means for informing the driver, warning the driver or prompting a driver intervention
- G06T 7/30: Determination of transform parameters for the alignment of images, i.e. image registration
- G06V 20/56: exterior to a vehicle by using sensors mounted on the vehicle
- G06V 20/58: Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
- H04N 5/265: Mixing
- H04N 23/698: for achieving an enlarged field of view, e.g. panoramic image capture
- B60R 2300/105: using multiple cameras
- B60R 2300/303: using joined images, e.g. multiple camera images
- B60R 2300/607: from a bird's eye viewpoint
- B60W 2050/146: {Display means}
- B60W 2420/403: Image sensing, e.g. optical camera
- B60W 2554/80: Spatial relation or speed relative to objects
- G06T 2207/10016: Video; Image sequence
- G06T 2207/30252: Vehicle exterior; Vicinity of vehicle
- B60R: VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A driver assistance apparatus according to an embodiment of the present invention includes: a first camera configured to capture a first video of the vicinity of a vehicle; a second camera configured to capture a second video of the vicinity of the vehicle; a processor configured to extract a first edge of an object included in a first stitching region in which the first video and the second video of the vicinity of the vehicle are connected; and a display unit configured to overlap and display the first edge and a synthetic video of the first and second videos of the vicinity of the vehicle except for the first stitching region, wherein the first stitching region is a fixed region included in the first video and the second video of the vicinity of the vehicle.

## Claims

### Claim 1

A driver assistance apparatus comprising:
a display;
a first camera configured to capture a first video of the vicinity of a vehicle;
a second camera configured to capture a second video of the vicinity of the vehicle; and
a processor configured to:
extract a first edge of a first object included in a first stitching region connecting the first video of the vicinity of the vehicle with the second video of the vicinity of the vehicle,
display a first synthetic video based on the first and second videos of the vicinity of the vehicle without including the first stitching region, and
display the first edge of the first object overlapping with a first portion corresponding to an area where the first stitching region has been excluded from the first synthetic video,
wherein the first stitching region is a fixed region included in the first video and the second video of the vicinity of the vehicle.

### Claim 2 (depends on 1)

The driver assistance apparatus of claim 1, further comprising:
a third camera configured to capture a third video of the vicinity of the vehicle,
wherein the processor is further configured to:
extract a second edge of a second object included in a second stitching region connecting the second video of the vicinity of the vehicle with the third video of the vicinity of the vehicle are connected,
display a second synthetic video based on the first, second and third videos of the vicinity of the vehicle without including the first and second stitching regions,
display the first edge of the first object overlapping with a first portion corresponding to an area where the first stitching region has been excluded from the second synthetic video, and
display the second edge of the second object overlapping with a second portion corresponding to an area where the second stitching region has been excluded from the second synthetic video, and
wherein the second stitching region is a fixed region included in the second video and the third video of the vicinity of the vehicle.

### Claim 3 (depends on 2)

The driver assistance apparatus of claim 2, wherein the processor is further configured to:
calculate a first speed of the first object included in the first stitching region,
calculate a second speed of the second object included in the second stitching region,
calculate a first distance between the first object and the vehicle, and
calculate a second distance between the second object and the vehicle.

### Claim 4 (depends on 3)

The driver assistance apparatus of claim 3, wherein the processor is further configured to:
display a top-view video of the vicinity of the vehicle viewed from above based on the first speed, the second speed, the first distance and the second distance.

### Claim 5 (depends on 4)

The driver assistance apparatus of claim 4, wherein the processor is further configured to:
detect a specific object included in at least one of the first, second or third videos of the vicinity of the vehicle, and
display a message indicating detection of the specific object,
wherein the specific object includes at least one of a car, a motorcycle, a bicycle, or a human.

### Claim 6 (depends on 4)

The driver assistance apparatus of claim 4, wherein the processor is further configured to:
detect a lane change operation of the vehicle, and
in response to detecting the lane change operation, display a lane change guide message based on the first speed, the second speed, the first distance and the second distance.

### Claim 7 (depends on 6)

The driver assistance apparatus of claim 6, wherein the processor detects the lane change operation of the vehicle based on a movement of a wheel of the vehicle.

### Claim 8 (depends on 6)

The driver assistance apparatus of claim 6, wherein the processor detects the lane change operation of the vehicle based on a movement of a vehicle icon included in the top-view video.

### Claim 9 (depends on 6)

The driver assistance apparatus of claim 6, wherein the lane change guide message is displayed based on a speed of an object located in a lane into which the vehicle is to switch into, and a distance between the vehicle and the object.

### Claim 10 (depends on 6)

The driver assistance apparatus of claim 6, wherein the processor displays the lane change guide message when a distance between the vehicle and any one of the first and second objects is less than a pre-set distance.

### Claim 11 (depends on 2)

The driver assistance apparatus of claim 2, wherein the first camera is a camera located at a front right side of the vehicle, the second camera is a camera located at a rear center of the vehicle, and the third camera is a camera located at a front left side of the vehicle.

### Claim 12 (depends on 5)

The driver assistance apparatus of claim 5, wherein the specific object includes at least one of a car, a motorcycle, a bicycle, or a human.

### Claim 13 (depends on 4)

The driver assistance apparatus of claim 4, wherein the top-view video includes the first speed, the second speed, the first distance and the second distance.

### Claim 14 (depends on 1)

The driver assistance apparatus of claim 1, wherein the processor is further configured to:
set an overlap region of the first video of the vicinity of the vehicle and the second video of the vicinity of the vehicle as the first stitching region.

### Claim 15 (depends on 2)

The driver assistance apparatus of claim 2, wherein the processor is further configured to:
set an overlap region of the second video of the vicinity of the vehicle and the third video of the vicinity of the vehicle as the second stitching region.

### Claim 16

A method for operating a driver assistance apparatus, the method comprising:
capturing a first video of the vicinity of a vehicle;
capturing a second video of the vicinity of the vehicle;
extracting a first edge of a first object included in a first stitching region connecting the first video of the vicinity of the vehicle with the second video of the vicinity of the vehicle;
displaying a first synthetic video based on the first and second videos of the vicinity of the vehicle without including the first stitching region; and
displaying the first edge of the first object overlapping with a first portion corresponding to an area where the first stitching region has been excluded from the first synthetic video,
wherein the first stitching region is a fixed region included in the first video and the second video of the vicinity of the vehicle.

### Claim 17 (depends on 16)

The method according to claim 16, further comprising:
capturing a third video of the vicinity of the vehicle;
extracting a second edge of a second object included in a second stitching region connecting the second video of the vicinity of the vehicle with the third video of the vicinity of the vehicle;
displaying a second synthetic video based on the first, second and third videos of the vicinity of the vehicle without including the first and second stitching regions;
display the first edge of the first object overlapping with a first portion corresponding to an area where the first stitching region has been excluded from the second synthetic video; and
displaying the second edge of the second object overlapping with a second portion corresponding to an area where the second stitching region has been excluded from the second synthetic video,
wherein the second stitching region is a fixed region included in the second video and the third video of the vicinity of the vehicle.

### Claim 18 (depends on 17)

The method according to claim 17, further comprising:
calculating a first speed of the first object included in the first stitching region;
calculating a second speed of the second object included in the second stitching region;
calculating a first distance between the first object and the vehicle; and
calculating a second distance between the second object and the vehicle.

### Claim 19 (depends on 18)

The method according to claim 18, further comprising:
displaying a top-view video of the vicinity of the vehicle viewed from above based on the first speed, the second speed, the first distance and the second distance.

### Claim 20 (depends on 18)

The method according to claim 18, further comprising:
detecting a specific object included in at least one of the first, second or third videos of the vicinity of the vehicle, and
displaying a message indicating detection of the specific object.
