# US 2017/0287168 A1 · Around view provision apparatus and vehicle including the same

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0287168 A1
- Document ID: US20170287168A1
- Status: Published application
- Kind: A1
- Application number: 15/479,212
- Filed: 2017-04-04
- Published: 2017-10-05
- Earliest claimed: 2016-04-04
- Assignees: LG Electronics Inc.
- Applicants: LG Electronics Inc.
- Inventors: Boyoung JEONG; Alexey ROZHKOV; Denis TIMOSHENKO
- Web page: https://patentgrep.com/patent/US20170287168A1

## CPC

- H04N 7/181: {for receiving images from a plurality of remote sources}
- B60K 35/23: Head-up displays [HUD] (optical aspects of head-up displays G02B27/01)
- B60R 1/27: providing all-round vision, e.g. using omnidirectional cameras
- G06T 3/4038: Image mosaicing, e.g. composing plane images from plane sub-images
- G06T 7/74: {involving reference images or patches}
- G06T 7/80: Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
- G06T 11/60: Creating or editing images; Combining images with text
- H04N 9/3179: {Video signal processing therefor}
- B60K 35/10: Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
- B60K 35/26: using acoustic output
- B60K 2360/334: Projection means
- B60R 2300/105: using multiple cameras
- B60R 2300/303: using joined images, e.g. multiple camera images
- B60R 2300/304: using merged images, e.g. merging camera image with stored images
- B60R 2300/402: Image calibration
- G06T 2207/10016: Video; Image sequence
- G06T 2207/30264: Parking
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- B60K: ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60R: VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Disclosed herein are an around view provision apparatus and a vehicle including the same. The around view provision apparatus includes a plurality of cameras mounted on a vehicle, a display, and a processor configured to receive a plurality of images from the plurality of cameras, to check locations of the images using first area patterns in the plurality of images, to compensate a parameter in an image using second area patterns located in overlapping areas between the plurality of images, and to generate an around view image based on the compensated parameter. Accordingly, it is possible to provide an accurate around view image based on a calibrated image.

## Claims

### Claim 1

An image provision apparatus comprising:
a plurality of cameras mounted on a vehicle and configured to capture images;
a display configured to display information; and
a processor configured to:
receive a plurality of images from the plurality of cameras;
check a location of each of the plurality of images using first area patterns in the plurality of images;
compensate a parameter in an image using second area patterns located in overlapping areas of the image at which at least two of the plurality of images partially overlap; and
cause the display to display an image generated based on the compensated parameter.

### Claim 2 (depends on 1)

The apparatus according to claim 1, wherein the processor is further configured to:
calculate coordinates of a specific point based on the compensated parameter; and
generate the image based on the calculated coordinates.

### Claim 3 (depends on 2)

The apparatus according to claim 2, wherein the processor is further configured to:
calculate the coordinates of the specific point in the overlapping areas based on the compensated parameter; and
synthesize the plurality of images based on the calculated coordinates to generate the image.

### Claim 4 (depends on 1)

The apparatus according to claim 1, wherein:
the first area patterns are located in front, rear, left and right areas of the vehicle; and
the second area patterns are located in corner areas of the vehicle.

### Claim 5 (depends on 1)

The apparatus according to claim 1, wherein each of the first area patterns and second area patterns includes a checker board pattern.

### Claim 6 (depends on 1)

The apparatus according to claim 1, further comprising an image projector configured to output the generated image external to the vehicle,
wherein the processor is further configured to cause the image projector to output the image including the first area patterns and second area patterns when the vehicle is in a reverse gear or when a speed of the vehicle is equal to or less than a predetermined speed.

### Claim 7 (depends on 1)

The apparatus according to claim 1, further comprising a memory configured to store a reference image of each of the plurality of cameras,
wherein the processor is further configured to:
calculate offset information of at least some of the plurality of cameras based on a difference between at least one stored reference image and at least one image captured from a corresponding at least one of the plurality of cameras; and
synthesize the plurality of images from the plurality of cameras using the calculated offset information to generate the image.

### Claim 8 (depends on 7)

The apparatus according to claim 7, wherein the processor is further configured to:
calculate first offset information based on a reference image of a first camera of the plurality of cameras and an image captured from the first camera; and
apply the calculated first offset information to cameras of the plurality of cameras other than the first camera.

### Claim 9 (depends on 7)

The apparatus according to claim 7, wherein:
each of the at least one reference image and the at least one captured image includes a character line of the vehicle; and
the processor is further configured to calculate the offset information based on a difference between the character line in the at least one reference image and the character line in the at least one captured image.

### Claim 10 (depends on 7)

The apparatus according to claim 7, wherein the processor is further configured to cause output of a notification message indicating that the image cannot be generated when the offset information is equal to or greater than a predetermined value.

### Claim 11

A vehicle comprising:
a steering drive unit configured to drive a steering apparatus;
a brake drive unit configured to drive a brake apparatus;
a power source drive unit configured to drive a power source;
a plurality of cameras mounted on the vehicle and configured to capture images;
a display configured to display information; and
a processor configured to:
receive a plurality of images from the plurality of cameras;
check a location of each of the plurality of images using first area patterns in the plurality of images;
compensate a parameter in an image using second area patterns located in overlapping areas of the image at which at least two of the plurality of images partially overlap; and
cause the display to display an image generated based on the compensated parameter.

### Claim 12 (depends on 11)

The vehicle according to claim 11, wherein the processor is further configured to:
calculate coordinates of a specific point based on the compensated parameter; and
generate the image based on the calculated coordinates.

### Claim 13 (depends on 12)

The vehicle according to claim 12, wherein the processor is further configured to:
calculate the coordinates of the specific point in the overlapping areas based on the compensated parameter; and
synthesize the plurality of images based on the calculated coordinates to generate the image.

### Claim 14 (depends on 11)

The vehicle according to claim 11, wherein:
the first area patterns are located in front, rear, left and right areas of the vehicle; and
the second area patterns are located in corner areas of the vehicle.

### Claim 15 (depends on 11)

The vehicle according to claim 11, wherein each of the first area patterns and second area patterns includes a checker board pattern.

### Claim 16 (depends on 11)

The vehicle according to claim 11, further comprising an image projector configured to output the generated image external to the vehicle,
wherein the processor is further configured to cause the image projector to output the image including the first area patterns and second area patterns when the vehicle is in a reverse gear or when a speed of the vehicle is equal to or less than a predetermined speed.

### Claim 17 (depends on 11)

The vehicle according to claim 11, further comprising a memory configured to store a reference image of each of the plurality of cameras,
wherein the processor is further configured to:
calculate offset information of at least some of the plurality of cameras based on a difference between at least one stored reference image and at least one image captured from a corresponding at least one of the plurality of cameras; and
synthesize the plurality of images from the plurality of cameras using the calculated offset information to generate the image.

### Claim 18 (depends on 17)

The vehicle according to claim 17, wherein the processor is further configured to:
calculate first offset information based on a reference image of a first camera of the plurality of cameras and an image captured from the first camera; and
apply the calculated first offset information to cameras of the plurality of cameras other than the first camera.

### Claim 19 (depends on 17)

The vehicle according to claim 17, wherein:
each of the at least one reference image and the at least one captured image includes a character line of the vehicle; and
the processor is further configured to calculate the offset information based on a difference between the character line in the at least one reference image and the character line in the at least one captured image.

### Claim 20 (depends on 17)

The vehicle according to claim 17, wherein the processor is further configured to cause output of a notification message indicating that the image cannot be generated when the offset information is equal to or greater than a predetermined value.
