# US 2018/0324365 A1 · Image conversion device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0324365 A1
- Document ID: US20180324365A1
- Status: Published application
- Kind: A1
- Application number: 15/668,128
- Filed: 2017-08-03
- Published: 2018-11-08
- Earliest claimed: 2017-05-08
- Assignees: Hyundai Motor Company; Kia Motors Corporation
- Applicants: Hyundai Motor Company; Kia Motors Corporation
- Inventors: Jae Seob Choi; Joong Ryoul Lee
- Web page: https://patentgrep.com/patent/US20180324365A1

## CPC

- H04N 5/2628: {Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation}
- B60R 1/26: to the rear of the vehicle
- B60R 1/28: with an adjustable field of view
- G06V 20/588: {Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road}
- B60R 2300/207: using multi-purpose displays, e.g. camera image and navigation or video on same display
- B60R 2300/304: using merged images, e.g. merging camera image with stored images
- B60R 2300/307: virtually distinguishing relevant parts of a scene from the background of the scene
- B60R 2300/602: with an adjustable viewpoint
- B60R 2300/802: for monitoring and displaying vehicle exterior blind spot views
- G06V 20/20: in augmented reality scenes
- G06V 20/58: Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- B60R: VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

An image conversion device is provided. The device includes a driving environment recognition unit that has a camera acquiring a base image of areas behind and to the side of a subject vehicle and a sensor sensing a driving environment behind and to the side of the subject vehicle. A display unit displays the base image and a navigation unit provides information regarding a location of the subject vehicle. A controller determines whether a blind spot is created in the driving environment based on information acquired from the driving environment recognition unit and the navigation unit, converts the base image into an image including the blind spot to generate the converted image, and operates the display unit to display the converted image.

## Claims

### Claim 1

An image conversion device, comprising:
a driving environment recognition unit including a camera configured to acquire a base image of areas behind and to a side of a subject vehicle and a sensor configured to sense a driving environment behind and to the side of the subject vehicle;
a display unit configured to display the base image of the areas behind and to the side of the subject vehicle;
a navigation unit configured to provide information regarding a location of the subject vehicle; and
a controller configured to determine whether a blind spot is created in the driving environment based on information acquired from the driving environment recognition unit and the navigation unit, convert the base image into an image including the blind spot to generate the converted image, and operate the display unit to output the converted image.

### Claim 2 (depends on 1)

The image conversion device according to claim 1, wherein the display unit includes a cluster or an audio video navigation (AVN).

### Claim 3 (depends on 1)

The image conversion device according to claim 1, wherein the controller is configured to determine that the blind spot is created when the subject vehicle is trying to change a lane and a neighboring vehicle is trying to enter a same lane of the subject vehicle.

### Claim 4 (depends on 1)

The image conversion device according to claim 1, wherein the controller is configured to determine that the blind spot is created when the subject vehicle or a neighboring vehicle merges with traffic at a bottleneck.

### Claim 5 (depends on 4)

The image conversion device according to claim 4, wherein the controller is configured to operate the display unit to display a range of the converted image from a point at which a merging road is recognized from a main road on which the subject vehicle is driving to a point at which the main road and the merging road merge when the neighboring vehicle merges with traffic at the bottleneck.

### Claim 6 (depends on 5)

The image conversion device according to claim 5, wherein the range of the converted image is changed according to a relative location of the subject vehicle with respect to the merging road for both the main road and the merging road to be included.

### Claim 7 (depends on 4)

The image conversion device according to claim 4, wherein the controller is configured to operate the display unit to display a range of the converted image from a point at which a main road is recognized from a merging road on which the subject vehicle is driving to a point at which the main road and the merging road merge when the subject vehicle merges with traffic at the bottleneck.

### Claim 8 (depends on 7)

The image conversion device according to claim 7, wherein the range of the converted image is changed according to a relative location of the subject vehicle with respect to the main road for both the main road and the merging road to be included.

### Claim 9 (depends on 1)

The image conversion device according to claim 1, wherein the controller is configured to determine that the blind spot is created when the subject vehicle is driving at night, in a tunnel, or in bad weather.

### Claim 10 (depends on 1)

The image conversion device according to claim 1, wherein the controller is configured to generate the converted image by changing regions of interest (ROIs) according to areas in which the blind spot is created.

### Claim 11 (depends on 10)

The image conversion device according to claim 10, wherein the converted image includes an image that is converted to include an area spaced apart from the rear of a vehicle body in a clockwise or counterclockwise direction in relation to a sideview mirror.

### Claim 12 (depends on 10)

The image conversion device according to claim 10, wherein the converted image includes a boundary line with respect to a position of a vehicle body, and the boundary line is darkened in color as a degree of distance from the rear of the vehicle body in a clockwise or counterclockwise direction in relation to a sideview mirror is reduced, and is displayed transparently as the degree of distance is increased.

### Claim 13 (depends on 1)

The image conversion device according to claim 1, wherein the controller is configured to generate the converted image by changing a focal length of a virtual camera according to areas in which the blind spot is created.

### Claim 14 (depends on 13)

The image conversion device according to claim 13, wherein the controller is configured to generate the converted image by reducing the focal length and zooming out or by lengthening the focal length and zooming in.

### Claim 15 (depends on 13)

The image conversion device according to claim 13, wherein the converted image includes an image extended in a direction toward the rear of a vehicle body.

### Claim 16 (depends on 1)

The image conversion device according to claim 1, wherein the controller is configured to generate the converted image by changing a compression ratio of a virtual camera according to areas in which the blind spot is created.

### Claim 17 (depends on 16)

The image conversion device according to claim 16, wherein the converted image includes an image that is converted by increasing or decreasing the compression ratio to include an area behind a vehicle body and an area to the side of the vehicle body.

### Claim 18 (depends on 1)

The image conversion device according to claim 1, wherein the display unit is configured to display the converted image together with the base image.

### Claim 19 (depends on 18)

The image conversion device according to claim 18, wherein the display unit is configured to display a conversion viewing area of a vehicle body icon.

### Claim 20 (depends on 19)

The image conversion device according to claim 19, wherein the conversion viewing area represents a top view of the converted image.

### Claim 21 (depends on 18)

The image conversion device according to claim 18, wherein the display unit is configured to display a base viewing area of the vehicle body icon.

### Claim 22 (depends on 21)

The image conversion device according to claim 21, wherein the base viewing area represents a top view of the base image.

### Claim 23 (depends on 1)

The image conversion device according to claim 1, wherein the display unit is configured to display a conversion viewing area and a base viewing area of a vehicle body icon in an image in which the converted image and the base image are displayed.

### Claim 24 (depends on 23)

The image conversion device according to claim 23, wherein the conversion viewing area represents a top view of the converted image, and the base viewing area represents a top view of the base image.
