# US 2019/0315275 A1 · Display device and operating method thereof

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0315275 A1
- Document ID: US20190315275A1
- Status: Published application
- Kind: A1
- Application number: 16/461,252
- Filed: 2017-03-06
- Published: 2019-10-17
- Earliest claimed: 2016-11-21
- Assignees: LG Electronics Inc.
- Applicants: LG Electronics Inc.
- Inventors: Hangtae KIM; Kyungdong CHOI
- Web page: https://patentgrep.com/patent/US20190315275A1

## CPC

- B60J 3/04: adjustable in transparency
- B60R 1/001: {integrated in the windows, e.g. Fresnel lenses}
- B60J 1/02: arranged at the vehicle front {, e.g. structure of the glazing, mounting of the glazing (on windscreen mounted antenna wire H01Q1/1271)}
- B60K 35/10: Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
- B60K 35/20: Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
- B60K 35/22: Display screens
- B60K 35/23: Head-up displays [HUD] (optical aspects of head-up displays G02B27/01)
- B60K 35/26: using acoustic output
- B60K 35/29: Instruments characterised by the way in which information is handled, e.g. showing information on plural displays or prioritising information according to driving conditions
- B60K 35/50: Instruments characterised by their means of attachment to or integration in the vehicle (B60K35/231 takes precedence)
- B60K 35/60: Instruments characterised by their location or relative disposition in or on vehicles (arrangements of lighting devices on dashboards B60Q3/10)
- B60K 35/81: for controlling displays
- B60R 1/26: to the rear of the vehicle
- B60R 1/27: providing all-round vision, e.g. using omnidirectional cameras
- B60W 40/02: related to ambient conditions
- B60W 50/14: Means for informing the driver, warning the driver or prompting a driver intervention
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- H04N 7/181: {for receiving images from a plurality of remote sources}
- H04N 13/204: using stereoscopic image cameras (stereoscopic photography G03B35/00)
- B60K 35/65: Instruments specially adapted for specific vehicle types or users, e.g. for left- or right-hand drive
- B60K 2360/1464: 3D-gesture
- B60K 2360/149: Instrument input by detecting viewing direction not otherwise provided for
- B60K 2360/151: Instrument output devices for configurable output
- B60K 2360/182: Distributing information between displays
- B60K 2360/741: Instruments adapted for user detection
- B60R 2300/105: using multiple cameras
- B60R 2300/202: displaying a blind spot scene on the vehicle part responsible for the blind spot
- B60R 2300/205: using a head-up display
- B60R 2300/303: using joined images, e.g. multiple camera images
- H04N 13/271: wherein the generated image signals comprise depth maps or disparity maps
- H04N 2213/003: Aspects relating to the "2D+depth" image format
- B60J: WINDOWS, WINDSCREENS, NON-FIXED ROOFS, DOORS, OR SIMILAR DEVICES FOR VEHICLES; REMOVABLE EXTERNAL PROTECTIVE COVERINGS SPECIALLY ADAPTED FOR VEHICLES (fastening, suspending, closing, or opening of such devices E05)
- B60R: VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60K: ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A display device according to an embodiment of the present invention comprises: a front display unit; a side display unit including a left display unit and a right display unit; a communication unit for receiving external image data; a sensing unit for sensing a user; and a control unit for controlling an operation of the display device, wherein the control unit is configured to measure a position of the user's eyes inside a vehicle and a distance between the front display unit and the side display unit and the user's eyes by using the sensing unit, calculate the user's visible view and viewing angle through measured data, and process external image data corresponding to the calculated visible view to output the same to the side display unit.

## Claims

### Claim 1

A display device comprising:
a front display unit;
a side display unit comprising a left display unit and a right display unit;
a communication unit configured to receive external image data;
a sensing unit configured to sense a user; and
a control unit configured to control an operation of the display device,
wherein the control unit is configured to:
measure a position of a user's eyes within a vehicle and a distance between the front display unit and the side display unit and the user's eyes by using the sensing unit;
calculate a visible view and a viewing angle of the user through the measured data; and
process the external image data corresponding to the calculated visible view and perform control to output the processed external image data on the side display unit.

### Claim 2 (depends on 1)

The display device according to claim 1, wherein the front display unit comprises a windshield of the vehicle.

### Claim 3 (depends on 1)

The display device according to claim 1, wherein the side display unit is mounted on an A-pillar position of the vehicle.

### Claim 4 (depends on 1)

The display device according to claim 1, wherein the sensing unit comprises a 3D camera, and
the sensing unit is configured to sense the position of the user's eyes and sight direction information through the 3D camera.

### Claim 5 (depends on 4)

The display device according to claim 4, wherein the 3D camera is provided in a predetermined region of a steering wheel mounted on a front surface of a driver's seat of the vehicle.

### Claim 6 (depends on 1)

The display device according to claim 1, wherein the external image data is image data photographed through a general image camera and a time of flight (TOF) camera installed on the left and right sides of the vehicle.

### Claim 7 (depends on 6)

The display device according to claim 6, wherein the general image camera is configured to obtain 2D RGB images of left and right sides of the vehicle, and
the control unit is configured to combine distance information measured by the TOF camera with each pixel of the 2D RGB image.

### Claim 8 (depends on 1)

The display device according to claim 1, wherein the display device further comprises a user interface unit, and
the control unit is configured to control the side display unit to output navigation information upon receiving a navigation guidance request through the user interface unit.

### Claim 9

A control method of a display device, comprising:
measuring a position of a user's eyes within a vehicle and a distance between a front display unit and a side display unit and the user's eyes by using a sensing unit of the display device;
calculating a visible view and a viewing angle of the user through the measured data; and
processing external image data corresponding to the calculated visible view and outputting the processed external image data on the side display unit.

### Claim 10 (depends on 9)

The control method according to claim 9, wherein the front display unit comprises a windshield of the vehicle.

### Claim 11 (depends on 9)

The control method according to claim 9, wherein the side display unit is mounted on an A-pillar position of the vehicle.

### Claim 12 (depends on 9)

The control method according to claim 9, wherein the sensing unit comprises a 3D camera, and
the sensing unit is configured to sense the position of the user's eyes and sight direction information through the 3D camera.

### Claim 13 (depends on 12)

The control method according to claim 12, wherein the 3D camera is provided in a predetermined region of a steering wheel mounted on a front surface of a driver's seat of the vehicle.

### Claim 14 (depends on 9)

The control method according to claim 9, wherein the external image data is image data photographed through a general image camera and a time of flight (TOF) camera installed on the left and right sides of the vehicle.
