# US 10,321,122 B2 · Vehicle display system providing depth information

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,321,122 B2
- Document ID: US10321122B2
- Status: Granted
- Kind: B2
- Application number: 15/487,065
- Filed: 2017-04-13
- Published: 2017-10-19
- Granted: 2019-06-11
- Earliest claimed: 2016-04-14
- Assignees: Gentex Corporation
- Applicants: Gentex Corporation
- Inventors: William L. Tonar; Andre J. Rieder
- Web page: https://patentgrep.com/patent/US10321122B2

## CPC

- H04N 13/327: Calibration thereof
- B60K 35/10: Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
- B60K 35/211: {producing three-dimensional [3D] effects, e.g. stereoscopic images}
- B60K 35/22: Display screens
- B60K 35/60: Instruments characterised by their location or relative disposition in or on vehicles (arrangements of lighting devices on dashboards B60Q3/10)
- B60K 35/80: Arrangements for controlling instruments
- B60R 1/26: to the rear of the vehicle
- B60R 1/31: providing stereoscopic vision
- G06V 20/20: in augmented reality scenes
- G06V 40/19: Sensors therefor
- G06V 40/20: Movements or behaviour, e.g. gesture recognition (recognition of facial expressions G06V40/16)
- H04N 7/181: {for receiving images from a plurality of remote sources}
- H04N 13/243: using three or more two-dimensional [2D] image sensors
- H04N 13/305: using lenticular lenses, e.g. arrangements of cylindrical lenses
- H04N 13/31: using parallax barriers
- H04N 13/366: using viewer tracking
- H04N 13/383: for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes
- H04N 13/398: Synchronisation thereof; Control thereof
- B60K 35/65: Instruments specially adapted for specific vehicle types or users, e.g. for left- or right-hand drive
- B60K 2360/21: using cameras
- B60K 2360/31: Virtual images
- B60R 2300/105: using multiple cameras
- B60R 2300/20: characterised by the type of display used
- B60R 2300/30: characterised by the type of image processing
- G06F 3/048: Interaction techniques based on graphical user interfaces [GUI]
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- B60K: ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60R: VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

The disclosure provides for a display system for a vehicle comprising at least one image sensor, an image processor, and a display. The image processor is in communication with the image sensor and configured to generate autostereoscopic image data. The display is in communication with the image processor and configured to display the autostereoscopic image data. The autostereoscopic image data is configured to provide a depth perception to assist in determining a proximity of an object in the image data.

## Claims

### Claim 1

A vehicle display device for a vehicle:
a plurality of image sensors configured to capture image data;
a tracking sensor configured to identify a position of an occupant;
an image processor in communication with the image sensors and the tracking sensor, the image processor configured to generate stereoscopic image data from the image data, wherein the stereoscopic image data comprises right image data and left image data; and
a display apparatus in communication with the image processor, the display apparatus disposed in a rearview display of the vehicle comprising a display panel comprising a display screen and an optical array, wherein the optical array is configured to communicate the stereoscopic image data from the display screen independently to each of a right eye and a left eye of the occupant based on the position of the occupant.

### Claim 2 (depends on 1)

The display device according to claim 1, wherein the display apparatus comprises a pixel array comprising a plurality of pixels.

### Claim 3 (depends on 2)

The display device according to claim 2, wherein the display apparatus is configured to activate a first portion of the plurality of pixels displaying the right image data and activate a second portion of the plurality of pixels displaying the left image data.

### Claim 4 (depends on 3)

The display device according to claim 3, wherein the display apparatus comprises a parallax barrier disposed on a front surface of the pixel array between the pixel array and the occupant.

### Claim 5 (depends on 3)

The display device according to claim 3, wherein the display apparatus comprises a lenticular lens disposed on a front surface of the pixel array between the pixel array and the occupant.

### Claim 6 (depends on 5)

The display system according to claim 5, wherein the image processor controls the passage of the right image data and the left image data through the lenticular array by pairing light field rays of the pixels of the pixel array with retinal positions of the occupant.

### Claim 7 (depends on 5)

The display system according to claim 5, wherein the right image data and the left image data are communicated to the occupant by selectively activating pixels of the pixel array aligned through the lenticular lens with the right eye and the left eye of the occupant respectively.

### Claim 8 (depends on 7)

The display system according to claim 7, wherein the display apparatus is configured to direct the right image data to the right eye and the left image data to the left eye based on the position identified by the tracking sensor.

### Claim 9 (depends on 1)

The display system according to claim 1, wherein the display system corresponds to an autostereoscopic display.

### Claim 10 (depends on 1)

The display system according to claim 1, wherein the display system corresponds to a rearview display system.

### Claim 11 (depends on 1)

The device according to claim 1, further comprising a position sensor configured to detect an angle of the display as an orientation relative to a forward operating direction of the vehicle, wherein the stereoscopic image data is generated based on the angle.

### Claim 12

A display system for a vehicle comprising:
at least one image sensor configured to capture image data in a rearward directed field of view relative to a forward operating direction of the vehicle;
an image processor in communication with the image sensor and configured to generate autostereoscopic image data;
a display in connection with the vehicle and in communication with the image processor configured to display the autostereoscopic image data on a display screen, wherein the autostereoscopic image data is configured to provide a depth perception to assist in determining a proximity of an object in the image data; and
at least one sensor configured to detect a gesture of a user proximate to the display screen, wherein the display screen is configured to display a virtual user interface comprising three-dimensional graphical data and project the three-dimensional graphical data with the autostereoscopic image data to a user operating the vehicle from the display screen.

### Claim 13 (depends on 12)

The display system according to claim 12, wherein the image sensor corresponds to a plurality of image sensors configured to generate a plurality of views of image data.

### Claim 14 (depends on 12)

The display system according to claim 12, wherein the image processor is configured to generate at least one of an autostereoscopic image data and an automultiscopic image data from the plurality of views.

### Claim 15 (depends on 12)

The display system according to claim 12, wherein the image processor is further operable to generate graphical data forming a three dimensional user interface on the display.

### Claim 16 (depends on 12)

The display system according to claim 12, wherein the input sensor is configured to detect and distinguish the gesture of the user corresponding to the shape of the graphical data.

### Claim 17 (depends on 12)

The display system according to claim 12, wherein the image processor is further configured to generate the autostereoscopic image data based on an angle of the display relative to a forward direction of the vehicle.

### Claim 18

A vehicle display device for a vehicle:
a plurality of image sensors configured to capture image data;
a tracking sensor configured to identify a position of an occupant;
an image processor in communication with the image sensors and the tracking sensor, the image processor configured to generate stereoscopic image data from the image data, wherein the stereoscopic image data comprises right image data and left image data; and
a display apparatus in connection with the vehicle and in communication with the image processor, the display apparatus comprising a pixel array comprising a plurality of pixels and a lenticular lens, wherein the display apparatus is configured to:
activate a first portion of the plurality of pixels directing the right image data to a right eye of the occupant through the lenticular lens; and
activate a second portion of the plurality of pixels directing the left image data to a left eye of the occupant through the lenticular lens;
wherein the image processor is further configured to generate the autostereoscopic image data based on an angle of the display relative to a forward direction of the vehicle.

### Claim 19 (depends on 18)

The device according to claim 18, further comprising a position sensor configured to detect the angle of the display relative to the forward operating direction of the vehicle.
