# US 2019/0168777 A1 · Depth based alerts in multi-display system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0168777 A1
- Document ID: US20190168777A1
- Status: Published application
- Kind: A1
- Application number: 16/195,931
- Filed: 2018-11-20
- Published: 2019-06-06
- Earliest claimed: 2017-11-22
- Assignees: Pure Depth Limited
- Applicants: Pure Depth, Inc.
- Inventors: Richard John LESTER
- Web page: https://patentgrep.com/patent/US20190168777A1

## CPC

- B60W 50/14: Means for informing the driver, warning the driver or prompting a driver intervention
- B60K 35/10: Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
- B60K 35/215: characterised by the combination of multiple visual outputs, e.g. combined instruments with analogue meters and additional displays
- B60K 35/22: Display screens
- B60K 35/28: characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
- B60K 35/29: Instruments characterised by the way in which information is handled, e.g. showing information on plural displays or prioritising information according to driving conditions
- B60K 35/60: Instruments characterised by their location or relative disposition in or on vehicles (arrangements of lighting devices on dashboards B60Q3/10)
- G02B 30/52: the three-dimensional [3D] volume being constructed from a stack or sequence of two-dimensional [2D] planes, e.g. depth sampling systems
- G06V 20/58: Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
- G08G 1/165: {for passive traffic, e.g. including static obstacles, trees}
- G08G 1/166: {for active traffic, e.g. moving vehicles, pedestrians, bikes}
- B60K 2360/176: Camera images
- B60K 2360/178: Warnings
- B60K 2360/179: Distances to obstacles or vehicles
- B60W 30/095: Predicting travel path or likelihood of collision
- B60W 2050/146: {Display means}
- H04N 13/395: with depth sampling, i.e. the volume being constructed from a stack or sequence of two-dimensional [2D] image planes
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60K: ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G08G: TRAFFIC CONTROL SYSTEMS (guiding railway traffic, ensuring the safety of railway traffic B61L; arrangement of road signs or traffic signals E01F9/00; radar or analogous systems, sonar systems, lidar systems specially adapted for traffic control G01S13/91, G01S15/88, G01S17/88; {radar or analogous systems, sonar systems, lidar systems specially adapted for anti-collision purposes G01S13/93, G01S15/93, G01S17/93})
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A multi-layer display may include a first screen and a second screen arranged in a substantially parallel manner, with the first screen and the second screen including an array of pixels and the second screen overlapping the first screen, a light configured to provide light to the first screen and the second screen of the multi-layer display system, and a processing system comprising at least one processor and memory. The processing system may be configured to: receive data from at least one camera; based on the receive data from the at least one camera, display image on the first screen; determine if an object in the image satisfies a predetermined condition; and upon determining that the object in the image satisfies the predetermined condition, display on the second screen an alert at least partially overlapping the object in the image displayed on the first screen.

## Claims

### Claim 1

An instrument panel comprising;
a multi-layer display including a first screen and a second screen arranged in a substantially parallel manner, the first screen and the second screen including an array of pixels and the second screen overlapping the first screen;
a light configured to provide light to the first screen and the second screen of the multi-layer display; and
a processing system comprising at least one processor and memory, the processing system configured to:
receive data from at least one camera;
based on the receive data from the at least one camera, display an image on the first screen;
determine if an object in the image satisfies a predetermined condition; and
upon determining that the object in the image satisfies the predetermined condition, display on the second screen an alert at least partially overlapping the object in the image displayed on the first screen.

### Claim 2 (depends on 1)

The instrument panel of claim 1, wherein determining if the object in the image satisfies the predetermined condition includes determining that the object is in a predetermined portion of the image corresponding to path of a vehicle including the instrument panel.

### Claim 3 (depends on 1)

The instrument panel of claim 1, wherein determining if the object in the image satisfies the predetermined condition includes determining that the object is within a threshold distance from a vehicle including the instrument panel.

### Claim 4 (depends on 1)

The instrument panel of claim 1, wherein determining if the object in the image satisfies the predetermined condition includes determining that the object is within a path of a vehicle including the instrument panel and within a threshold distance from the vehicle.

### Claim 5 (depends on 1)

The instrument panel of claim 1, wherein the processing system is further configured to: receive data from a range sensor; and determine, based on the received data from the range sensor, whether the object in the image is within a threshold distance from the range sensor, and wherein the predetermined condition is that the object in the image is within the threshold distance from the range sensor.

### Claim 6 (depends on 1)

The instrument panel of claim 1, wherein the alert is a feature with a shape corresponding to a shape of the object in the image.

### Claim 7 (depends on 6)

The instrument panel of claim 6, wherein the alert is displayed with a first color when the object is determined to be positioned within a first distance from a vehicle including the instrument panel, and is displayed with a second color when the object is determined to be positioned within a second distance from the vehicle that is smaller than the first distance.

### Claim 8

A multi-layer display system comprising:
a first display panel and second display panel arranged in a substantially parallel manner, the second display panel overlapping the first display panel;
a backlight configured to provide light to the first display panel and the second display panel of the multi-layer display system; and
a processing system comprising at least one processor and memory, the processing system configured to:
receive image data from at least one camera;
based on the received data from the at least one camera, display images on the first display panel;
determine if an object in the images is within a moving path of a vehicle and/or is with a predetermined distance from the vehicle; and
upon determining that the object is within the moving path of the vehicle and/or is with the predetermined distance from the vehicle, display, on the second display panel, an alert corresponding to the object in the images.

### Claim 9 (depends on 8)

The multi-layer display system of claim 8, wherein the alert comprises a shape corresponding to a shape of the object in the images and the alert is displayed in an overlapping manner with the object in the images.

### Claim 10 (depends on 9)

The multi-layer display system of claim 9, wherein at least a portion of the alert is displayed with a partial opacity.

### Claim 11 (depends on 8)

The multi-layer display system of claim 8, wherein the alert is displayed with a first color when the object is determined to be positioned within a first distance from the vehicle and a second color when the object is determined to be positioned within a second distance from the vehicle that is smaller than the first distance.

### Claim 12 (depends on 8)

The multi-layer display system of claim 8, wherein the object in the image and the alert have the same shape and size.

### Claim 13 (depends on 8)

The multi-layer display system of claim 8, wherein the alert is displayed on the second display panel at predetermined intervals while the object is within the moving path of the vehicle and/or is with the predetermined distance from the vehicle.

### Claim 14 (depends on 8)

The multi-layer display system of claim 8, wherein the images are displayed on the first display panel in response to processing system receiving a signal indicating that the vehicle is in a reverse driving mode.

### Claim 15

A vehicle display system comprising:
a sensor disposed on a vehicle;
a camera configured to capture images of an area behind the vehicle;
a multi-layer display including a back display panel and a front display panel arranged in a substantially parallel manner, each display panel including an array of pixels;
a backlight configured to provide light to the front and back display panels; and
a processing system comprising at least one processor and memory, the processing system configured to:
receive sensor data from the sensor;
receive image data from the camera;
in response receiving a signal indicating that the vehicle is in a reverse driving mode, display, on the back display panel, images based on the received image data;
based on the received sensor data and/or the received image data, determine whether an object is present in an estimated path of the vehicle; and
upon determining that the object is present in the estimated path of the vehicle and the object satisfying a predetermined condition, display an alert on the front display panel, the alert having a shape and size corresponding to the object.

### Claim 16 (depends on 15)

The vehicle display system of claim 15, wherein the object is included in the images displayed on the back display panel, and the alert is displayed with partial opacity on the front display panel and overlapping the object in the images.

### Claim 17 (depends on 15)

The vehicle display system of claim 15, wherein the predetermined condition is the object being within an predetermine distance from the vehicle, the alert is displayed with a first color when the object is determined to be positioned within a first distance from the vehicle, and the alert is displayed with a second color when the object is determined to be positioned within a second distance from the vehicle.

### Claim 18 (depends on 17)

The vehicle display system of claim 17, wherein the position of the object from the vehicle is determined based on the received sensor data.

### Claim 19

A method for displaying content on a multi-layer display system including at least first display panel and second display panel arranged in a substantially parallel and overlapping manner, the method comprising:
receiving image data from at least one camera disposed on a vehicle;
based on the received data from the at least one camera, displaying images on the first display panel;
determining if an object in the images is within a moving path of a vehicle and is with a predetermined distance from the vehicle; and
upon determining that the object is within the moving path of the vehicle and is with the predetermined distance from the vehicle, displaying, on the second display panel, an alert corresponding to the object in the images.

### Claim 20 (depends on 19)

The method of claim 19, wherein the alert is displayed with a first color when the object is determined to be positioned within a first distance from the vehicle and a second color when the object is determined to be positioned within a second distance from the vehicle that is smaller than the first distance.
