# US 2023/0274689 A1 · Integrated display and sensor array

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0274689 A1
- Document ID: US20230274689A1
- Status: Published application
- Kind: A1
- Application number: 17/681,047
- Filed: 2022-02-25
- Published: 2023-08-31
- Earliest claimed: 2022-02-25
- Assignees: GM Global Technology Operations LLC
- Applicants: GM Global Technology Operations LLC
- Inventors: Jonglee Park; Dorel M. Sala
- Web page: https://patentgrep.com/patent/US20230274689A1

## CPC

- G09G 3/32: semiconductive, e.g. using light-emitting diodes [LED]
- B60K 35/10: Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
- B60K 35/22: Display screens
- G06F 3/147: using display panels
- G09G 3/20: for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix {no fixed position being assigned to or needed to be assigned to the individual characters or partial characters}
- G09G 3/3208: organic, e.g. using organic light-emitting diodes [OLED]
- G09G 3/3406: {Control of illumination source (illumination devices structurally associated with liquid crystal cells G02F1/1336)}
- B60K 35/28: characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
- B60K 35/81: for controlling displays
- B60K 2360/171: Vehicle or relevant part thereof displayed
- B60K 2360/332: Light emitting diodes
- B60K 2360/48: Sensors
- B60K 2360/62: Anti-theft arrangements
- G09G 2354/00: Aspects of interface with display user
- G09G 2360/144: the light being ambient light
- G09G 2380/10: Automotive applications
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)
- B60K: ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A display device includes a plurality of pixel elements, each pixel comprising a display portion and a sensor portion. The display portion includes a light source embedded in a backplane layer; the light source causes an image to be rendered by the display device. The sensor portion includes a sensor embedded in the same backplane layer, the sensor detects movement within a predetermined vicinity of the display device.

## Claims

### Claim 1

A display device comprising:
a plurality of pixel elements, each pixel element comprising a display portion and a sensor portion to detect movement within a predetermined vicinity of the display device, wherein the detected movement is at least six inches from the display device, and wherein:
the display portion comprises a light source embedded in a backplane layer, the light source to cause an image to be rendered by the display device; and
the sensor portion comprises a movement sensor embedded in the backplane layer, the movement sensor to detect the movement within the predetermined vicinity of the display device; and
a controller coupled to a light sensor that detects an amount of ambient light, wherein, in response to the light sensor measuring an amount of ambient light being below a predetermined threshold, the controller provides an electric signal to the light source to cause the light source to emit light within the predetermined vicinity to facilitate detecting the movement by the movement sensor.

### Claim 2

(canceled)

### Claim 3 (depends on 1)

The display device of claim 1, wherein the light source is a plurality of light sources.

### Claim 4 (depends on 1)

The display device of claim 1, wherein the light source is a microLED.

### Claim 5 (depends on 1)

The display device of claim 1, wherein the movement sensor includes: a camera, a depth sensor, radar, lidar, ambient light sensor, vertical-cavity surface-emitting laser (VCSEL) diode, single-photon avalanche diode (SPAD), or combinations thereof.

### Claim 6 (depends on 1)

The display device of claim 1, wherein the controller is further configured to:
receive a movement detection signal from the movement sensor; and
in response, based on the movement detection signal, cause the light source to change the image being rendered.

### Claim 7

(canceled)

### Claim 8 (depends on 1)

The display device of claim 1, wherein the controller is configured to:
cause the pixel elements to display a lock screen using the display portion of each of the pixel elements;
receive, from the sensor portion of one or more pixel elements from the plurality of pixels, a movement detection; and
in response to the movement detection, cause the pixel elements to display a keypad to lock or unlock a vehicle.

### Claim 9 (depends on 1)

The display device of claim 1, wherein the plurality of pixel elements is a first plurality, and the display device further comprises a second plurality of pixel elements, wherein each of the second plurality of pixel elements comprises only the display portion.

### Claim 10

A method comprising:
detecting, using a movement sensor of a sensor portion of a pixel element of a display panel, a movement within a predetermined vicinity at a distance from the display panel, wherein the detected movement is at least six inches from the display panel, wherein the display panel is embedded on an exterior of a vehicle, and wherein the display panel is transparent;
based on detecting the movement, displaying a keypad by a display portion of the pixel element;
in response to an input provided via the keypad displayed by the display portion, locking or unlocking the vehicle;
determining, by a controller coupled to the display panel and a light sensor, that an amount of ambient light measured by the light sensor is below a predetermined threshold; and
in response to determining the amount of the ambient light measured by the light sensor is below a predetermined threshold, providing, by the controller, an electric signal to a light source coupled to the display portion to cause the light source to emit light within the predetermined vicinity to facilitate detecting the movement by the movement sensor.

### Claim 11 (depends on 10)

The method of claim 10 wherein the pixel element is a plurality of pixel elements of the display panel.

### Claim 12 (depends on 10)

The method of claim 10 wherein the sensor portion and the display portion are commonly located on the same backplane layer of the pixel element.

### Claim 13 (depends on 10)

The method of claim 10 wherein the pixel element is a first pixel element that comprises the display portion and the sensor portion, and wherein the display panel further comprises a second pixel element that comprises only the display portion.

### Claim 14

(canceled)

### Claim 15 (depends on 10)

The method of claim 10, wherein the light source comprises one or more light sources, and the light sources comprises a microLED.

### Claim 16 (depends on 10)

The method of claim 10, wherein the movement sensor includes: a camera, a depth sensor, radar, lidar, ambient light sensor, vertical-cavity surface-emitting laser (VCSEL) diode, single-photon avalanche diode (SPAD), or combinations thereof.

### Claim 17

A vehicle comprising:
a transparent display panel embedded within glass layers of a glass panel, the display panel comprising:
a plurality of pixel elements, each pixel element comprising a display portion and a sensor portion, wherein:
the display portion comprises a light source to cause an image to be rendered by the display; and
the sensor portion comprises a movement sensor, the movement sensor to detect movement within a predetermined vicinity at a distance from the vehicle wherein the detected movement is at least six inches from the vehicle; and
a controller coupled to a light sensor that detects an amount of ambient light, wherein, in response to the light sensor measuring an amount of ambient light being below a predetermined threshold, the controller provides an electric signal to the light source to cause the light source to emit light within the predetermined vicinity to facilitate detecting the movement by the movement sensor.

### Claim 18 (depends on 17)

The vehicle of claim 17, wherein the display panel is coupled with a vehicle security system of the vehicle, and the display portion renders a status of the vehicle being locked or unlocked.

### Claim 19 (depends on 18)

The vehicle of claim 18, wherein in response to detecting, by the sensor portion of the pixel element, the movement within the predetermined vicinity, the display portion renders a keypad to lock or unlock the vehicle.

### Claim 20 (depends on 19)

The vehicle of claim 19, wherein the vehicle is locked or unlocked based on an input via the keypad.
