# US 2026/0027896 A1 · Holographic interface control for a vehicle

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0027896 A1
- Document ID: US20260027896A1
- Status: Published application
- Kind: A1
- Application number: 18/782,479
- Filed: 2024-07-24
- Published: 2026-01-29
- Earliest claimed: 2024-07-24
- Assignees: GM Global Technology Operations LLC
- Applicants: GM Global Technology Operations LLC
- Inventors: Kyle Reimer; Joseph F. Szczerba; Fatemeh Abolfazli Zargar; Bochen Peng; Kai-Han Chang
- Web page: https://patentgrep.com/patent/US20260027896A1

## CPC

- B60K 35/10: Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
- B60K 35/22: Display screens
- B60K 35/211: {producing three-dimensional [3D] effects, e.g. stereoscopic images}
- B60K 35/81: for controlling displays
- B60W 50/10: Interpretation of driver requests or demands
- B60W 50/12: Limiting control by the driver depending on vehicle state, e.g. interlocking means for the control input for preventing unsafe operation
- B60W 50/14: Means for informing the driver, warning the driver or prompting a driver intervention
- B60W 50/16: Tactile feedback to the driver, e.g. vibration or force feedback to the driver on the steering wheel or the accelerator pedal
- G03H 1/2294: {Addressing the hologram to an active spatial light modulator}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- B60K 2360/1464: 3D-gesture
- B60K 2360/148: Instrument input by voice
- B60K 2360/166: Navigation
- B60K 2360/175: Autonomous driving
- B60K 2360/21: using cameras
- B60K 2360/29: Holographic features
- B60W 2420/403: Image sensing, e.g. optical camera
- B60W 2540/21: Voice
- G02B 30/56: by projecting aerial or floating images
- G03H 2001/0061: {in haptic applications when the observer interacts with the holobject}
- G03H 2001/2239: {Enlarging the viewing window}
- G03H 2223/16: Optical waveguide, e.g. optical fibre, rod
- G03H 2225/52: Reflective modulator
- G03H 2225/60: Multiple SLMs
- B60K: ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- G03H: HOLOGRAPHIC PROCESSES OR APPARATUS (holograms, e.g. point holograms, used as ordinary optical elements G02B5/32; producing stereoscopic or other three-dimensional effects G02B30/00; diffraction-grating systems G02B27/44; systems using moiré fringes G02B27/60; optical logic elements G02F3/00; stereo-photography G03B35/00; photosensitive materials or processes for photographic purposes G03C; {stereo-photographic or similar processes G03C9/00}; apparatus for processing exposed photographic materials G03D; analogue computers performing mathematical operations with the aid of optical elements G06E3/00; authentication by radiation, of concealed information carried by holograms or diffraction gratings G06K19/16; holographic storage G11B7/0065, G11C13/04; {stereoscopic or other three dimensional effects in television systems H04N13/00})
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS

## Abstract

Aspects of the disclosure include a method for controlling a vehicle via a holographic interface. Aspects include detecting a request, by an occupant of the vehicle, to display a holographic user interface and instructing a holographic display device to display the holographic user interface. Aspects also include detecting an interaction between the occupant and the holographic user interface, identifying a desired action for the vehicle based on the interaction, and instructing the vehicle to perform the desired action.

## Claims

### Claim 1

A method for controlling a vehicle, the method comprising:
detecting a request, by an occupant of the vehicle, to display a holographic user interface;
instructing a holographic display device to display the holographic user interface;
detecting an interaction between the occupant and the holographic user interface;
identifying a desired action for the vehicle based on the interaction; and
instructing the vehicle to perform the desired action.

### Claim 2 (depends on 1)

The method of claim 1, wherein the desired action is a modification of one or more of a direction and a speed of travel of the vehicle and wherein the method further comprises performing a safety check for the desired action and only instructing the vehicle to perform the desired action based on a determination that the safety check has been successfully completed.

### Claim 3 (depends on 1)

The method of claim 1, further comprising instructing the holographic display device to stop displaying the holographic user interface based on a determination that no interaction between the occupant and the holographic user interface is detected for at least a predetermined time period.

### Claim 4 (depends on 1)

The method of claim 1, wherein the holographic user interface is a scaled down representation of the vehicle.

### Claim 5 (depends on 1)

The method of claim 1, further comprising providing haptic feedback to the occupant based on the detection of the interaction.

### Claim 6 (depends on 1)

The method of claim 1, wherein the request is a gesture made by the occupant of the vehicle that is observed by a camera disposed in an interior of the vehicle.

### Claim 7 (depends on 1)

The method of claim 1, wherein the interaction is a gesture made by the occupant of the vehicle that is observed by a camera disposed in an interior of the vehicle.

### Claim 8 (depends on 1)

The method of claim 1, wherein the request is a voice command by the occupant of the vehicle that is captured by a microphone disposed in an interior of the vehicle.

### Claim 9 (depends on 1)

The method of claim 1, wherein the desired action is one of an adjustment to a seating position of a seat of the occupant of the vehicle, an adjustment to a heating and cooling system of the vehicle, and an adjustment to an infotainment system of the vehicle.

### Claim 10

A method for controlling an autonomous vehicle, the method comprising:
detecting a request, by an occupant of the autonomous vehicle, to display a holographic user interface;
instructing a holographic display device to display the holographic user interface comprising a scaled down representation of the autonomous vehicle;
detecting an interaction between the occupant and the holographic user interface;
identifying a desired action for the autonomous vehicle based on the interaction wherein the desired action is a modification of one or more of a direction and a speed of travel of the autonomous vehicle;
based on a determination that the autonomous vehicle can safely perform the desired action, instructing the autonomous vehicle to perform the desired action; and
based on a determination that the autonomous vehicle can not safely perform the desired action, providing feedback to the occupant of the autonomous vehicle that the desired action can not be performed.

### Claim 11 (depends on 10)

The method of claim 10, further comprising instructing the holographic display device to stop displaying the holographic user interface based on a determination that no interaction between the occupant and the holographic user interface is detected for at least a predetermined time period.

### Claim 12 (depends on 10)

The method of claim 10, wherein the feedback is a haptic feedback provided to the occupant.

### Claim 13 (depends on 10)

The method of claim 10, wherein the feedback is a change made to an appearance of the holographic user interface.

### Claim 14 (depends on 10)

The method of claim 10, wherein the request is a gesture made by the occupant of the autonomous vehicle that is observed by a camera disposed in an interior of the autonomous vehicle.

### Claim 15 (depends on 10)

The method of claim 10, wherein the interaction is a gesture made by the occupant of the autonomous vehicle that is observed by a camera disposed in an interior of the autonomous vehicle.

### Claim 16 (depends on 10)

The method of claim 10, wherein the request is a voice command by the occupant of the autonomous vehicle that is observed by a microphone disposed in an interior of the autonomous vehicle.

### Claim 17

A vehicle comprising:
a plurality of sensors configured to monitor a movement of an occupant of the vehicle;
a holographic display device configured to display a holographic user interface; and
a processing system configured to receive data from the plurality of sensors, wherein the processing system is configured to execute a computer program that includes instructions to:
detect a request, by the occupant of the vehicle, to control a system of the vehicle;
instruct, based on the request, the holographic display device to display the holographic user interface, wherein a form of the holographic user interface is determined based on the system of the vehicle to be controlled;
detect, via one or more of the plurality of sensors, an interaction between the occupant and the holographic user interface;
identify a desired action for the system of the vehicle based on the interaction; and
instruct the vehicle to perform the desired action.

### Claim 18 (depends on 17)

The vehicle of claim 17, wherein the system of the vehicle is one of a drive system of the vehicle, an infotainment system of the vehicle, and a heating and cooling system of the vehicle.

### Claim 19 (depends on 18)

The vehicle of claim 18, wherein the request is a gesture made by the occupant of the vehicle that is observed by a camera disposed in an interior of the vehicle and wherein the system of the vehicle is determined based on a type of the gesture.

### Claim 20 (depends on 17)

The vehicle of claim 17, wherein the desired action is a modification of one or more of a direction and a speed of travel of the vehicle and wherein the instructions further comprise instructions to perform a safety check for the desired action and only instructing the vehicle to perform the desired action based on a determination that the safety check has been successfully completed.
