# US 2023/0054771 A1 · Augmented reality for providing autonomous vehicle personnel with enhanced safety and efficiency

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0054771 A1
- Document ID: US20230054771A1
- Status: Published application
- Kind: A1
- Application number: 17/409,205
- Filed: 2021-08-23
- Published: 2023-02-23
- Earliest claimed: 2021-08-23
- Assignees: GM Cruise Holdings LLC
- Applicants: GM Cruise Holdings LLC
- Inventors: Jeffrey Brandon; Domenico Rusciano
- Web page: https://patentgrep.com/patent/US20230054771A1

## CPC

- G01C 21/3626: {Details of the output of route guidance instructions (traffic control systems for road vehicles involving transmission of navigation instructions to the vehicle G08G1/0968)}
- G06F 3/147: using display panels
- B60W 50/14: Means for informing the driver, warning the driver or prompting a driver intervention
- B60W 60/001: {Planning or execution of driving tasks}
- B60W 60/0015: {specially adapted for safety}
- G01C 21/3407: {specially adapted for specific applications}
- G02B 27/0172: {characterised by optical features}
- G06F 3/14: Digital output to display device {; Cooperation and interconnection of the display device with other functional units}
- G08G 1/005: including pedestrian guidance indicator
- G08G 1/143: {inside the vehicles}
- G08G 1/166: {for active traffic, e.g. moving vehicles, pedestrians, bikes}
- B60W 2050/146: {Display means}
- B60W 2556/50: of positioning data, e.g. GPS [Global Positioning System] data
- G02B 27/017: {Head mounted}
- G02B 2027/0141: {characterised by the informative content of the display}
- G02B 2027/0178: {Eyeglass type (eyeglass details G02C)}
- G09G 2360/121: using a cache memory
- G09G 2370/022: Centralised management of display operation, e.g. in a server instead of locally
- G09G 2370/16: Use of wireless transmission of display information
- G09G 2380/06: Remotely controlled electronic signs other than labels
- G09G 2380/10: Automotive applications
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G08G: TRAFFIC CONTROL SYSTEMS (guiding railway traffic, ensuring the safety of railway traffic B61L; arrangement of road signs or traffic signals E01F9/00; radar or analogous systems, sonar systems, lidar systems specially adapted for traffic control G01S13/91, G01S15/88, G01S17/88; {radar or analogous systems, sonar systems, lidar systems specially adapted for anti-collision purposes G01S13/93, G01S15/93, G01S17/93})
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)

## Abstract

Systems and methods for using augmented reality technology to provide on-site service center personnel with enhanced safety. In particular, augmented reality technology can be used to display autonomous vehicle driving paths to service center personnel. Additionally, systems and methods are provided for using augmented reality technology to improve efficiency of autonomous vehicle service centers and operating facilities. For example, augmented reality technology can be used to communicate services for respective autonomous vehicles to service center personnel. Augmented reality technology can be presented to users via augmented reality glasses.

## Claims

### Claim 1

A method for utilizing autonomous reality technology in a vehicle facility, comprising:
receiving planned route information for an autonomous vehicle, wherein the planned route information includes a driving path in the vehicle facility;
receiving requested services for the autonomous vehicle;
displaying the driving path for the autonomous vehicle in an augmented reality system; and
presenting the requested services for the autonomous vehicle in the augmented reality system.

### Claim 2 (depends on 1)

The method of claim 1, wherein displaying the driving path in the augmented reality system includes displaying the driving path in augmented reality glasses.

### Claim 3 (depends on 2)

The method of claim 2, wherein displaying the driving path comprises superimposing the driving path over a view through the augmented reality glasses, when the view through the augmented reality glasses includes the driving path.

### Claim 4 (depends on 2)

The method of claim 2, wherein presenting the requested services includes displaying the requested services in the augmented reality glasses when a view through the augmented reality glasses includes the autonomous vehicle.

### Claim 5 (depends on 2)

The method of claim 2, wherein presenting the requested services includes providing an audio signal from the augmented reality glasses when a view through the augmented reality glasses includes the autonomous vehicle, wherein the audio signal lists the requested services.

### Claim 6 (depends on 2)

The method of claim 2, wherein presenting the requested services for the autonomous vehicle includes presenting the requested services after the autonomous vehicle is parked in a designated parking space in the vehicle facility.

### Claim 7 (depends on 2)

The method of claim 2, wherein presenting the requested services for the autonomous vehicle includes presenting a current state of the autonomous vehicle.

### Claim 8 (depends on 1)

The method of claim 1, further comprising presenting safety hazard warnings in the augmented reality system.

### Claim 9

A system for utilizing autonomous reality technology in a vehicle facility, comprising:
a central computing system including a routing coordinator configured to route an autonomous vehicle to the vehicle facility for service;
an onboard computing system in the autonomous vehicle configured to navigate the autonomous vehicle along a driving path within the vehicle facility; and
an augmented reality system configured to:
receive planned route information for the autonomous vehicle, wherein the planned route information includes the driving path within the vehicle facility; and
display the driving path of the autonomous vehicle.

### Claim 10 (depends on 9)

The system of claim 9, wherein the onboard computing system is further configured to determine service requests for the autonomous vehicle.

### Claim 11 (depends on 10)

The system of claim 10, wherein the augmented reality system is further configured to receive the service requests for the autonomous vehicle, and present the service requests in the augmented reality system.

### Claim 12 (depends on 9)

The system of claim 9, wherein the augmented reality system comprises augmented reality glasses.

### Claim 13 (depends on 12)

The system of claim 12, wherein the augmented reality system is configured to display the driving path of the autonomous vehicle in the augmented reality glasses, when a view through the augmented reality glasses includes the driving path.

### Claim 14 (depends on 12)

The system of claim 12, wherein the augmented reality system is further configured to present safety hazard warnings through the augmented reality glasses.

### Claim 15 (depends on 9)

The system of claim 9, wherein the central computing system is further configured to designate a parking space in the vehicle facility to the autonomous vehicle.

### Claim 16 (depends on 9)

The system of claim 9, wherein the central computing system is further configured to send an estimated time of arrival of the autonomous vehicle at the vehicle facility to the augmented reality system.

### Claim 17

An autonomous vehicle service facility for servicing an autonomous vehicle fleet, comprising:
a central computing system configured to:
receive arrival information for an autonomous vehicle,
receive requested services for the autonomous vehicle, and
assign a parking space to the autonomous vehicle; and
an augmented reality system configured to:
receive planned route information for the autonomous vehicle, wherein the planned route information includes a driving path in the facility; and
display the driving path for the autonomous vehicle.

### Claim 18 (depends on 17)

The service facility of claim 17, wherein the augmented reality system is further configured to receive the requested services for the autonomous vehicle, and present the requested services.

### Claim 19 (depends on 17)

The service facility of claim 17, wherein the augmented reality system comprises augmented reality glasses, and wherein the augmented reality glasses are configured to superimpose the driving path over a view through the augmented reality glasses, when the view through the augmented reality glasses includes the driving path.

### Claim 20 (depends on 17)

The service facility of claim 17, wherein the augmented reality system if further configured to present safety hazard warnings.
