# US 2023/0053687 A1 · Augmented vehicle testing environment

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0053687 A1
- Document ID: US20230053687A1
- Status: Published application
- Kind: A1
- Application number: 17/889,563
- Filed: 2022-08-17
- Published: 2023-02-23
- Earliest claimed: 2021-08-17
- Assignees: The Regents of the University of Michigan
- Applicants: The Regents of the University of Michigan
- Inventors: Tyler S. WORMAN; Huei PENG; Gregory J. McGUIRE
- Web page: https://patentgrep.com/patent/US20230053687A1

## CPC

- G06T 11/00: Two-dimensional [2D] image generation
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G01M 17/007: Wheeled or endless-tracked vehicles (G01M17/08 takes precedence)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G01M: TESTING STATIC OR DYNAMIC BALANCE OF MACHINES OR STRUCTURES; TESTING OF STRUCTURES OR APPARATUS, NOT OTHERWISE PROVIDED FOR

## Abstract

An augmented virtual vehicle testing system and method for presenting graphics to a vehicle operator during operation of a vehicle. The method includes: determining a position of a vehicle operator within a vehicle testing environment; executing an augmentative simulation of the vehicle testing environment, wherein the augmentative simulation is used to provide a position of one or more virtual objects within the vehicle testing environment; generating graphics representing the one or more virtual objects based on the position of the vehicle operator and the position of the one or more virtual objects within the vehicle testing environment; and presenting the graphics on an electronic display and to the vehicle operator during operation of the vehicle.

## Claims

### Claim 1

A method of presenting graphics to a vehicle operator during operation of a vehicle, comprising the steps of:
determining a position of a vehicle operator within a vehicle testing environment;
executing an augmentative simulation of the vehicle testing environment, wherein the augmentative simulation is used to provide a position of one or more virtual objects within the vehicle testing environment;
generating graphics representing the one or more virtual objects based on the position of the vehicle operator and the position of the one or more virtual objects within the vehicle testing environment; and
presenting the graphics on an electronic display and to the vehicle operator during operation of the vehicle.

### Claim 2 (depends on 1)

The method of claim 1, wherein the electronic display is a display of a pair of augmented reality (AR) glasses.

### Claim 3 (depends on 2)

The method of claim 2, wherein the position of the vehicle operator is determined at least in part based on a location of the AR glasses.

### Claim 4 (depends on 3)

The method of claim 3, wherein the AR glasses include a global navigation satellite system (GNSS) receiver, and wherein the location of the AR glasses is determined based on GNSS signals that are received by the GNSS receiver.

### Claim 5 (depends on 4)

The method of claim 4, wherein a real-time kinematic (RTK) positioning technique is used as a part of determining the location of the AR glasses.

### Claim 6 (depends on 1)

The method of claim 1, wherein the vehicle includes an onboard computer that is configured to carry out the augmentative simulation.

### Claim 7 (depends on 6)

The method of claim 6, wherein the onboard computer is further configured to provide the graphics of the one or more virtual objects to the electronic display or a device having the electronic display and to provide the position of the one or more virtual objects within the vehicle testing environment to the electronic display or the device having the electronic display.

### Claim 8 (depends on 1)

The method of claim 1, wherein the vehicle testing facility includes a traffic signal or control, and wherein, as a part of the augmentative simulation, at least one of the one or more virtual objects is configured to respond to a state of the traffic signal or control.

### Claim 9 (depends on 8)

The method of claim 8, wherein the traffic signal or control is a traffic signal that is used to control traffic by emitting light.

### Claim 10 (depends on 8)

The method of claim 8, wherein the traffic signal or control is a boom barrier that obstructs a road of the vehicle testing facility.

### Claim 11 (depends on 1)

The method of claim 1, wherein the vehicle testing facility includes a traffic signal or control that is controlled at least in part on information obtained by a sensor, and wherein, as a part of the augmentative simulation, a state of the traffic signal or control is changed as a result of a presence of at least one of the one or more virtual objects as if the at least one virtual object were each actually a real object that was proximate a location at which the traffic signal or control is located.

### Claim 12 (depends on 11)

The method of claim 11, wherein the at least one virtual object is a virtual vehicle, wherein the traffic signal or control is a traffic signal, and wherein the sensor is used to detect traffic on a road at which the traffic signal is located.

### Claim 13

An augmented virtual vehicle testing system, comprising
at least one computer having one or more processors and at least one non-transitory, computer-readable memory storing computer instructions; and
an electronic display that is configured to present graphics representing one or more virtual objects to a vehicle operator in an augmented reality fashion and that is communicatively coupled to the at least one computer;
wherein the one or more processors are configured to execute the computer instructions that, when executed, cause the augmented virtual vehicle testing system to:
determine a position of the vehicle operator within a vehicle testing environment;
execute an augmentative simulation of the vehicle testing environment, wherein the augmentative simulation is used to provide a position of the one or more virtual objects within the vehicle testing environment;
generate the graphics representing the one or more virtual objects based on the position of the vehicle operator and the position of the one or more virtual objects within the vehicle testing environment; and
present the graphics on an electronic display and to the vehicle operator during operation of the vehicle.
