# US 2021/0241723 A1 · Augmented reality system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0241723 A1
- Document ID: US20210241723A1
- Status: Published application
- Kind: A1
- Application number: 17/162,960
- Filed: 2021-01-29
- Published: 2021-08-05
- Earliest claimed: 2020-01-31
- Assignees: McLaren Automotive Limited
- Applicants: McLaren Automotive Limited
- Inventors: Stephen Gordon David Tucker; Hugo Peter Cohn; Simon Lacey
- Web page: https://patentgrep.com/patent/US20210241723A1

## CPC

- G02B 27/017: {Head mounted}
- G09G 5/37: Details of the operation on graphic patterns (G09G5/38 takes precedence)
- B60Q 9/00: Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00 {, e.g. haptic signalling}
- G02B 27/0172: {characterised by optical features}
- G06F 3/147: using display panels
- B60Q 9/008: {for anti-collision purposes}
- G02B 2027/014: {comprising information/image processing systems}
- G02B 2027/0141: {characterised by the informative content of the display}
- G02B 2027/0187: {slaved to motion of at least a part of the body of the user, e.g. head, eye}
- G09G 2354/00: Aspects of interface with display user
- G09G 2380/10: Automotive applications
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)
- B60Q: ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

An augmented reality system for assisting the driver of a vehicle comprising a display headset, a positioning system and a display driver configured to generate graphic elements which appear to the driver to move independently with respect to one another.

## Claims

### Claim 1

An augmented reality system for assisting the driver of a vehicle being driven on a surface in an environment, the environment including one or more dynamic bodies, the system comprising:
a display headset comprising an at least partially transparent display pane;
a positioning system configured to determine the relative positions of the display headset, the vehicle, the surface and at least one dynamic body external to the vehicle; and
a display driver configured to generate, in dependence on the relative positions determined by the positioning system, graphic elements on the at least partially transparent display pane, the display driver being configured such that, to a wearer of the display headset, at least one graphic element appears stationary relative to the display headset;
at least one graphic element appears stationary relative to the vehicle notwithstanding motion of the display headset relative to the vehicle;
at least one graphic element appears stationary relative to the surface; and
at least one graphic element appears stationary relative to the at least one dynamic body external to the vehicle.

### Claim 2 (depends on 1)

The system of claim 1, wherein the display driver is configured to display a first, second, third and fourth graphic element such that each graphic element appears, to the wearer of the display device, to move independently with respect to each of the other graphic elements and wherein the first graphic element appears, to the wearer of the display headset, stationary relative to the display headset;
the second graphic element appears, to the wearer of the display headset, stationary relative to the vehicle;
the third graphic element appears, to the wearer of the display headset, stationary relative to the surface; and
the fourth graphic element appears, to the wearer of the display headset, stationary relative to the at least one dynamic body external to the vehicle.

### Claim 3 (depends on 1)

The system of claim 1, wherein the positioning system is arranged to characterize a vector between the viewpoint of the wearer of the display headset and each one of the display headset, the vehicle, the surface and the at least one dynamic body external to the vehicle.

### Claim 4 (depends on 3)

The system of claim 3, wherein the display driver generates graphic elements such that:
a vector between the viewpoint of the wearer of the display headset and the at least one graphic element which appears, to a wearer of the display headset, stationary relative to the display headset, does not move relative to any vector between the viewpoint of the wearer of the display headset and the display headset; and
a vector between the viewpoint of the wearer of the display headset and the at least one graphic element which appears, to a wearer of the display headset, stationary relative to the vehicle, is equal in direction to the vector between the viewpoint of the wearer of the display headset and the vehicle; and
a vector between the viewpoint of the wearer of the display headset and the at least one graphic element which appears, to a wearer of the display headset, stationary relative to the surface, is equal in direction to the vector between the viewpoint of the wearer of the display headset and the surface; and
a vector between the viewpoint of the wearer of the display headset and the at least one graphic element which appears, to a wearer of the display headset, stationary relative to the at least one dynamic body external to the vehicle is equal in direction to the vector between the viewpoint of the wearer of the display headset and the at least one dynamic body external to the vehicle.

### Claim 5 (depends on 1)

The system of claim 1, wherein the at least one graphic element which, to the wearer of the display headset, appears stationary relative to the display headset, is any of warning signs, information regarding the operation of the vehicle, safety information or video content.

### Claim 6 (depends on 1)

The system of claim 1, wherein the at least one graphic element which, to the wearer of the display headset, appears stationary relative to the vehicle, is any of virtual instruments, information regarding the operation of the vehicle, navigation information or video content.

### Claim 7 (depends on 1)

The system of claim 1, wherein the at least one graphic element which, to the wearer of the display headset, appears stationary relative to the surface, is any of navigation information, track information and hazard identifiers.

### Claim 8 (depends on 1)

The system of claim 1, wherein the at least one graphic element which, to the wearer of the display headset, appears stationary relative to the at least one dynamic body external to the vehicle, is a hazard identifier.

### Claim 9 (depends on 1)

The system of claim 1, wherein the positioning system is configured to determine whether the at least one dynamic body external to the vehicle is moving with respect to the vehicle, and having determined that the at least one dynamic body external to the vehicle is moving with respect to the vehicle, is further configured to determine whether the at least one dynamic body is moving towards or away from the expected path of the vehicle.

### Claim 10 (depends on 9)

The system of claim 9, wherein the display driver is configured to generate a graphic element being a hazard identifier, which to the wearer of the display headset appears stationary relative to the at least one dynamic body, if the positioning system determines that the at least one dynamic body external to the vehicle is moving towards the expected path of the vehicle.

### Claim 11 (depends on 9)

The system of claim 9, wherein the display driver is configured to generate a graphic element being a braking or turning point indicator, which to the wearer of the display headset appears stationary relative to the surface, if the positioning system determines that the at least one dynamic body external to the vehicle is moving towards the expected path of the vehicle.

### Claim 12 (depends on 1)

The system of claim 1, wherein the surface is a road and the graphic elements comprise:
warning signs, which to the wearer of the display headset appear stationary relative to the display headset;
information regarding the operation of the vehicle, which to the wearer of the display headset, appear stationary relative to the vehicle;
navigation information, which to the wearer of the display headset, appear stationary relative to the road; and
hazard identifiers, which to the wearer of the display headset, appear stationary relative to the at least one dynamic body external to the vehicle.

### Claim 13 (depends on 1)

The system of claim 1, wherein the surface is a track and the graphic elements comprise:
warning signs, which to the wearer of the display headset appear stationary relative to the display headset;
information regarding the operation of the vehicle, which to the wearer of the display headset, appear stationary relative to the vehicle;
track information, which to the wearer of the display headset, appear stationary relative to the road; and
hazard identifiers, which to the wearer of the display headset, appear stationary relative to the at least one dynamic body external to the vehicle.

### Claim 14 (depends on 1)

The system of claim 1, wherein the augmented reality system is configured to obtain an environment map from a source external to the vehicle and the display driver is configured to generate graphic elements in dependence on track information provided by the environment map.

### Claim 15 (depends on 1)

The system of claim 1, wherein the at least one graphic element which, to wearer of the display headset, appears stationary relative to the surface, and is track information, is generated in dependence on one or more of braking point indicators, acceleration point indicators and driving lines.

### Claim 16 (depends on 1)

The system of claim 1, wherein the system is configured to record a first route taken by a vehicle driven on a surface; and upon the vehicle being driven again on the surface, the display driver being configured to display at least one graphic element, which to a wearer of the display headset appears stationary relative to the surface, wherein the at least one graphic element is a driving line which represents the first route taken by the vehicle.

### Claim 17 (depends on 15)

The system of claim 15, wherein the system is configured to record wheel slip of the vehicle during a first route taken by the vehicle on the surface; and upon the vehicle being driven again on the surface, the display driver being configured to display graphic elements, which to a wearer of the display headset appear stationary relative to the surface, wherein at least one graphic element indicates one or more portions of the first route in which wheel slip of the vehicle was recorded, and at least one graphic element is a driving line which indicates a second route to be taken by the vehicle, wherein the second route is formulated such that the vehicle avoids the one or more portions of the first route in which wheel slip of the vehicle was recorded.

### Claim 18 (depends on 1)

The system of claim 1 being configured to communicate with a display of a vehicle configured to display graphic elements, the system being further configured to deactivate at least part of the vehicle display such that graphic elements are not duplicated on the vehicle display and the display headset of the augmented reality system.

### Claim 19 (depends on 1)

The system of claim 1, wherein the display headset comprises a pair of augmented reality glasses and the at least partially transparent display pane is one or more lenses of the augmented reality glasses or the display headset comprises a helmet and the at least partially transparent display pane is a visor of the helmet.

### Claim 20

(canceled)

### Claim 21

A method comprising:
determining the relative positions of:
a vehicle;
a display headset worn by a driver of the vehicle;
a surface on which the vehicle is being driven;
one or more dynamic bodies of an environment in which the vehicle is being driven, the one or more dynamic bodies being external to the vehicle; and
generating first, second, third and fourth graphic elements on an at least partially transparent display pane of the display headset such that each graphic element appears, to the wearer of the display headset, to move independently with respect to each of the other graphic elements and wherein
the first graphic element appears, to a wearer of the display headset, stationary relative to the display headset;
the second graphic element appears, to a wearer of the display headset, stationary relative to the vehicle notwithstanding motion of the display headset relative to the vehicle;
the third graphic element appears, to a wearer of the display headset, stationary relative to the surface; and
the fourth graphic element appears, to a wearer of the display headset, stationary relative to the at least one dynamic body external to the vehicle.
