# US 2022/0026218 A1 · Head mounted display system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0026218 A1
- Document ID: US20220026218A1
- Status: Published application
- Kind: A1
- Application number: 17/296,631
- Filed: 2019-12-03
- Published: 2022-01-27
- Earliest claimed: 2019-12-03
- Assignees: BAE SYSTEMS plc
- Applicants: BAE SYSTEMS plc
- Inventors: Mark Nichols; Owen Edward Jones; Daniel Martyn Forrester; Derek Ron Jordan
- Web page: https://patentgrep.com/patent/US20220026218A1

## CPC

- G01C 21/203: {specially adapted for water-borne vessels}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- B63B 49/00: Arrangements of nautical instruments or navigational aids (nautical measuring instruments G01C; radio navigation, analogous arrangements using other waves G01S)
- G06F 3/012: {Head tracking input arrangements}
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- B63B: SHIPS OR OTHER WATERBORNE VESSELS; EQUIPMENT FOR SHIPPING (arrangements of vessel ventilation, heating, cooling, or air-conditioning B63J2/00; floating substructures as supports of dredgers or soil-shifting machines E02F9/06)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A head mounted display system for use on a watercraft is disclosed. The head mounted display system comprises circuitry to determine orientation information of a head mounted display system relative to the watercraft and a display configured to superimpose graphical information over objects in a field of view of at least one eye of a user of the head mounted display system. The graphical information is based on sensor data and the orientation information of the head mounted display. The sensor data is provided by at least one data source associated with the watercraft.

## Claims

### Claim 1

A head mounted display system for use on a watercraft, the head mounted display system comprising:
circuitry to determine orientation information of the head mounted display system relative to the watercraft; and
a display configured to superimpose graphical information over objects in a field of view of at least one eye of a user of the head mounted display system, the graphical information based on sensor data and the orientation information, the sensor data provided by at least one data source associated with the watercraft.

### Claim 2 (depends on 1)

The system according to claim 1, wherein the graphical information comprises a recommended path avoiding potential hazards in the vicinity of the watercraft.

### Claim 3 (depends on 1)

The system according to claim 1, wherein the graphical information comprises a three-dimensional plot indicating positions of features of interest relative to a location of the watercraft, the features of interest obtained from radar and other sensors associated with the watercraft.

### Claim 4 (depends on 1)

The system according to claim 1, wherein the graphical information comprises a predicted path of features of interest.

### Claim 5 (depends on 4)

The system according to claim 4, wherein the graphical information comprises a recommended path avoiding potential hazards in the vicinity of the watercraft, and the recommended path avoids the predicted path of the features of interest.

### Claim 6 (depends on 1)

The system according to claim 1, wherein the graphical information comprises head gaze heading information superimposed and fixed to scenery around the watercraft.

### Claim 7 (depends on 1)

The system according to claim 1, wherein the graphical information comprises undersea information to provide an indication of undersea features.

### Claim 8 (depends on 7)

The system according to claim 7, wherein the undersea information comprises a terrain map.

### Claim 9 (depends on 1)

The system according to claim 1, wherein at least part of the graphical information is conformal to real objects.

### Claim 10 (depends on 1)

The system according to claim 1, wherein the circuitry to determine orientation information of the head mounted display system relative to the watercraft comprises a tracking system, the tracking system including:
optical tracking circuitry to determine first tracking information of the head mounted display system;
non-optical circuitry to determine second tracking information of the head mounted display system; and
correction circuitry to determine an updated tracking information of the head mounted display system based on the first tracking information and the second tracking information.

### Claim 11 (depends on 10)

The system according to claim 10, wherein the non-optical tracking circuitry determines the second tracking information using a plurality of disjoint sets of inertial sensors located on the watercraft, each individual set comprising at least one inertial sensor, each set located in one or more separate locations of the watercraft, wherein selection of which of the plurality of sets of inertial sensors to use to determine the second tracking information is based on a location of the head mounted display system.

### Claim 12 (depends on 10)

The system according to claim 10, wherein the optical tracking circuitry determines the first tracking information using at least one size-variable optical tracking mark, a size and configuration of the variable-sized alignment mark is based on a location of the head mounted display system.

### Claim 13 (depends on 1)

A watercraft comprising the head mounted display system according to claim 1.

### Claim 14

A method comprising:
receiving orientation information of a head mounted display system relative to a watercraft; and
determining graphical information to display on a display of the head mounted display system based on sensor data and the orientation information, the sensor data provided by at least one data source associated with the watercraft.

### Claim 15

(canceled)

### Claim 16 (depends on 14)

The method according to claim 14, wherein the graphical information comprises: a recommended path avoiding potential hazards in the vicinity of the watercraft; a three-dimensional plot indicating positions of features of interest relative to a location of the watercraft, the features of interest obtained from radar and other sensors associated with the watercraft; a predicted path of features of interest; head gaze heading information superimposed and fixed to scenery around the watercraft; undersea information to provide an indication of undersea features; and/or an undersea terrain map.

### Claim 17

A non-transitory machine-readable medium comprising instructions, that when executed by one or more processors, cause a process to be carried out, the process comprising:
receiving orientation information of a head mounted display system relative to a watercraft; and
determining graphical information to display on a display of the head mounted display system based on sensor data and the orientation information, the sensor data provided by at least one data source associated with the watercraft.

### Claim 18 (depends on 17)

The non-transitory machine-readable medium according to claim 17, wherein the graphical information comprises a three-dimensional plot indicating positions of features of interest relative to a location of the watercraft, the features of interest obtained from radar and other sensors associated with the watercraft.

### Claim 19 (depends on 17)

The non-transitory machine-readable medium according to claim 17, wherein the graphical information comprises: a predicted path of features of interest; and/or a recommended path that avoids the predicted path of the features of interest.

### Claim 20 (depends on 17)

The non-transitory machine-readable medium according to claim 17, wherein the graphical information comprises: head gaze heading information; undersea information to provide an indication of undersea features; and/or an undersea terrain map.

### Claim 21 (depends on 17)

A watercraft comprising the non-transitory machine-readable medium according to claim 17.
