# US 2023/0410330 A1 · Techniques for accurate pose estimation

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0410330 A1
- Document ID: US20230410330A1
- Status: Published application
- Kind: A1
- Application number: 18/234,769
- Filed: 2023-08-16
- Published: 2023-12-21
- Earliest claimed: 2014-08-22
- Assignees: Applied Research Associates, Inc.
- Applicants: Applied Research Associates, Inc.
- Inventors: Alberico Menozzi; Chris F. Argenta; James B. Cook
- Web page: https://patentgrep.com/patent/US20230410330A1

## CPC

- G06T 7/33: using feature-based methods
- G01C 21/1654: {with electromagnetic compass}
- G01C 21/1656: {with passive imaging devices, e.g. cameras}
- G02B 27/0093: {with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking}
- G02B 27/017: {Head mounted}
- G06F 1/163: {Wearable computers, e.g. on a belt}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/04817: using icons (graphical or visual programming using iconic symbols G06F8/34)
- G06F 11/00: Error detection; Error correction; Monitoring (error detection, correction or monitoring in information storage based on relative movement between record carrier and transducer G11B20/18; monitoring, i.e. supervising the progress of recording or reproducing G11B27/36; in static stores G11C29/00)
- G06T 5/20: using local operators
- G06T 11/00: Two-dimensional [2D] image generation
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G02B 2027/0138: {comprising image capture systems, e.g. camera}
- G02B 2027/0141: {characterised by the informative content of the display}
- G02B 2027/0181: {Adaptation to the pilot/driver}
- G06F 3/01: Input arrangements or combined input and output arrangements for interaction between user and computer (G06F3/16 takes precedence)
- G06T 2200/24: involving graphical user interfaces [GUIs]
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

The described technology regards an augmented reality system and method for estimating a position of a location of interest relative to the position and orientation of a display, including receiving and selectively filtering a plurality of measurement vectors from a rate-gyroscope. Systems of the described technology include including a plurality of sensors, a processing module or other computation means, and a database. Methods of the described technology use data from the sensor package useful to accurately render graphical user interface information on a display.

## Claims

### Claim 1

A head-mounted display for a user, comprising:
a display screen positioned in the line of sight of the user;
a processor;
one or more non-transitory computer-readable media storing computer-executable instructions that, when executed, cause the processor to:
display, on the display screen, at least a portion of a situational awareness ring,
wherein the situational awareness ring is centered on the user's location,
wherein the situational awareness ring displays a plurality of geo-registered icons representing a corresponding plurality of points of interest,
wherein each icon is positioned on the situational awareness ring in a position corresponding to the bearing of the corresponding point of interest relative to a pose azimuth of the user;
dynamically update the rotation of the situational awareness ring based on the user's pose azimuth such that a heading corresponding to a user's line of sight remains at a fixed point on the situational awareness ring as the user's pose azimuth changes;
dynamically update the positions of the plurality of icons based on updated bearings to the plurality of points of interest as the plurality of points of interest move relative to the user.

### Claim 2 (depends on 1)

The head-mounted display of claim 1, wherein the user's pose azimuth is determined based on updating a state-based estimation of the orientation of the display using data received from a relative orientation sensor.

### Claim 3 (depends on 2)

The head-mounted display of claim 2, wherein the user's pose azimuth is determined further based on updating the state-based estimation of the orientation of the display using data received from an absolute orientation sensor.

### Claim 4 (depends on 2)

The head-mounted display of claim 2, wherein the state-based estimation of the orientation of the display is an Extended Kalman Filter-based estimation of the orientation of the display.

### Claim 5 (depends on 1)

The head-mounted display of claim 1, wherein the updated bearings to the plurality of points of interest are determined based on updating a state-based estimation of the position of the display using data received from a relative position sensor.

### Claim 6 (depends on 5)

The head-mounted display of claim 5, wherein the updated bearings to the plurality of points of interest are further determined based on updating a state-based estimation of the position of the display using data received from an absolute position sensor.

### Claim 7 (depends on 5)

The head-mounted display of claim 5, wherein the state-based estimation of the position of the display is an Extended Kalman Filter-based estimation of the position of the display.

### Claim 8 (depends on 1)

The head-mounted display of claim 1, wherein at least one icon of the plurality of icons corresponds to an aircraft, and wherein the icon further includes indicia of an altitude of the aircraft.

### Claim 9 (depends on 1)

The head-mounted display of claim 1, wherein the entire situational awareness ring is displayed on the display.

### Claim 10 (depends on 9)

The head-mounted display of claim 9,
wherein the user's position is displayed in the center of the situational awareness ring, and
wherein the user's heading is displayed above the situational awareness ring.

### Claim 11

A method for displaying a situational-awareness ring on a head-mounted display, the method comprising the steps of:
displaying, on a display screen of the head-mounted display, at least a portion of the situational awareness ring,
wherein the situational awareness ring displays a plurality of geo-registered icons representing a corresponding plurality of points of interest,
wherein each icon is positioned on the situational awareness ring in a position corresponding to the bearing of the corresponding point of interest relative to a pose azimuth of the user;
dynamically updating the rotation of the situational awareness ring based on the user's pose azimuth such that a heading corresponding to a user's line of sight remains at a fixed point on the situational awareness ring as the user's pose azimuth changes;
dynamically updating the positions of the plurality of icons based on updated bearings to the plurality of points of interest as the plurality of points of interest move relative to the user.

### Claim 12 (depends on 11)

The method of claim 11, wherein the user's pose azimuth is determined based on updating a state-based estimation of the orientation of the display using data received from a relative orientation sensor and an absolute orientation sensor.

### Claim 13 (depends on 12)

The method of claim 12, wherein the updated bearings to the plurality of points of interest are determined based on updating a state-based estimation of the position of the display using data received from a relative position sensor and an absolute position sensor.

### Claim 14 (depends on 13)

The method of claim 13, wherein the state-based estimation of the orientation of the display and the state-based estimation of the position of the display are an Extended Kalman Filter-based estimation of the position and orientation of the display.

### Claim 15 (depends on 11)

The method of claim 11, wherein at least one icon of the plurality of icons corresponds to a movement objective of the user.

### Claim 16

One or more non-transitory computer-readable media storing computer executable instructions that, when executed by a processor, perform a method of displaying a situational-awareness ring, comprising the steps of:
displaying, on a display screen, at least a portion of the situational awareness ring,
wherein the situational awareness ring displays a plurality of geo-registered icons representing a corresponding plurality of points of interest,
wherein each icon is positioned on the situational awareness ring in a position corresponding to the bearing of the corresponding point of interest relative to a pose azimuth of the display;
dynamically updating the rotation of the situational awareness ring based on the display's pose azimuth such that a heading corresponding to an orientation of the display remains at a fixed point on the situational awareness ring as the display's pose azimuth changes;
dynamically updating the positions of the plurality of icons on the situational awareness ring based on updated bearings to the plurality of points of interest as the plurality of points of interest move relative to the display.

### Claim 17 (depends on 16)

The media of claim 16, wherein the display's pose azimuth is determined based on updating an Extended Kalman Filter-based estimation of the orientation of the display using data received from a relative orientation sensor and an absolute orientation sensor.

### Claim 18 (depends on 16)

The media of claim 16, wherein the updated bearings to the plurality of points of interest are determined based on updating an Extended Kalman Filter-based estimation of the position of the display using data received from a relative position sensor and an absolute position sensor.

### Claim 19 (depends on 16)

The media of claim 16, wherein at least one icon of the plurality of icons corresponds to an aircraft, and wherein the icon further includes indicia of an altitude of the aircraft.

### Claim 20 (depends on 16)

The media of claim 16, wherein the entire situational awareness ring is displayed on the display.
