# US 2025/0165062 A1 · A head tracking system > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2025/0165062 A1 - Document ID: US20250165062A1 - Status: Published application - Kind: A1 - Application number: 18/874,914 - Filed: 2023-06-01 - Published: 2025-05-22 - Earliest claimed: 2022-06-13 - Assignees: BAE SYSTEMS plc - Applicants: Bae Systems PLC - Inventors: Colin Richard Mills; Simon Trythall - Web page: https://patentgrep.com/patent/US20250165062A1 ## CPC - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G06F 3/012: {Head tracking input arrangements} - G02B 27/0093: {with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking} - G06F 3/0304: {Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042)} - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS ## Abstract A head tracking system HTS (100, 200) and associated method and head worn assembly, configured to determine a head position and/or a head orientation of a user, the HTS comprising: one or more optical sensors (112) producing optical measurements; and one or more inertial sensors (104) producing inertial measurements; a processor configured, when the optical sensors fail to provide optical measurements to determine the head location and the head orientation of a user, to operate in a coasting mode using the inertial measurements from the one or more inertial sensors to determine the head location and the head orientation of a user, the processor configured to further: determine a figure of merit FOM (346) for coasting errors based on a combination of one or more of errors in an estimated inertial sensor bias, a random drift and noise of the inertial sensor and the inertial sensor gain and alignment errors; compare (348) the FOM with a threshold to determine whether the inertial measurements provide a valid or invalid head location and/or head orientation; and determine a subsequent operation from a plurality of possible subsequent operations of the HTS based on whether the head location and/or head orientation is valid or invalid. ## Claims ### Claim 1 A head tracking system (HTS), configured to determine a head position and/or a head orientation of a user, the HTS comprising: an optical sensor configured to produce an optical measurement; an inertial sensor configured to produce an inertial measurement; and a processor configured to operate in a coasting mode, when the optical sensor fails to provide the optical measurement to determine the head location and the head orientation of a user, the coasting mode using the inertial measurement from the inertial sensor to determine the head location and the head orientation of a user, the processor configured to: determine a figure of merit (FOM) for a coasting error based on a combination of an error in an estimated bias of the inertial sensor, an error due to random drift and noise of the inertial sensor, and an error due to gain and alignment errors of the inertial sensor, compare the FOM with a threshold to determine whether the inertial measurement provides a valid or invalid head location and/or head orientation; and determine a subsequent operation from a plurality of possible subsequent operations of the HTS based on whether the head location and/or head orientation is valid or invalid. ### Claim 2 (depends on 1) The head tracking system according to claim 1, wherein when the coasting error is less than the threshold the head location and/or head orientation is valid. ### Claim 3 (depends on 1) The head tracking system according to claim 1, wherein when the coasting error is greater than/or equal to the threshold the head location and/or head orientation is invalid. ### Claim 4 (depends on 1) The head tracking system according to claim 1, wherein the HTS further includes an action control module to determine which subsequent operations are available. ### Claim 5 (depends on 4) The head tracking system according to claim 4, wherein the possible subsequent operation comprises normal operation when the head location and/or head orientation is valid. ### Claim 6 (depends on 4) The head tracking system according to claim 4, wherein the possible subsequent operation comprises limited operation when the head location and/or head orientation is invalid, and the operation does not need the position or orientation of a user. ### Claim 7 (depends on 4) The head tracking system according to claim 4, wherein the possible subsequent operation comprises declaring tracking invalid when the head location and/or head orientation is invalid, and the operation does need the position or orientation of a user. ### Claim 8 (depends on 1) The head tracking system according to claim 1, wherein the processor is configured to: determine the head position and/or the head orientation from one or both of the optical sensor and the inertial sensor; determine the head position and/or the head orientation from the inertial sensor if the optical measurement is invalid; determine the head position and/or the head orientation from the optical sensor if the inertial measurement is invalid. ### Claim 9 (depends on 1) The head tracking system according to claim 1, further configured to determine a rate of changes of FOM to identify trends and potential risks. ### Claim 10 (depends on 1) The head tracking system according to claim 1, wherein the inertial sensor is one of three or more gyroscopes located on a head worn assembly associated with the HTS. ### Claim 11 (depends on 1) The head tracking system according to claim 1, wherein the optical sensor is a camera in the vicinity of the HTS being configured to receive optical measurements from one or more light elements located on a head worn assembly associated with the HTS. ### Claim 12 (depends on 1) The head tracking system according to claim 1, further comprising an interface to receive aircraft orientation, aircraft position and associated latencies of the aircraft orientation and aircraft position data which is used in calculating the FOM. ### Claim 13 (depends on 1) The head tracking system according to claim 1, incorporated into a head worn display assembly such as a helmet. ### Claim 14 (depends on 1) A head worn display assembly configured to present real and virtual images to a user based on a head position and a head orientation provided by the HTS of claim 1. ### Claim 15 (depends on 14) The head worn assembly of claim 14, further including an optical display to display the real and virtual images to a user wearing the head worn assembly, wherein the presentation of at least the virtual images is based on the FOM of the inertial measurement. ### Claim 16 (depends on 14) The head worn assembly of claim 14, wherein the optical display comprises at least one of a visor-projection display system, and a waveguide-based display, arranged to present virtual images such that they appear overlain through a visor of the head worn display. ### Claim 17 A method to determine a head location and a head orientation of a user to which real and virtual images are to be presented using a head tracking system (HTS) configured to produce optical measurements and to produce inertial measurements, the method comprising: using, when optical measurements are unavailable, the inertial measurements to determine the head location and position; determining a figure of merit FOM (FOM) for coasting errors based on a combination of an error in an estimated bias of an inertial sensor that produces one or more of the inertial measurements, an error due to random drift and noise of the inertial sensor, and an error due to gain and alignment errors of the inertial sensor; comparing the FOM with a threshold to determine whether the one or more inertial measurements provide a valid or invalid head location and/or head orientation; and determining a subsequent operation from a plurality of possible subsequent operations of the HTS based on whether the head location and/or head orientation is valid or invalid. ### Claim 18 (depends on 17) The method of claim 17, wherein determining the head location and/or head orientation is valid when the FOM is less than the threshold, and wherein determining the head location and/or head orientation is invalid when the FOM is greater than/or equal to the threshold. ### Claim 19 (depends on 18) The method according claim 18, further comprising determining which subsequent operations are available via an action control module, further comprising one or more of: determining the possible subsequent operation to be a normal operation when the head location and/or head orientation is valid, or the operation does not need the position or location of a user; determining the possible subsequent operation to be a limited operation when the head location and/or head orientation is invalid, and the operation does not need the position or location of a user; and determining the possible subsequent operation to be declaring tracking invalid when the head location and/or head orientation is invalid, and the operation does need the position or location of a user. ### Claim 20 (depends on 17) The method according to claim 17, further comprising determining a rate of changes of FOM to identify trends and potential risks. ### Claim 21 (depends on 17) The method according to claim 17, further comprising notifying a vehicle control system when the FOM is invalid to enable the vehicle control system to reset head tracking.