# US 2022/0035461 A1 · Ambient electromagnetic distortion correction for electromagnetic tracking

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0035461 A1
- Document ID: US20220035461A1
- Status: Published application
- Kind: A1
- Application number: 17/505,497
- Filed: 2021-10-19
- Published: 2022-02-03
- Earliest claimed: 2018-10-26
- Assignees: Magic Leap, Inc.
- Applicants: Magic Leap, Inc.
- Inventors: Richmond B. Chan
- Web page: https://patentgrep.com/patent/US20220035461A1

## CPC

- G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
- G01R 33/0082: {Compensation, e.g. compensating for temperature changes}
- G01R 33/02: Measuring direction or magnitude of magnetic fields or magnetic flux (G01R33/20 takes precedence)
- G02B 27/0179: {Display position adjusting means not related to the information to be displayed}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/012: {Head tracking input arrangements}
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G01R: MEASURING ELECTRIC VARIABLES; MEASURING MAGNETIC VARIABLES (indicating correct tuning of resonant circuits H03J3/12)
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Head-mounted augmented reality (AR) devices can track pose of a wearer's head to provide a three-dimensional virtual representation of objects in the wearer's environment. An electromagnetic (EM) tracking system can track head or body pose. A handheld user input device can include an EM emitter that generates an EM field, and the head-mounted AR device can include an EM sensor that senses the EM field (e.g., for determining head pose). The generated EM field may be distorted due to nearby electrical conductors or ferromagnetic materials, which may lead to error in the determined pose. Systems and methods are disclosed that measure the degree of EM distortion, as well as correct for the EM distortion. The EM distortion correction may be performed in real time by the EM tracking system without the need for additional data from imaging cameras or other sensors.

## Claims

### Claim 1

A system comprising:
an electromagnetic (EM) emitter configured to generate a magnetic field;
an EM sensor configured to sense the magnetic field and provide EM sensor data; and
a hardware processor programmed to:
receive EM sensor data from the EM sensor, the EM sensor data comprising an EM field matrix;
detect presence of EM distortion;
calculate, only when the detected EM distortion is above a first threshold or a change in the detected EM distortion is above a second threshold, based at least partly on the EM sensor data, distortion compensating matrices;
calculate, based at least partly on the distortion compensating matrices, an undistorted EM field matrix;
calculate, based at least partly on the undistorted EM field matrix, a pose of the EM sensor.

### Claim 2 (depends on 1)

The system of claim 1, further comprising:
an outward-facing imaging system; and
a hand-held user input device;
wherein the hardware processor is programmed to:
analyze images obtained by the outward-facing imaging system;
determine, based at least partly on the analyzed images, a pose of the user input device; and
calculate the distortion compensating matrices based at least in part on the determined pose of the user input device.

### Claim 3 (depends on 1)

The system of claim 1, wherein the distortion compensating matrices comprise a first matrix CL and a second matrix CR, and to calculate the undistorted EM field matrix, the hardware processor is programmed to evaluate CL Fd CR where Fd is the EM field matrix.

### Claim 4 (depends on 1)

The system of claim 1, wherein to calculate the pose of the EM sensor, the hardware processor is programmed to use direct computational methods that do not utilize numerical iteration

### Claim 5 (depends on 1)

The system of any claim 1, wherein the hardware processor is further programmed to render a virtual object based at least in part on the calculated pose.

### Claim 6 (depends on 1)

The system of claim 1, wherein the hardware processor is further programmed to calculate a degree of EM distortion in an ambient environment using a metric based on eigenvalues of the EM field matrix

### Claim 7 (depends on 6)

The system of claim 6, wherein the metric is based on a combination of differences of the eigenvalues from a reference value.

### Claim 8 (depends on 7)

The system of claim 7, wherein the eigenvalues are normalized based on a determinant of the EM field matrix.

### Claim 9 (depends on 1)

The system of claim 1, wherein to calculate the distortion compensating matrices, the hardware processor is further programmed to compare the EM sensor data to ground truth data for a relative pose of the EM sensor to an EM emitter obtained by a non-EM tracking system.

### Claim 10 (depends on 9)

The system of claim 9, wherein the non-EM tracking system comprises an imaging system or an ultrasound system.

### Claim 11

A method for correcting for electromagnetic (EM) distortion in an EM tracking system, the method comprising:
under control of a hardware processor:
receiving EM sensor data from an EM sensor, the EM sensor data comprising an EM field matrix;
detecting the presence of EM distortion;
calculating, only when the detected EM distortion is above a first threshold or a change in the detected EM distortion is above a second threshold, based at least partly on the EM sensor data, distortion compensating matrices;
calculating, based at least partly on the distortion compensating matrices, an undistorted EM field matrix; and
calculating, based at least partly on the undistorted EM field matrix, a pose of the EM sensor.

### Claim 12 (depends on 11)

The method of claim 11, wherein the pose comprises a six degree-of-freedom (6DOF) pose.

### Claim 13 (depends on 11)

The method of claim 11, further comprising detecting presence of an EM distortion.

### Claim 14 (depends on 13)

The method of claim 13, wherein detecting the presence of the EM distortion further comprises calculating a deviation of eigenvalues of the EM field matrix from eigenvalues for an undistorted EM field matrix.

### Claim 15 (depends on 14)

The method of claim 14, wherein detecting the presence of the EM distortion comprises determining that a deviation of the eigenvalues exceeds a threshold.

### Claim 16 (depends on 11)

The method of claim 11, wherein calculating the distortion compensating matrices further comprises comparing to ground truth data for a relative pose of the EM sensor to an EM emitter obtained by a non-EM tracking system.

### Claim 17 (depends on 16)

The method of claim 16, wherein the non-EM tracking system comprises an imaging system or an ultrasound system.

### Claim 18 (depends on 11)

The method of claim 11, further comprising calculating a degree of EM distortion in an ambient environment using a metric based on eigenvalues of the EM field matrix.

### Claim 19 (depends on 18)

The method of claim 18, wherein the metric is based on a combination of differences of the eigenvalues from a reference value.

### Claim 20 (depends on 19)

The method of claim 19, wherein the eigenvalues are normalized based on a determinant of the EM field matrix.
