# US 2022/0031400 A1 · Systems and methods for tracking a surgical device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0031400 A1
- Document ID: US20220031400A1
- Status: Published application
- Kind: A1
- Application number: 17/383,980
- Filed: 2021-07-23
- Published: 2022-02-03
- Earliest claimed: 2020-07-31
- Assignees: Biosense Webster (Israel) Ltd.
- Applicants: Biosense Webster (Israel) Ltd.
- Inventors: Uriel Hod; Helen Wolfson; Itamar Bustan; Moran Levi; Noam Rachli
- Web page: https://patentgrep.com/patent/US20220031400A1

## CPC

- A61B 34/20: Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
- G06T 7/30: Determination of transform parameters for the alignment of images, i.e. image registration
- A61B 2034/2051: {Electromagnetic tracking systems}
- A61B 2034/2055: {Optical tracking systems}
- A61B 2034/2072: {Reference field transducer attached to an instrument or patient}
- A61B 2090/371: {with simultaneous use of two cameras}
- A61B 2090/3983: {Reference marker arrangements for use with image guided surgery}
- A61B 2562/0223: Magnetic field sensors
- G06T 2207/10028: Range image; Depth image; 3D point clouds
- G06T 2207/10081: Computed x-ray tomography [CT]
- G06T 2207/30016: Brain
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Systems, methods, and devices for registering a 3D image of a patient with magnetic coordinates are disclosed. A tri-axial sensor (TAS) may be added to the 3D camera. The location and orientation of the TAS sensor may be determined based on the known magnetic fields that are applied by a magnetic field transmitter. The camera coordinate system may then be transferred to the magnetic coordinate system. After completing the registration of the 3D image with a CT image and the 3D image with the magnetic coordinates, the CT image may then be registered with the magnetic coordinates.

## Claims

### Claim 1

A method comprising:
activating an electromagnetic tracking system on a head of a patient;
receiving a three-dimensional (3D) image of the head of the patient and storing the 3D image a scatter plot in a memory, wherein the 3D image is acquired using a 3D camera comprising at least one optical sensor and at least one magnetic sensor;
determining a location and an orientation of the 3D camera when the 3D image was acquired via magnetic sensor based on known magnetic fields applied by one or more transmitters of the electromagnetic tracking system;
registering the scatter plot to magnetic coordinates of the electromagnetic tracking system using the determined location and orientation of the 3D camera, wherein the registered scatter plot is stored in the memory.

### Claim 2 (depends on 1)

The method of claim 1, wherein the at least one magnetic sensor is a tri-axial sensor (TAS).

### Claim 3 (depends on 1)

The method of claim 1, wherein the at least one magnetic sensor is a single-axis sensor (SAS) or dual-axis sensor (DAS).

### Claim 4 (depends on 1)

The method of claim 1, wherein the scatter plot is a reference fixed to two separate optical sensors on the 3D camera.

### Claim 5 (depends on 1)

The method of claim 1, further comprising registering the received 3D image of the subject with a computerized tomography (CT) image of the subject.

### Claim 6 (depends on 5)

The method of claim 5, wherein the CT image is registered with the magnetic coordinates using an Iterative Closest Point (ICP) algorithm.

### Claim 7 (depends on 5)

The method of claim 5, further comprising registering a CT image of the patient with the magnetic coordinates.

### Claim 8

A system comprising
an electromagnetic tracking system comprising one or more transmitters configured to apply magnetic fields;
a 3D camera comprising at least one optical sensor and at least one magnetic sensor;
a memory configured to store a 3D image of a subject acquired by the 3D camera as a scatter plot; and
a processor configured to:
activate the electromagnetic tracking system;
retrieve the scatter plot from the memory;
determine a location and an orientation of the 3D camera when the 3D camera acquired the 3D image via the magnetic sensor based on known magnetic fields applied by a transmitter of the electromagnetic tracking system; and
register the scatter plot to magnetic coordinates of the electromagnetic tracking system;
the memory further configured to store the registered scatter plot.

### Claim 9 (depends on 8)

The system of claim 8, wherein the at least one magnetic sensor is a tri-axial sensor (TAS).

### Claim 10 (depends on 8)

The system of claim 8, wherein the at least one magnetic sensor is a single-axis sensor (SAS) or dual-axis sensor (DAS).

### Claim 11 (depends on 8)

The system of claim 8, wherein the scatter plot is a reference fixed to the at least one optical sensor of the 3D camera.

### Claim 12 (depends on 8)

The system of claim 8, wherein the processor is further configured to register a computerized tomography (CT) image with the 3D image.

### Claim 13 (depends on 12)

The system of claim 12, wherein the CT image is registered with the magnetic coordinates using an ICP algorithm.

### Claim 14 (depends on 12)

The system of claim 12, wherein the processor is further configured to register the CT image of the subject with the magnetic coordinates.

### Claim 15

A non-transitory computer readable storage medium in which program instructions are stored, which, when read by a processor, cause the processor to:
activate an electromagnetic tracking system;
retrieve a scatter plot of a 3D image of a subject, wherein the 3D image is acquired by a 3D camera comprising at least one optical sensor and at least one magnetic sensor;
determine a location and an orientation of the 3D camera when the 3D image was acquired via the magnetic sensor based on known magnetic fields applied by a transmitter of the electromagnetic tracking system; and
register the scatter plot to magnetic coordinates of the electromagnetic tracking system.

### Claim 16 (depends on 15)

The non-transitory computer readable storage medium of claim 15, wherein the at least one magnetic sensor is a tri-axial sensor (TAS).

### Claim 17 (depends on 15)

The non-transitory computer readable storage medium of claim 15, wherein the at least one magnetic sensor is a single-axis sensor (SAS) or dual-axis sensor (DAS).

### Claim 18 (depends on 15)

The non-transitory computer readable storage medium of claim 15, wherein the scatter plot is a reference fixed to the at least one optical sensor.

### Claim 19 (depends on 15)

The non-transitory computer readable storage medium of claim 15, wherein the stored program instructions, when read by a processor, further cause the processor to register a computerized tomography (CT) image with the 3D image.

### Claim 20 (depends on 19)

The non-transitory computer readable storage medium of claim 19, wherein the stored program instructions, when read by a processor, further cause the processor to register the CT image with the magnetic coordinates.
