# US 2022/0036583 A1 · Imaging to determine electrode geometry

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0036583 A1
- Document ID: US20220036583A1
- Status: Published application
- Kind: A1
- Application number: 17/501,528
- Filed: 2021-10-14
- Published: 2022-02-03
- Earliest claimed: 2017-07-12
- Assignees: Cardioinsight Technologies, Inc.
- Applicants: Cardioinsight Technologies Inc.
- Inventors: GLENN D. RAUDINS; QINGGUO ZENG; CHARULATHA RAMANATHAN; RYAN M. BOKAN
- Web page: https://patentgrep.com/patent/US20220036583A1

## CPC

- A61B 5/0536: Impedance imaging, e.g. by tomography
- A61B 5/367: Electrophysiological study [EPS], e.g. electrical activation mapping or electro-anatomical mapping
- A61B 5/0044: {for the heart}
- A61B 5/0064: {Body surface scanning}
- A61B 5/0077: {Devices for viewing the surface of the body, e.g. camera, magnifying lens}
- A61B 5/064: {using markers (A61B5/062 takes precedence)}
- A61B 5/282: Holders for multiple electrodes (for introduction into the body A61B5/287)
- A61B 5/7425: {Displaying combinations of multiple images regardless of image source, e.g. displaying a reference anatomical image with a live image}
- A61B 6/032: {Transmission computed tomography [CT]}
- A61B 6/5247: {combining images from an ionising-radiation diagnostic technique and a non-ionising radiation diagnostic technique, e.g. X-ray and ultrasound}
- A61B 34/20: Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
- A61B 90/361: {Image-producing devices, e.g. surgical cameras}
- A61B 90/39: {Markers, e.g. radio-opaque or breast lesions markers}
- G06T 7/0012: {Biomedical image inspection}
- G06T 7/337: {involving reference images or patches}
- G06T 7/74: {involving reference images or patches}
- A61B 5/4836: {Diagnosis combined with treatment in closed-loop systems or methods (A61B5/0036 takes precedence)}
- A61B 5/6805: {Vests, e.g. shirts or gowns}
- A61B 5/684: {Indicating the position of the sensor on the body}
- A61B 2034/105: {Modelling of the patient, e.g. for ligaments or bones}
- A61B 2034/2051: {Electromagnetic tracking systems}
- A61B 2034/2065: {Tracking using image or pattern recognition}
- A61B 2090/367: {creating a 3D dataset from 2D images using position information}
- A61B 2090/376: {using X-rays, e.g. fluoroscopy}
- A61B 2090/3937: {Visible markers}
- A61B 2090/3966: {Radiopaque markers visible in an X-ray image}
- A61B 2090/3983: {Reference marker arrangements for use with image guided surgery}
- A61B 2090/3995: {Multi-modality markers}
- A61B 2562/0209: Special features of electrodes classified in A61B5/24, A61B5/25, A61B5/283, A61B5/291, A61B5/296, A61B5/053
- A61B 2562/046: in a matrix array
- G06T 7/73: using feature-based methods
- G06T 2207/10028: Range image; Depth image; 3D point clouds
- G06T 2207/10081: Computed x-ray tomography [CT]
- G06T 2207/30048: Heart; Cardiac
- G06T 2207/30204: Marker
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A method includes placing a set of electrodes on a body surface of a patient's body. The method also includes digitizing locations for the electrodes across the body surface based on one or more image frames using range imaging and/or monoscopic imaging. The method also includes estimating locations for hidden ones of the electrodes on the body surface not visible during the range imaging and/or monoscopic imaging. The method also includes registering the location for the electrodes on the body surface with predetermined geometry information that includes the body surface and an anatomical envelope within the patient's body. The method also includes storing geometry data in non-transitory memory based on the registration to define spatial relationships between the electrodes and the anatomical envelope.

## Claims

### Claim 1

A method comprising:
placing a set of electrodes on a body surface of a patient's body;
digitizing locations for visible electrodes on the body surface based on one or more image frames acquired using optical imaging;
estimating locations for hidden ones of the electrodes on the body surface not visible during the optical imaging;
registering the locations for the visible and hidden ones of the electrodes on the body surface with geometry information that spatially describes the body surface and an anatomical envelope within the patient's body; and
storing geometry data in non-transitory memory based on the registration, the geometry data defining spatial relationships between the electrodes and the anatomical envelope.

### Claim 2 (depends on 1)

The method of claim 1, wherein the geometry information further comprises a template that defines geometry relationships among internal and external anatomical features.

### Claim 3 (depends on 2)

The method of claim 2, further comprising selecting the template from a plurality of templates in response to a user input.

### Claim 4 (depends on 2)

The method of claim 2, further comprising using localized electrical information measured via at least some of the electrodes to adjust the geometry relationships among at least some of the internal and external anatomical features.

### Claim 5 (depends on 1)

The method of claim 1, wherein estimating the locations of the hidden electrodes further comprises:
storing electrode geometry data describing a relative spatial position of at least some of the hidden electrodes, at least one visible electrode or tracking marker that is visible during the optical imaging being included in the electrode geometry data; and
determining a three-dimensional location for the at least one visible electrode or tracking marker,
wherein three-dimensional locations for the hidden electrodes are estimated based on the three-dimensional location determined for the at least one visible electrode or tracking marker and the electrode geometry data.

### Claim 6 (depends on 1)

The method of claim 1, wherein estimating the locations of the hidden electrodes further comprises:
using an optical image device to perform the optical imaging to generate imaging data for the set of electrodes within direct line of sight during the optical imaging;
performing electromagnetic tracking to generate other data describing three-dimensional locations of at least some of the hidden electrodes out of direct line of sight during the optical imaging; and
registering the other data with the imaging data to provide the three-dimensional locations for the electrodes on the body surface.

### Claim 7 (depends on 1)

The method of claim 1, wherein estimating the locations of the hidden electrodes further comprises:
using an optical image device to perform optical imaging to generate imaging data for the set of the electrodes within direct line of sight during the optical imaging;
performing radiographic imaging to generate other data describing three-dimensional locations of at least some of the hidden electrodes out of direct line of sight during the optical imaging; and
registering the other data with the imaging data to provide the three-dimensional locations for the electrodes on the body surface.

### Claim 8 (depends on 1)

The method of claim 1, further comprising:
acquiring a plurality of image frames from different viewing angles using the optical imaging; and
stitching the plurality of image frames together to provide a combined image by correlating multiple image frames based on a location and identity of the electrodes in the multiple image frames.

### Claim 9 (depends on 8)

The method of claim 8, wherein each image frame includes electrodes and surface information within a line of sight of an optical imaging device that is performing the optical imaging, the stitching further comprising:
using locations of identified electrodes to perform a rough alignment among the multiple image frames; and
performing a final registration between the multiple image frames based on pixel values and depth information across the surface that is shared by the respective multiple images; and
accumulating registered surface data from each of the image frames according to the final registration.

### Claim 10 (depends on 8)

The method of claim 8, further comprising generating guidance to a user by identifying one or more electrodes and/or location information missing from the plurality of image frames based on the location and identity of the electrodes determined for the plurality of image frames.

### Claim 11 (depends on 1)

The method of claim 1, further comprising:
measuring electrical signals from the body surface using the electrodes;
storing electrical measurement data representing the measured electrical signals over one or more time intervals; and
reconstructing electrical signals onto the anatomical envelope based on the electrical measurement data and the geometry data; and
generating an output visualization on a display based on the electrical measurement data and the geometry data.

### Claim 12

A system comprising:
an optical imaging device configured to generate imaging data containing one or more image frames of a body surface of a patient including a plurality of electrodes that have been positioned on the body surface and in direct line of sight during image capture by the optical imaging device;
non-transitory memory to store machine readable instructions and data, the data comprising geometry information for an anatomical envelope and the body surface;
at least one processor to access the memory and execute the instructions to perform a method that comprises:
determining three-dimensional electrode locations and surface geometry from the imaging data, the determined three-dimensional electrode locations and surface geometry including estimated locations for hidden electrodes outside of the direct line of sight during image capture by the optical imaging device;
registering the determined three-dimensional electrode locations and surface geometry with the geometry information for the anatomical envelope and the body surface to provide aggregate geometry data describing a three-dimensional spatial relationship between the plurality of electrodes and the anatomical envelope; and
storing the aggregate geometry data in the memory.

### Claim 13 (depends on 12)

The system of claim 12, further comprising tracking-markers at known locations relative to a portion of the electrodes, wherein the optical imaging device is configured to generate a series of image frames that includes the tracking markers, wherein the processor is configured to access the memory and execute the instructions to further determine the three-dimensional electrode locations and surface geometry from the series of image frames based on recognizing the tracking markers in the series of image frames.

### Claim 14 (depends on 12)

The system of claim 12, further comprising a radiographic imaging device that generates radiographic imaging data that includes the hidden electrodes out of the direct line of sight of the optical imaging device,
wherein the processor is further configured to access the memory and execute the instructions to register the radiographic imaging data with the three-dimensional electrode locations and surface geometry determined from the imaging data to provide registered imaging data that is further registered with the geometry information for the anatomical envelope and the body surface to provide the aggregate geometry data.

### Claim 15 (depends on 12)

The system of claim 12, further comprising an electromagnetic tracking system to generate tracking data describing three-dimensional locations of electromagnetic sensors having a known position relative to at least some of the hidden electrodes,
wherein the processor is further configured to access the memory and execute the instructions to register the tracking data with the three-dimensional electrode locations and surface geometry determined from the imaging data to provide corresponding registered data that is further registered with the geometry information for the anatomical envelope and the body surface to provide the aggregate geometry data.

### Claim 16 (depends on 12)

The system of claim 12, wherein the optical imaging device is a portable optical imaging device, and the imaging data includes a plurality of image frames acquired from different viewing angles, and
wherein the processor is further configured to access the memory and execute the instructions to stitch the plurality of image frames together to provide a combined image by correlating multiple image frames based on a location and identity of electrodes in the multiple image frames.

### Claim 17 (depends on 12)

The system of claim 12, further comprising:
an arrangement of sensors, which includes the plurality of electrodes, configured to be placed on the body surface to non-invasively measure electrophysiological signals from the body surface; and
a measurement system configured to provide electrical measurement data representing the measured electrophysiological signals,
wherein the at least one processor is further programmed to:
reconstruct electrophysiological signals onto the anatomical envelope based on the electrical measurement data and the aggregate geometry data; and
display a graphical output visualization based on the reconstructed electrophysiological signals.

### Claim 18

One or more non-transitory computer-readable media having instructions programmed to perform a method comprising:
storing imaging data containing one or more image frames of a body surface of a patient including a plurality of electrodes positioned on the body surface and in direct line of sight during image capture by an optical imaging device;
determining three-dimensional electrode locations and surface geometry based on the imaging data, in which the determined three-dimensional electrode locations and surface geometry includes estimated locations for hidden electrodes outside of the direct line of sight during image capture by the optical imaging device;
registering the determined three-dimensional electrode locations and surface geometry with predetermined anatomical geometry information, which describes a spatial relationship between the body surface and an anatomical envelope, to provide aggregate geometry data describing a three-dimensional spatial relationship between the plurality of electrodes and the anatomical envelope; and
storing the aggregate geometry data in the memory.

### Claim 19 (depends on 18)

The media of claim 18, wherein the method further comprises:
generating other spatial data describing three-dimensional locations of at least some of the hidden electrodes and/or three-dimensional locations of objects having a known position relative to at least some of the hidden electrodes; and
registering the other spatial data with the three-dimensional electrode locations and surface geometry determined from the imaging data to provide registered imaging data, the registered imaging data being further registered with the anatomical geometry information to provide the aggregate geometry data.

### Claim 20 (depends on 18)

The media of claim 18, wherein the method further comprises:
storing electrical measurement data representing electrophysiological signals measured from the body surface by at least some of the electrodes; and
reconstructing electrophysiological signals onto the anatomical envelope based on the electrical measurement data and the aggregate geometry data; and
displaying a graphical output visualization based on the reconstructed electrophysiological signals.
