# US 2020/0349726 A1 · Methods and devices for surface motion tracking

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0349726 A1
- Document ID: US20200349726A1
- Status: Published application
- Kind: A1
- Application number: 16/947,165
- Filed: 2020-07-21
- Published: 2020-11-05
- Earliest claimed: 2018-01-18
- Assignees: Elekta Limited
- Applicants: Elekta, Inc.
- Inventors: Nicolette Patricia Magro; Xiao Han
- Web page: https://patentgrep.com/patent/US20200349726A1

## CPC

- A61B 5/704: {Tables}
- A61B 5/0077: {Devices for viewing the surface of the body, e.g. camera, magnifying lens}
- A61B 5/015: {By temperature mapping of body part}
- A61B 5/055: involving electronic [EMR] or nuclear [NMR] magnetic resonance, e.g. magnetic resonance imaging
- A61B 6/032: {Transmission computed tomography [CT]}
- A61B 6/4085: {Cone-beams}
- A61N 5/1039: {using functional images, e.g. PET or MRI}
- G06T 7/30: Determination of transform parameters for the alignment of images, i.e. image registration
- G06T 7/38: Registration of image sequences
- A61B 5/1135: {by monitoring thoracic expansion}
- A61B 2090/364: {Correlation of different images or relation of image positions in respect to the body}
- G06T 2207/10004: Still image; Photographic image
- G06T 2207/10021: Stereoscopic video; Stereoscopic image sequence
- G06T 2207/10048: Infrared image
- G06T 2207/10081: Computed x-ray tomography [CT]
- G06T 2207/10088: Magnetic resonance imaging [MRI]
- G06T 2207/10108: Single photon emission computed tomography [SPECT]
- G06T 2207/20221: Image fusion; Image merging
- G06T 2207/30004: Biomedical image processing
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- A61N: ELECTROTHERAPY; MAGNETOTHERAPY; RADIATION THERAPY; ULTRASOUND THERAPY (measurement of bioelectric currents A61B; surgical instruments, devices or methods for transferring non-mechanical forms of energy to or from the body A61B18/00; anaesthetic apparatus in general A61M; incandescent lamps H01K; infrared radiators for heating H05B)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Embodiments of the disclosure may be directed to an image processing system configured to receive a medical image of a region of a subject's body taken at a first time and to receive a surface image of an exterior portion of the region of the subject's body taken at the first time. The image processing may also be configured to receive a medical image of the region of the subject's body taken at a second time and to register the medical image taken at the first time, the surface image taken at the first time, and the medical image taken at the second time.

## Claims

### Claim 1

An image processing system comprising:
an image processor circuit configured to:
receive a medical image of a region of a subject's body taken at a first time;
receive a surface image of an exterior portion of the region of the subject's body taken at the first time;
receive a medical image of the region of the subject's body taken at a second time;
register the medical image taken at the first time and the surface image taken at the first time to form a combined image, and then register the combined image with the medical image taken at the second time to form a combined registered image, wherein the combined registered image includes one or more data points or other non-image information to indicate a position of the surface image taken at the first time and the position of the medical image taken at the first time.

### Claim 2 (depends on 1)

The system of claim 1, wherein registering the medical image taken at the first time and the surface image taken at the first time to form a combined image includes using deformable registration.

### Claim 3 (depends on 1)

The system of claim 1, wherein the second time precedes the first time.

### Claim 4 (depends on 1)

The system of claim 1, wherein the medical image taken at the second time is a planning computed tomography image.

### Claim 5 (depends on 1)

The system of claim 1, wherein the medical image taken at the first time is either a magnetic resonance image or a cone-beam computed tomography image.

### Claim 6 (depends on 1)

The system of claim 1, wherein the image processor circuit is further configured to obtain the medical image at the first time and obtain the surface image at the first time.

### Claim 7 (depends on 1)

The system of claim 1, wherein the surface image is one of an optical image, an infrared image, a thermal image, or a stereoscopic image.

### Claim 8 (depends on 1)

The system of claim 1, wherein the first time occurs during a radiotherapy treatment fraction.

### Claim 9 (depends on 1)

The system of claim 1, wherein the second time occurs during a planning stage.

### Claim 10 (depends on 1)

The system of claim 1, wherein the medical image taken at the second time includes at least part of the exterior portion of the region of the subject's body.

### Claim 11

A computer-implemented image processing method comprising:
receiving a first medical image of a region of a subject's body taken at a first time;
receiving a first surface image of an exterior portion of the region of the subject's body at the first time;
registering the first medical image and the first surface image to form a first combined image;
receiving a second medical image of the region of the subject's body taken at a second time;
receiving a second surface image of the exterior portion of the region of the subject's body at the second time;
registering the second medical image and the second surface image to form a second combined image; and
registering the first combined image and the second combined image to form a combined registered image, wherein the combined registered image includes one or more data points or other non-image information to indicate a position of the first surface image taken at the first time and the position of the first medical image taken at the first time.

### Claim 12 (depends on 11)

The method of claim 11, wherein the first medical image and the second medical image are either magnetic resonance images or cone-beam computed tomography images.

### Claim 13 (depends on 11)

The method of claim 11, wherein the first surface image and the second surface image are an optical image, an infrared image, a thermal image, or a stereoscopic image.

### Claim 14 (depends on 11)

The method of claim 11, wherein the first time occurs during a radiotherapy treatment fraction.

### Claim 15 (depends on 11)

The method of claim 11, wherein the second time occurs during a planning stage.

### Claim 16

A non-transitory computer-readable medium storing instructions that, when executed by a processor, cause the processor to perform an image processing method, the method comprising:
receiving a medical image of an interior region of a subject's body taken at a first time;
receiving a surface image of an exterior portion of the interior region of the subject's body taken at the first time;
receiving a medical image of the subject's body taken at a second time; and
registering the medical image taken at the first time and the surface image taken at the first time to form a combined image, and then register the combined image with the medical image taken at the second time using deformable registration to form a combined registered image, wherein the combined registered image includes one or more data points or other non-image information to indicate a position of the surface image taken at the first time and the medical image taken at the first time.

### Claim 17 (depends on 16)

The method of claim 16, wherein the surface image is one of an optical image, an infrared image, a thermal image, or a stereoscopic image.

### Claim 18 (depends on 16)

The method of claim 16, wherein the medical image taken at the second time is a planning computed tomography image, and the medical image taken at the first time is either a magnetic resonance image or a cone-beam computed tomography image.

### Claim 19 (depends on 18)

The method of claim 18, wherein the planning computed tomography image also includes at least some of the exterior portion of the interior region of the subject's body.

### Claim 20 (depends on 16)

The method of claim 16, wherein the first time occurs during a radiotherapy treatment fraction.

### Claim 21 (depends on 16)

The method of claim 16, wherein the second time occurs during a planning stage.
