# US 10,769,787 B2 · Device for projecting a guidance image on a subject

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,769,787 B2
- Document ID: US10769787B2
- Status: Granted
- Kind: B2
- Application number: 16/063,920
- Filed: 2016-12-22
- Published: 2019-01-03
- Granted: 2020-09-08
- Earliest claimed: 2015-12-22
- Assignees: Koninklijke Philips N.V.
- Applicants: Koninklijke Philips N.V.
- Inventors: Michael Grass; Dirk Schäfer; Thirukumaran Thangaraj Kanagasabapathi; Bernardus Hendrikus Wilhelmus Hendriks
- Web page: https://patentgrep.com/patent/US10769787B2

## CPC

- G06T 7/0014: {using an image reference approach}
- A61B 6/5247: {combining images from an ionising-radiation diagnostic technique and a non-ionising radiation diagnostic technique, e.g. X-ray and ultrasound}
- A61B 8/5261: {combining images from different diagnostic modalities, e.g. ultrasound and X-ray}
- A61B 90/361: {Image-producing devices, e.g. surgical cameras}
- G06T 7/11: Region-based segmentation
- G06T 7/337: {involving reference images or patches}
- A61B 2017/00699: {correcting for movement caused by respiration, e.g. by triggering}
- A61B 2034/2065: {Tracking using image or pattern recognition}
- A61B 2090/366: {using projection of images directly onto the body}
- A61B 2090/376: {using X-rays, e.g. fluoroscopy}
- A61B 2090/3762: {using computed tomography systems [CT]}
- A61B 2090/3764: {with a rotating C-arm having a cone beam emitting source}
- A61B 2090/378: {using ultrasound}
- G06T 2207/10081: Computed x-ray tomography [CT]
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)

## Abstract

The present invention relates to providing a projection data for providing a guidance image. In order to provide an enhanced guiding image technique for generating a guidance image of the patient's anatomy to be projected on the body surface of the patient, such that a at least a basis for a corrected guidance image for a better correlation to the patient's current motion can be provided, in particular to the patient's current breathing motion state, a device (10) for providing a projection data set is provided that comprises a storage means (12), an input interface (14), a processing unit (16) and an output interface (18). The storage means is configured to store a pre-determined basis data set representing a 3D tomographic image of a subject (20). The input interface is configured to receive reference data representing a current spatial depiction at least of a target region (22) of the subject. The processing unit is configured to register the reference data on the pre-determined basis data set. The processing unit is further configured to transform, based on the reference data and the result of the registration, the pre-determined basis data set resulting in a working data set representing a transformed 3D tomographic image indicating the current spatial anatomy relation at least for the target region of the subject. The processing unit is also configured to segment the working data set resulting in a projection data set representing the target region of the subject. Still further, output interface is configured to provide the projection data set for a further purpose.

## Claims

### Claim 1

A device for projecting a guidance image on a subject, comprising:
a storage medium having stored therein a pre-determined basis data set representing a 3D tomographic image of a subject;
an input for receiving reference data representing a current spatial depiction at least of a target region of the subject;
a processor coupled to said storage to receive the pre-determined basis data set representing the 3D tomographic image of the subject, and to said input to receive the reference data representing the current spatial depiction at least of the target region of the subject, said processor being configured to:
register the reference data on the pre-determined basis data set,
transform, based on the reference data and the result of the registration, the pre-determined basis data set resulting in a working data set representing a transformed 3D tomographic image indicating the current spatial anatomy relation at least for the target region of the subject, and
segment the working data set resulting in a projection data set representing the target region of the subject;
an output coupled to the processor to provide the projection data set; and
an optical projector coupled to the output to project the projection data set as a guidance image on the subject,
wherein the processor is configured to segment the working data set, such that the resulting projection data set represents an entrance point at a surface of the subject.

### Claim 2 (depends on 1)

The device as claimed in claim 1, wherein the processor is configured to segment the working data set, such that the resulting projection data set represents an anatomy of the target region of the subject and/or an entrance point at a surface of the target region of the subject.

### Claim 3 (depends on 1)

The device as claimed in claim 1, wherein the input receives updated reference data in predefined time intervals or continuously.

### Claim 4 (depends on 1)

The device as claimed in claim 1, wherein the reference data is formed by reference image data.

### Claim 5 (depends on 1)

The device as claimed in claim 1, wherein the reference data is formed by tomographical reference image data.

### Claim 6 (depends on 1)

The device as claimed in claim 1, wherein the storage medium stores a plurality of image data sets each representing a corresponding spatial depiction at least of the target region of the subject;
wherein the processor is configured to select, based on the reference data, one of the plurality of image data sets as a reference image data set; and
wherein the processor is configured to transform, based on the reference image data set, the pre-determined basis data set resulting in the working data set representing the transformed 3D tomographic image indicating the current spatial anatomy relation at least for the target region of the subject.

### Claim 7 (depends on 1)

A system for projecting a guidance image on a subject, comprising:
an imaging device; and
the device for projecting a guidance image on a subject as claimed in claim 1;
wherein the imaging device detects the subject and generates the reference data representing a current spatial depiction at least of a target region of the subject for application to the input of the device for projecting a guidance image on a subject, and
wherein the processor is configured to segment the working data set, such that the resulting projection data set represents an entrance point at a surface of the subject.

### Claim 8 (depends on 7)

The system as claimed in claim 7, wherein the imaging device comprises at least one optical camera arrangement.

### Claim 9 (depends on 7)

The system as claimed in claim 7, wherein the imaging device comprises at least one X-ray detection arrangement.

### Claim 10 (depends on 7)

The system as claimed in claim 7, wherein the imaging device comprises at least one ultrasonic detection arrangement.

### Claim 11

A method for projecting a guidance image on a subject, comprising the following steps:
a) receiving reference data representing a current spatial depiction at least of a target region of a subject;
b) transforming, based in the reference data, a pre-determined basis data set, which represents a 3D tomographic image of the subject, resulting in a working data set representing a transformed 3D tomographic image indicating the current spatial anatomy relation at least for the target region of the subject;
c) segmenting the working data set resulting in a projection data set representing the target region of the subject; and
d) projecting the projection data set as a guidance image on the subject,
wherein the working data set is segmented such that the resulting projection data set represents an entrance point at a surface of the subject.

### Claim 12 (depends on 11)

A non-transitory computer-readable storage medium having stored a computer program element comprising instructions for controlling an apparatus, which, when being executed by a processor, is adapted to cause the processor and the apparatus to perform the method steps of claim 11.