# US 2019/0318823 A1 · Image processing apparatus, x-ray diagnostic apparatus, and image processing method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0318823 A1
- Document ID: US20190318823A1
- Status: Published application
- Kind: A1
- Application number: 16/385,567
- Filed: 2019-04-16
- Published: 2019-10-17
- Earliest claimed: 2018-04-16
- Assignees: Canon Medical Systems Corporation
- Applicants: Canon Medical Systems Corporation
- Inventors: Mika TAKAYA; Ryoichi NAGAE; Sho SASAKI
- Web page: https://patentgrep.com/patent/US20190318823A1

## CPC

- A61B 6/12: Arrangements for detecting or locating foreign bodies
- G16H 30/40: for processing medical images, e.g. editing
- A61B 6/4441: {the rigid structure being a C-arm or U-arm}
- A61B 6/466: {adapted to display 3D data}
- A61B 6/481: {involving the use of contrast agents}
- A61B 6/487: {involving fluoroscopy}
- A61B 6/504: {for diagnosis of blood vessels, e.g. by angiography}
- A61B 6/5205: {involving processing of raw data to produce diagnostic data}
- A61B 6/5211: {involving processing of medical diagnostic data}
- A61B 34/20: Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
- G06T 7/0012: {Biomedical image inspection}
- G06T 7/33: using feature-based methods
- G06T 7/73: using feature-based methods
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G16H 50/50: for simulation or modelling of medical disorders
- A61B 6/06: Diaphragms
- A61B 6/4035: {the source being combined with a filter or grating}
- A61B 6/463: {characterised by displaying multiple images or images and diagnostic data on one display}
- A61B 2034/102: {Modelling of surgical devices, implants or prosthesis}
- A61B 2034/107: {Visualisation of planned trajectories or target regions}
- A61B 2090/376: {using X-rays, e.g. fluoroscopy}
- A61B 2090/3966: {Radiopaque markers visible in an X-ray image}
- A61B 2576/00: Medical imaging apparatus involving image processing or analysis (A61B1/00009, A61B6/52 and A61B8/52 take precedence)
- A61F 2/07: Stent-grafts
- G06T 2207/10116: X-ray image
- G06T 2207/30004: Biomedical image processing
- G06T 2210/62: Semi-transparency
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- A61F: FILTERS IMPLANTABLE INTO BLOOD VESSELS; PROSTHESES; DEVICES PROVIDING PATENCY TO, OR PREVENTING COLLAPSING OF, TUBULAR STRUCTURES OF THE BODY, e.g. STENTS; ORTHOPAEDIC, NURSING OR CONTRACEPTIVE DEVICES; FOMENTATION; TREATMENT OR PROTECTION OF EYES OR EARS; BANDAGES, DRESSINGS OR ABSORBENT PADS; FIRST-AID KITS (dental prosthetics A61C)

## Abstract

A medical image-processing apparatus according to an embodiment includes processing circuitry configured to determine a position of a feature point of a device in a first X-ray image, and generate a superimposed image in which a 3D model expressing the device is superimposed on the first X-ray image or a second X-ray image that is acquired later than the first X-ray image. The processing circuitry is configured to superimpose the 3D model on the first X-ray image or the second X-ray image at a position based on the position of the feature point.

## Claims

### Claim 1

An image processing apparatus comprising processing circuitry configured to
determine a position of a feature point of a device in a first X-ray image, and generate a superimposed image in which a 3D model expressing the device is superimposed on any one of the first X-ray image and a second X-ray image that is acquired later than the first X-ray image, wherein
the processing circuitry is configured to superimpose the 3D model on any one of the first X-ray image and the second X-ray image at a position based on the determined position of the feature point.

### Claim 2 (depends on 1)

The image processing apparatus according to claim 1, wherein
the processing circuitry is configured to determine position of a plurality of the feature points in the first X-ray image, and superimpose the 3D model at a position and an orientation based on the determined positions of the feature points.

### Claim 3 (depends on 2)

The image processing apparatus according to claim 2, wherein
the processing circuitry is configured to determine positions of three or more of the feature points in the first X-ray image.

### Claim 4 (depends on 1)

The image processing apparatus according to claim 1, wherein
the processing circuitry is configured to detect the feature point in the first X-ray image, thereby determining the position of the feature point.

### Claim 5 (depends on 4)

The image processing apparatus according to claim 4, wherein
the processing circuitry is configured to detect a marker put on the device in the first X-ray image as the feature point.

### Claim 6 (depends on 5)

The image processing apparatus according to claim 5, wherein
the processing circuitry is configured to detect a marker put on at a distal end of the device in the first X-ray image as the feature point.

### Claim 7 (depends on 6)

The image processing apparatus according to claim 6, wherein
the processing circuitry is further configured to detect a marker that is put on at a middle portion of the device in the first X-ray image as the feature point.

### Claim 8 (depends on 6)

The image processing apparatus according to claim 6, wherein
the device is a stent graft that has at least one of a branch, and
the processing circuitry is further configured to detect a marker put on the branch in the first X-ray image as the feature point.

### Claim 9 (depends on 4)

The image processing apparatus according to claim 4, wherein
the processing circuitry is configured to detect information corresponding to a shape of the device in the first X-ray image as the feature point.

### Claim 10 (depends on 4)

The image processing apparatus according to claim 4, wherein
the processing circuitry is configured to detect information corresponding to a shape of a wire frame of the device in the first X-ray image as the feature point.

### Claim 11 (depends on 1)

The image processing apparatus according to claim 1, wherein
the processing circuitry is further configured to deform the 3D model based on the first X-ray image, and superimpose the 3D model subjected to deformation on any one of the first X-ray image and the second X-ray image.

### Claim 12 (depends on 11)

The image processing apparatus according to claim 11, wherein
the device is a stent that is inserted into a blood vessel of a subject in a state of being housed in a catheter, and
the processing circuitry is configured to acquire an expansion state of the stent out of the catheter based on the first X-ray image, and deform the 3D model according to the expansion state.

### Claim 13 (depends on 11)

The image processing apparatus according to claim 11, wherein
the processing circuitry is configured to acquire a blood vessel shape of a subject in which the device is inserted based on the first X-ray image, and deform the 3D model according to the blood vessel shape.

### Claim 14 (depends on 1)

The image processing apparatus according to claim 1, wherein
the processing circuitry is configured to generate a superimposed image in which the 3D model expressing a shape of the device on any one of the first X-ray image and the second X-ray image.

### Claim 15 (depends on 1)

The image processing apparatus according to claim 1, wherein
the device is a stent graft that has at least one branch, and
the processing circuitry is configured to generate a superimposed image in which the 3D model indicating a position and an orientation of the branch of the stent graft is superimposed on any one of the first X-ray image and the second X-ray image.

### Claim 16 (depends on 1)

The image processing apparatus according to claim 1, wherein
the processing circuitry is configured to determine a position in depth direction of the feature point based on three-dimensional information that indicates arrangement of blood vessels of a subject, and superimpose the 3D model at an enlargement ratio based on the determined position in depth direction.

### Claim 17

An X-ray diagnostic apparatus comprising
a processing circuitry configured to acquire a first X-ray image, determine a position of a feature point of a device in the first X-ray image, and generate a superimposed image in which a 3D model expressing the device is superimposed on any one of the first X-ray image and a second X-ray image that is different from the first X-ray image, wherein
the processing circuitry is configured to superimpose the 3D model on any one of the first X-ray image and the second X-ray image at a position based on the determined position of the feature point.

### Claim 18

An image processing method comprising:
determining a position of a feature point of a device in a first X-ray image; and
generating a superimposed image in which a 3D model expressing the device is superimposed on any one of the first X-ray image and a second X-ray image that is acquired later than the first X-ray image at a position based on the feature point.
