# US 2012/0253173 A1 · Image processing apparatus, ultrasonic photographing system, image processing method therefor, and storage medium storing program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2012/0253173 A1
- Document ID: US20120253173A1
- Status: Published application
- Kind: A1
- Application number: 13/432,205
- Filed: 2012-03-28
- Published: 2012-10-04
- Earliest claimed: 2011-04-01
- Assignees: Canon Kabushiki Kaisha
- Inventors: Takaaki Endo; Kiyohide Satoh
- Web page: https://patentgrep.com/patent/US20120253173A1

## CPC

- G06T 19/00: Manipulating three-dimensional [3D] models or images for computer graphics
- G06T 12/30: Image post-processing, e.g. metal artefact correction
- G06T 2210/41: Medical
- G06T 2219/008: Cut plane or projection plane definition
- G06T 2219/2021: Shape modification
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

An image processing apparatus includes an ultrasonic image obtaining unit configured to obtain an ultrasonic image by capturing a subject by ultrasound, a generation unit configured to generate a corresponding cross-sectional surface which corresponds to an image capturing cross-sectional surface of the ultrasonic image, which is parallel to a reference direction, and which includes a position specified in advance from a three-dimensional image of the subject, and a cross-sectional image obtaining unit configured to obtain a cross-sectional image of the three-dimensional image from the generated corresponding cross-sectional surface.

## Claims

### Claim 1

An image processing apparatus comprising:
an ultrasonic image obtaining unit configured to obtain an ultrasonic image by capturing a subject by ultrasound;
a generation unit configured to generate a corresponding cross-sectional surface which corresponds to an image capturing cross-sectional surface of the ultrasonic image, which is substantially parallel to a reference direction, and which includes a target position specified in advance from a three-dimensional image of the subject; and
a cross-sectional image obtaining unit configured to obtain a cross-sectional image of the three-dimensional image from the generated corresponding cross-sectional surface.

### Claim 2 (depends on 1)

The image processing apparatus according to claim 1,
wherein the generation unit is arranged to newly generate a corresponding cross-sectional surface in accordance with a change of the image capturing cross-sectional surface by rotating the corresponding cross-sectional surface in accordance with a rotation of the image capturing cross-sectional surface relative to an axis extending in the reference direction.

### Claim 3 (depends on 1)

The image processing apparatus according to claim 1,
wherein the generation unit is arranged to newly generate a corresponding cross-sectional surface in accordance with a change of the image capturing cross-sectional surface by rotating the corresponding cross-sectional surface in accordance with a rotation of the image capturing cross-sectional surface relative to an axis extending in the reference direction, the corresponding cross-sectional surface newly generated being not rotated in accordance with a movement of inclination of the image capturing cross-sectional surface relative to the reference direction.

### Claim 4 (depends on 1)

The image processing apparatus according to claim 1,
wherein the generation unit is arranged to generate the corresponding cross-sectional surface which is substantially parallel to the reference direction, which includes the target position specified in advance, and which has a line which intersects with the image capturing cross-sectional surface of the ultrasonic image and which is substantially orthogonal to the reference direction.

### Claim 5 (depends on 1)

The image processing apparatus according to claim 1,
wherein the generation unit is arranged to determine whether the corresponding cross-sectional surface is to be generated in accordance with an angle defined by the reference direction and the captured ultrasonic image.

### Claim 6 (depends on 5)

The image processing apparatus according to claim 5,
wherein the generation means is arranged to generate the corresponding cross-sectional surface when the angle defined by the reference direction and the obtained ultrasonic image is equal to or smaller than a threshold value whereas the generation means is arranged not to generate the corresponding cross-sectional surface when the angle is larger than the threshold value.

### Claim 7 (depends on 6)

The image processing apparatus according to claim 6,
wherein the generation unit is arranged to generate, when the corresponding cross-sectional surface is not to be generated, another corresponding cross-sectional surface which is substantially parallel to a plane including the ultrasonic image and which includes a target position specified in advance, and
the cross-sectional image obtaining unit is arranged to obtain a cross-sectional image of the other corresponding cross-sectional surface from the three-dimensional image of the subject.

### Claim 8 (depends on 1)

The image processing apparatus according to claim 1, further comprising:
a display controller configured to display the ultrasonic image and the cross-sectional image.

### Claim 9 (depends on 8)

The image processing apparatus according to claim 8,
wherein the display controller is arranged to change a cross-sectional image to be displayed in accordance with an angle defined by the reference direction and the ultrasonic image.

### Claim 10 (depends on 8)

The image processing apparatus according to claim 8, further comprising:
a display controller configured to display a first MRI cross-sectional image of another corresponding cross-sectional surface which is a three-dimensional MRI image obtained by converting a three-dimensional MRI image of a prone posture into a three-dimensional MRI image of a supine posture, which is substantially parallel to the ultrasonic image, and which includes a target position specified in advance and display a second MRI cross-sectional image of the generated corresponding cross-sectional surface in an aligned manner.

### Claim 11 (depends on 1)

The image processing apparatus according to claim 1, further comprising:
a setting unit configured to set the reference direction in accordance with a body posture of the subject obtained when a three-dimensional image of the subject is photographed.

### Claim 12 (depends on 1)

The image processing apparatus according to claim 1,
wherein the cross-sectional image is obtained by photographing the subject in a prone posture and the ultrasonic image is obtained by photographing the subject in a posture other than the prone posture.

### Claim 13 (depends on 1)

The image processing apparatus according to claim 1, further comprising:
a specifying unit configured to specify an arbitrary position in the ultrasonic image.

### Claim 14 (depends on 13)

The image processing apparatus according to claim 13, further comprising:
a display controller configured to display the obtained cross-sectional image in accordance with the specifying performed by the specifying unit.

### Claim 15

An image processing apparatus comprising:
a three-dimensional image obtaining unit configured to obtain a prone-posture three-dimensional image by photographing a subject in a prone posture using a three-dimensional photographing apparatus and obtain a supine-posture three-dimensional image by deforming the prone-posture three-dimensional image;
an ultrasonic image obtaining unit configured to successively obtain two-dimensional ultrasonic images obtained by photographing a subject in a supine posture using an ultrasonic photographing apparatus;
a generation unit configured to generate, in accordance with an image capturing cross-sectional surface of an obtained two-dimensional ultrasonic image: a first cross-sectional surface of the supine-posture three-dimensional image which includes a target position, specified in advance using the prone-posture three-dimensional image, and which is substantially parallel to the image capturing cross-sectional surface of the two-dimensional ultrasonic image; and a second cross-sectional surface of the prone-posture three-dimensional image obtained by replacing an angle defined by a reference direction and the first cross-sectional surface by approximately 0 degrees;
a cross-sectional image obtaining unit configured to obtain from the supine-posture three-dimensional image a first cross-sectional image associated with the first cross-sectional surface and to obtain from the prone-posture three-dimensional image a second cross-sectional image associated with the second cross-sectional surface; and
a display controller configured to display the ultrasonic image, the first cross-sectional image, and the second cross-sectional image in an aligned manner.

### Claim 16 (depends on 1)

The image processing apparatus according to claim 1,
wherein the reference direction corresponds to a direction of gravitational force.

### Claim 17 (depends on 1)

The image processing apparatus according to claim 1,
wherein the target position specified in advance is one of a position of a lesion, a position of a region representing a scar and a region representing a hematoma.

### Claim 18 (depends on 1)

An ultrasonic photographing system comprising:
the image processing apparatus according to claim 1;
a display unit configured to display the ultrasonic image and the cross-sectional image; and
an ultrasonic unit configured to obtain the ultrasonic image by photographing the subject.

### Claim 19

An image processing method comprising:
obtaining an ultrasonic image by capturing a subject by ultrasound;
generating a corresponding cross-sectional surface which corresponds to an image capturing cross-sectional surface of the ultrasonic image, which is substantially parallel to a reference direction, and which includes a target position specified in advance from a three-dimensional image of the subject; and
obtaining a cross-sectional image of the three-dimensional image from the generated corresponding cross-sectional surface.

### Claim 20

An image processing method comprising:
obtaining a prone-posture three-dimensional image by photographing a subject in a prone posture using a three-dimensional photographing apparatus and obtaining a supine-posture three-dimensional image by deforming the prone-posture three-dimensional image;
successively obtaining two-dimensional ultrasonic images obtained by photographing a subject in a supine posture using an ultrasonic photographing apparatus;
generating, in accordance with an image capturing cross-sectional surface of an obtained two-dimensional ultrasonic image: a first cross-sectional surface of the supine-posture three-dimensional image which includes a target position, specified in advance using the prone-posture three-dimensional image, and which is substantially parallel to the image capturing cross-sectional surface of the two-dimensional ultrasonic image; and a second cross-sectional surface of the prone-posture three-dimensional image obtained by replacing an angle defined by a reference direction and the first cross-sectional surface by approximately 0 degrees;
obtaining from the supine-posture three-dimensional image a first cross-sectional image associated with the first cross-sectional surface and obtaining from the prone-posture three-dimensional image a second cross-sectional image associated with the second cross-sectional surface; and
displaying the ultrasonic image, the first cross-sectional image, and the second cross-sectional image in an aligned manner.

### Claim 21 (depends on 20)

A computer-readable medium storing thereon a computer-executable program which, when executed by a computer in an image processing apparatus, causes the image processing apparatus to carry out the method of claim 20.

### Claim 22 (depends on 1)

A computer-readable medium storing thereon a computer-executable program which, when loaded into a computer, causes the computer to control the image processing apparatus according to claim 1.
