# US 2018/0025548 A1 · Image processing apparatus, image processing method, and, non-transitory computer readable medium > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2018/0025548 A1 - Document ID: US20180025548A1 - Status: Published application - Kind: A1 - Application number: 15/648,898 - Filed: 2017-07-13 - Published: 2018-01-25 - Earliest claimed: 2016-07-19 - Assignees: Canon Kabushiki Kaisha - Applicants: Canon Kabushiki Kaisha - Inventors: Takaaki Endo; Kiyohide Satoh - Web page: https://patentgrep.com/patent/US20180025548A1 ## CPC - G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts - G06T 7/0012: {Biomedical image inspection} - G06T 7/149: involving deformable models, e.g. active contour models - G06T 7/33: using feature-based methods - G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80) - G06T 2207/10081: Computed x-ray tomography [CT] - G06T 2207/10088: Magnetic resonance imaging [MRI] - G06T 2207/10101: Optical tomography; Optical coherence tomography [OCT] - G06T 2207/10104: Positron emission tomography [PET] - G06T 2207/10108: Single photon emission computed tomography [SPECT] - G06T 2207/10136: 3D ultrasound image - G06T 2207/20101: Interactive definition of point of interest, landmark or seed - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract An image processing apparatus of the present invention includes an image obtaining unit obtaining first and second three-dimensional images, a deformation information obtaining unit obtaining deformation between two images, a cross-sectional image generating unit generating first and second cross-sectional images, a target position obtaining unit obtaining a target position in the first cross-sectional image, a corresponding position obtaining unit obtaining a corresponding position in the second three-dimensional image which corresponds to the target position on the basis of the deformation information. ## Claims ### Claim 1 An image processing apparatus, comprising: an image obtaining unit configured to obtain a first three-dimensional image and a second three-dimensional image different from the first three-dimensional image; a deformation information obtaining unit configured to obtain deformation information representing deformation between the first and second three-dimensional images; a cross-sectional image generating unit configured to generate a first cross-sectional image from the first three-dimensional image and generates a second cross-sectional image from the second three-dimensional image; a target position obtaining unit configured to obtain a target position in the first cross-sectional image; a corresponding position obtaining unit configured to obtain, on the basis of the deformation information, a corresponding position in the second three-dimensional image which corresponds to the target position; and a display controlling unit configured to control display of the first and second cross-sectional images on a displaying unit, wherein the cross-sectional image generating unit is configured to generate a cross-sectional image including the corresponding position as the second cross-sectional image. ### Claim 2 (depends on 1) The image processing apparatus according to claim 1, wherein the display controlling unit is configured to display the first and second cross-sectional images such that, on a screen of the displaying unit, the target position in the first cross-sectional image coincides with the corresponding position in the second cross-sectional image in a vertical or lateral direction. ### Claim 3 (depends on 1) The image processing apparatus according to claim 1, wherein the cross-sectional image generating unit is configured to generate, as the second cross-sectional image, an orthogonal cross-sectional image and an arbitrary cross-sectional image in an arbitrary cross section corresponding to the first cross-sectional image, and the display controlling unit is configured to simultaneously display the orthogonal cross-sectional image and the arbitrary cross-sectional image or switch between the orthogonal cross-sectional image and the arbitrary cross-sectional image. ### Claim 4 (depends on 1) The image processing apparatus according to claim 1, wherein the cross-sectional image generating unit is configured to generate, as the second cross-sectional image, an orthogonal cross-sectional image and generates, as a third cross-sectional image, an arbitrary cross-sectional image in an arbitrary cross section including the target position and corresponding to the orthogonal cross-sectional image from the first three-dimensional image, and the display controlling unit is configured to display the third and second cross-sectional images. ### Claim 5 (depends on 3) The image processing apparatus according to claim 3, wherein the arbitrary cross-sectional image is an image in a curved cross section along the arbitrary cross section or an image in a cross section obtained by approximating the arbitrary cross section with a plane. ### Claim 6 (depends on 1) The image processing apparatus according to claim 1, further comprising an operation unit configured to receive an input from a user. ### Claim 7 (depends on 6) The image processing apparatus according to claim 6, wherein the operation unit is configured to receive an input of the target position. ### Claim 8 (depends on 6) The image processing apparatus according to claim 6, wherein the display controlling unit is configured to switch between a plurality of display modes which are different in the number and combination of images simultaneously displayed on the displaying unit, on the basis of information input from the operation unit. ### Claim 9 (depends on 1) The image processing apparatus according to claim 1, further comprising a deformed image generating unit configured to generate a first deformed image by deforming the first three-dimensional image in accordance with the second three-dimensional image on the basis of the deformation information and generates a second deformed image by deforming the second three-dimensional image in accordance with the first three-dimensional image on the basis of the deformation information, wherein the display controlling unit is configured to control display of the first and second three-dimensional images and the first and second deformed images on the displaying unit. ### Claim 10 (depends on 1) The image processing apparatus according to claim 1, wherein the first and second three-dimensional images are different in at least imaging modality or imaging time. ### Claim 11 An image processing apparatus, comprising: an image obtaining unit configured to obtain a first three-dimensional image and a second three-dimensional image different from the first three-dimensional image; a corresponding position obtaining unit configured to obtain information on respective sets of points in the first and second three-dimensional images which correspond to each other; a cross-sectional image generating unit configured to generate a first cross-sectional image from the first three-dimensional image and generates a second cross-sectional image from the second three-dimensional image; a target position obtaining unit configured to obtain one of the set of points in the first three-dimensional image as a target position; a corresponding position obtaining unit configured to obtain a corresponding position in the second three-dimensional image which corresponds to the target position on the basis of the information on the sets of points; and a display controlling unit configured to control display of the first and second cross-sectional images on a displaying unit, wherein the cross-sectional image generating unit is configured to generate a cross-sectional image including the target position as the first cross-sectional image and generates a cross-sectional image including the corresponding position as the second cross-sectional image, and the display controlling unit is configured to adjust a position of the second cross-sectional image such that, on a screen of the displaying unit, the corresponding position after the adjustment coincides with the target position before the adjustment in a vertical or lateral direction and displays the first and second cross-sectional images. ### Claim 12 An image processing method, comprising: an image obtaining step of obtaining a first three-dimensional image and a second three-dimensional image different from the first three-dimensional image; a deformation information obtaining step of obtaining deformation information representing deformation between the first and second three-dimensional images; a cross-sectional image generating step of generating a first cross-sectional image from the first three-dimensional image and generating a second cross-sectional image from the second three-dimensional image; a target position obtaining step of obtaining a target position in the first cross-sectional image; a corresponding position obtaining step of obtaining a corresponding position in the second three-dimensional image which corresponds to the target position on the basis of the deformation information; and a display controlling step of controlling display of the first and second cross-sectional images on a displaying unit, wherein in the cross-sectional image generating step, a cross-sectional image including the corresponding position is generated as the second cross-sectional image. ### Claim 13 An image processing method, comprising: an image obtaining step of obtaining a first three-dimensional image and a second three-dimensional image different from the first three-dimensional image; a corresponding position obtaining step of obtaining information on respective sets of points in the first and second three-dimensional images which correspond to each other; a cross-sectional image generating step of generating a first cross-sectional image from the first three-dimensional image and generating a second cross-sectional image from the second three-dimensional image; a target position obtaining step of obtaining one of the set of points in the first three-dimensional image as a target position; a corresponding position obtaining step of obtaining a corresponding position in the second three-dimensional image which corresponds to the target position on the basis of the information on the sets of points; and a display controlling step of controlling display of the first and second cross-sectional images on a displaying unit, wherein in the cross-sectional image generating step, a cross-sectional image including the target position is generated as the first cross-sectional image and a cross-sectional image including the corresponding position is generated as the second cross-sectional image, and in the display controlling step, a position of the second cross-sectional image is adjusted such that, on a screen of the displaying unit, the corresponding position after the adjustment coincides with the target position before the adjustment in a vertical or lateral direction, and the first and second cross-sectional images are displayed. ### Claim 14 A non-transitory computer readable medium storing a program causing a computer to execute an image processing method, the image processing method comprising: an image obtaining step of obtaining a first three-dimensional image and a second three-dimensional image different from the first three-dimensional image; a deformation information obtaining step of obtaining deformation information representing deformation between the first and second three-dimensional images; a cross-sectional image generating step of generating a first cross-sectional image from the first three-dimensional image and generating a second cross-sectional image from the second three-dimensional image; a target position obtaining step of obtaining a target position in the first cross-sectional image; a corresponding position obtaining step of obtaining a corresponding position in the second three-dimensional image which corresponds to the target position on the basis of the deformation information; and a display controlling step of controlling display of the first and second cross-sectional images on a displaying unit, wherein in the cross-sectional image generating step, a cross-sectional image including the corresponding position is generated as the second cross-sectional image. ### Claim 15 A non-transitory computer readable medium storing a program causing a computer to execute an image processing method, the image processing method comprising: an image obtaining step of obtaining a first three-dimensional image and a second three-dimensional image different from the first three-dimensional image; a corresponding position obtaining step of obtaining information on respective sets of points in the first and second three-dimensional images which correspond to each other; a cross-sectional image generating step of generating a first cross-sectional image from the first three-dimensional image and generating a second cross-sectional image from the second three-dimensional image; a target position obtaining step of obtaining one of the set of points in the first three-dimensional image as a target position; a corresponding position obtaining step of obtaining a corresponding position in the second three-dimensional image which corresponds to the target position on the basis of the information on the sets of points; and a display controlling step of controlling display of the first and second cross-sectional images on a displaying unit, wherein in the cross-sectional image generating step, a cross-sectional image including the target position is generated as the first cross-sectional image and a cross-sectional image including the corresponding position is generated as the second cross-sectional image, and in the display controlling step, a position of the second cross-sectional image is adjusted such that, on a screen of the displaying unit, the corresponding position after the adjustment coincides with the target position before the adjustment in a vertical or lateral direction, and the first and second cross-sectional images are displayed.