# US 10,499,859 B2 · Image display apparatus, image display method, and storage medium > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,499,859 B2 - Document ID: US10499859B2 - Status: Granted - Kind: B2 - Application number: 15/681,807 - Filed: 2017-08-21 - Published: 2018-03-01 - Granted: 2019-12-10 - Earliest claimed: 2016-08-31 - Assignees: Canon Kabushiki Kaisha - Applicants: Canon Kabushiki Kaisha - Inventors: Yoshio Iizuka; Gakuto Aoyama; Ryo Ishikawa - Web page: https://patentgrep.com/patent/US10499859B2 ## CPC - A61B 6/035: {Mechanical aspects of CT} - A61B 5/0033: {Features or image-related aspects of imaging apparatus, e.g. for MRI, optical tomography or impedance tomography apparatus; Arrangements of imaging apparatus in a room} - A61B 5/0035: {adapted for acquisition of images from more than one imaging mode, e.g. combining MRI and optical tomography} - A61B 5/0073: {by tomography, i.e. reconstruction of 3D images from 2D projections (A61B5/0066 takes precedence)} - A61B 5/7425: {Displaying combinations of multiple images regardless of image source, e.g. displaying a reference anatomical image with a live image} - A61B 6/032: {Transmission computed tomography [CT]} - A61B 6/463: {characterised by displaying multiple images or images and diagnostic data on one display} - A61B 6/466: {adapted to display 3D data} - A61B 6/486: {involving generating temporal series of image data} - A61B 6/5235: {combining images from the same or different ionising radiation imaging techniques, e.g. PET and CT} - A61B 6/467: {characterised by special input means} - A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D) ## Abstract An image display apparatus includes a selection unit configured to select as a display image a second tomographic image in the case where a second acquisition unit successfully acquires the second tomographic image or in the case where a correspondence relationship between a first tomographic image and the second tomographic image satisfies a predetermined condition, or select a notification image in a case other than the above-described cases, and a display unit configured to display the first tomographic image and the display image selected by the selection unit in parallel or in a superimposed manner. ## Claims ### Claim 1 An image display apparatus comprising: a first acquisition unit configured to acquire a first tomographic image from a first three-dimensional image including a plurality of tomographic images; a second acquisition unit configured to acquire a second tomographic image at a cross-sectional position corresponding to the first tomographic image from a processed image obtained by performing image processing on the first three-dimensional image and a second three-dimensional image; a third acquisition unit configured to acquire a notification image for notifying that the second acquisition unit is unsuccessful in acquiring the second tomographic image or that a correspondence relationship between the first tomographic image and the second tomographic image does not satisfy a predetermined condition; a selection unit configured to select the second tomographic image as a display image in a case where the second acquisition unit successfully acquires the second tomographic image or in a case where the correspondence relationship between the first tomographic image and the second tomographic image satisfies the predetermined condition, or select the notification image as a display image in a case where the second acquisition unit unsuccessfully acquires the second tomographic image or in a case where the correspondence relationship does not satisfy the predetermined condition; and a display unit configured to display the first tomographic image and the display image selected by the selection unit in parallel or in a superimposed manner. ### Claim 2 (depends on 1) The image display apparatus according to claim 1, wherein the predetermined condition is a condition that a difference between a cross-sectional position of the first tomographic image and a cross-sectional position of the second tomographic image is smaller than or equal to a threshold value, and the selection unit selects the second tomographic image as a display image if the predetermined condition is satisfied, and the selection unit selects the notification image as a display image if the predetermined condition is not satisfied. ### Claim 3 (depends on 1) The image display apparatus according to claim 1, wherein the predetermined condition is a condition that a difference between a cross-sectional position of the first tomographic image and a cross-sectional position of the second tomographic image is smaller than or equal to a threshold value, and the selection unit selects the second tomographic image as a display image if the predetermined condition is satisfied, or the selection unit selects a combined image of the second tomographic image and the notification image as a display image if the predetermined condition is not satisfied. ### Claim 4 (depends on 3) The image display apparatus according to claim 3, wherein the selection unit sets, based on the difference, a combining ratio between the second tomographic image and the notification image in generating the combined image. ### Claim 5 An image display method comprising: acquiring a first tomographic image from a first three-dimensional image including a plurality of tomographic images; acquiring a second tomographic image at a cross-sectional position corresponding to the first tomographic image from a processed image obtained by performing image processing on the first three-dimensional image and a second three-dimensional image; acquiring a notification image for notifying that the second tomographic image is unsuccessfully acquired or that a correspondence relationship between the first tomographic image and the second tomographic image does not satisfy a predetermined condition; selecting the second tomographic image as a display image in a case where the second tomographic image is successfully acquired or in a case where the correspondence relationship between the first tomographic image and the second tomographic image satisfies the predetermined condition, or selecting the notification image as a display image in a case where the second tomographic image is unsuccessfully acquired or in a case where the correspondence relationship does not satisfy the predetermined condition; and displaying the first tomographic image and the selected display image in parallel or in a superimposed manner. ### Claim 6 A non-transitory storage medium storing a program for causing a computer to execute: acquiring a first tomographic image from a first three-dimensional image including a plurality of tomographic images; acquiring a second tomographic image at a cross-sectional position corresponding to the first tomographic image from a processed image obtained by performing image processing on the first three-dimensional image and a second three-dimensional image; acquiring a notification image for notifying that the second tomographic image is unsuccessfully acquired or that a correspondence relationship between the first tomographic image and the second tomographic image does not satisfy a predetermined condition; selecting the second tomographic image as a display image in a case where the second tomographic image is successfully acquired or in a case where the correspondence relationship between the first tomographic image and the second tomographic image satisfies the predetermined condition, or selecting the notification image as a display image in a case where the second tomographic image is unsuccessfully acquired or in a case where the correspondence relationship does not satisfy the predetermined condition; and displaying the first tomographic image and the selected display image such that the first tomographic image and the selected display image are displayed next to each other or superimposed. ### Claim 7 An image processing apparatus, comprising: a first acquisition unit configured to acquire a first tomographic image from a first three-dimensional image including a plurality of tomographic images; a second acquisition unit configured to acquire a second tomographic image at a cross-sectional position corresponding to the first tomographic image from a processed image obtained by performing image processing on the first three-dimensional image and a second three-dimensional image; a third acquisition unit configured to acquire a notification image for notifying that the second acquisition unit does not acquire the second tomographic image or that a correspondence relationship between the first tomographic image and the second tomographic image does not satisfy a predetermined condition; a selection unit configured to select the second tomographic image as a display image in a case where the second acquisition unit successfully acquires the second tomographic image or in a case where the correspondence relationship between the first tomographic image and the second tomographic image satisfies the predetermined condition, or select the notification image as a display image in a case where the second acquisition unit does not acquire the second tomographic image or in a case where the correspondence relationship does not satisfy the predetermined condition; and a display control unit configured to display, on a display screen, the first tomographic image and the display image selected by the selection unit in parallel or in a superimposed manner. ### Claim 8 (depends on 7) The image processing apparatus according to claim 7, wherein the predetermined condition is a condition that a difference between a cross-sectional position of the first tomographic image and a cross-sectional position of the second tomographic image is smaller than or equal to a threshold value, and the selection unit selects the second tomographic image as a display image if the predetermined condition is satisfied, and the selection unit selects the notification image as a display image if the predetermined condition is not satisfied. ### Claim 9 (depends on 7) The image processing apparatus according to claim 7, wherein the predetermined condition is a condition that a difference between a cross-sectional position of the first tomographic image and a cross-sectional position of the second tomographic image is smaller than or equal to a threshold value, and the selection unit selects the second tomographic image as a display image if the predetermined condition is satisfied, or the selection unit selects a combined image of the second tomographic image and the notification image as a display image if the predetermined condition is not satisfied. ### Claim 10 (depends on 9) The image processing apparatus according to claim 9, wherein the selection unit sets, based on the difference, a combining ratio between the second tomographic image and the notification image in generating the combined image.