# US 2019/0378314 A1 · Image display system, image display method, and program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0378314 A1
- Document ID: US20190378314A1
- Status: Published application
- Kind: A1
- Application number: 16/331,837
- Filed: 2017-10-03
- Published: 2019-12-12
- Earliest claimed: 2016-10-07
- Assignees: Canon Kabushiki Kaisha
- Applicants: Canon Kabushiki Kaisha
- Inventors: Kohtaro Umezawa; Mitsuhiro Shingu; Kazuhito Oka
- Web page: https://patentgrep.com/patent/US20190378314A1

## CPC

- A61B 8/4416: {related to combined acquisition of different diagnostic modalities, e.g. combination of ultrasound and X-ray acquisitions}
- A61B 5/0035: {adapted for acquisition of images from more than one imaging mode, e.g. combining MRI and optical tomography}
- A61B 5/14542: {for measuring blood gases (A61B5/14551 takes precedence)}
- A61B 5/7425: {Displaying combinations of multiple images regardless of image source, e.g. displaying a reference anatomical image with a live image}
- G06T 11/10: Texturing; Colouring; Generation of textures or colours (retouching, inpainting or scratch removal G06T5/77)
- G06T 11/60: Creating or editing images; Combining images with text
- G16H 30/20: for handling medical images, e.g. DICOM, HL7 or PACS
- G16H 30/40: for processing medical images, e.g. editing
- A61B 5/0095: {by applying light and detecting acoustic waves, i.e. photoacoustic measurements}
- A61B 5/1455: using optical sensors, e.g. spectral photometrical oximeters
- A61B 5/14551: {for measuring blood gases}
- A61B 5/7264: {Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems}
- A61B 5/7278: {Artificial waveform generation or derivation, e.g. synthesizing signals from measured signals}
- A61B 8/463: {characterised by displaying multiple images or images and diagnostic data on one display}
- G06T 2210/41: Medical
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA

## Abstract

The present invention provides an image display system which can simplify an operation of an operator for displaying images appropriate for diagnosis. An image display system according to the present invention includes a first obtaining unit configured to obtain first image data piece, a second obtaining unit configured to obtain a first meta-information piece regarding the first image data piece, a third obtaining unit configured to obtain a second image data piece, a fourth obtaining unit configured to obtain a second meta-information piece regarding the second image data piece, and a display control unit configured to determine a superimposition style corresponding to a combination of the first and second meta-information pieces based on the first and second meta-information pieces and display a superimposition image of the first and second image data pieces in the superimposition style on a display unit.

## Claims

### Claim 1

An image display system comprising:
a first obtaining unit configured to obtain first image data piece;
a second obtaining unit configured to obtain a first meta-information piece regarding the first image data piece;
a third obtaining unit configured to obtain a second image data piece;
a fourth obtaining unit configured to obtain a second meta-information piece regarding the second image data piece; and
a display control unit configured to determine a superimposition style corresponding to a combination of the first and second meta-information pieces based on the first and second meta-information pieces; and display a superimposition image of the first and second image data pieces in the superimposition style on a display unit.

### Claim 2 (depends on 1)

The image display system according to claim 1,
wherein the first meta-information piece includes information representing an image type of the first image data piece;
wherein the second meta-information piece includes information representing an image type of the second image data piece;
wherein the display control unit determines the superimposition style corresponding to a combination of image types of the first and second image data pieces.

### Claim 3 (depends on 1)

The image display system according to claim 1, wherein the display control unit determines color schemes of the first and second image data pieces as the superimposition style based on the first and second meta-information pieces and displays the superimposition image of the first and second image data piece in the color schemes on the display unit.

### Claim 4 (depends on 1)

The image display system according to claim 1, wherein the display control unit determines superimposed order of the first and second image data pieces as the superimposition style based on the first and second meta-information pieces and displays the superimposition image as a result of superimposition of the first and second image data pieces in the superimposed order on the display unit.

### Claim 5 (depends on 1)

The image display system according to claim 1, wherein the display control unit
determines a display layout of an image of at least one image data piece of the first and second image data piece and the superimposition image based on the first and second meta-information pieces; and
displays the image of the at least one image data piece of the first and second image data piece and the superimposition image side by side in the display layout on the display unit.

### Claim 6 (depends on 1)

The image display system according to claim 1, further comprising:
a third obtaining unit configured to obtain information representing a relationship between a combination of meta-information pieces and a superimposition style,
wherein the display control unit determines the superimposition style corresponding to a combination of the first and second meta-information pieces with reference to the information representing the relationship.

### Claim 7 (depends on 1)

The image display system according to claim 1, wherein the display control unit determines whether the first and second image data pieces are appropriate to be superimposed or not based on the first and second meta-information pieces and displays the determination result on the display unit.

### Claim 8 (depends on 1)

The image display system according to claim 1, wherein the first obtaining unit reads out the first and second image data pieces saved in a picture archiving and communication system to obtain the first and second image data pieces.

### Claim 9 (depends on 1)

The image display system according to claim 1, wherein the first obtaining unit obtains the first and second image data pieces determined based on a user's instruction.

### Claim 10 (depends on 1)

The image display system according to claim 1, wherein the first and second meta-information pieces are information regarding image types store in data files generated based on a DICOM format.

### Claim 11 (depends on 1)

The image display system according to claim 1, wherein the display mode includes at least one of a color scheme of the superimposition image, superimposing order, a transmittance of the image, and a luminance range.

### Claim 12 (depends on 1)

The image display system according to claim 1, wherein the first and second image data pieces are medical image data pieces obtained from modalities different from each other.

### Claim at position 13

13-15. (canceled)

### Claim 16

An image display system comprising:
a first obtaining unit configured to obtain a plurality of image data pieces; and
a display control unit configured to display icons representing the plurality of image data pieces on a display unit,
wherein the display control unit displays the icons on the display unit such that a combination of image data pieces appropriate to be superimpose from the plurality of image data pieces based on the meta-information pieces regarding the plurality of image data pieces can be identified.

### Claim 17 (depends on 16)

The image display system according to claim 16, wherein the display control unit displays on the display unit a combination of image data pieces appropriate to be superimposed from the plurality of image data pieces based on information representing image type regarding the plurality of image data pieces as the meta-information pieces such that the combination can be identified.

### Claim 18

An image display method comprising:
obtaining first image data piece;
obtaining a first meta-information piece regarding the first image data piece;
obtaining a second image data piece;
obtaining a second meta-information piece regarding the second image data piece;
determining a superimposition style corresponding to a combination of the first and second meta-information pieces based on the first and second meta-information pieces; and
displaying a superimposition image of the first and second image data pieces in the superimposition style on a display unit.

### Claim at position 17

19-20. (canceled)

### Claim 21

An image display method comprising:
obtaining a plurality of image data pieces;
obtaining a plurality of meta-information pieces regarding the plurality of image data pieces;
determining a superimposition style corresponding to a combination of the plurality of meta-information pieces based on the plurality of meta-information pieces; and
displaying a superimposition image of the plurality of image data pieces in the superimposition style on a display unit.

### Claim 22

(canceled)

### Claim 23 (depends on 18)

A non-transitory computer-readable storage medium which stores a program causing a computer to execute the image display method according to claim 18.

### Claim 24 (depends on 21)

A non-transitory computer-readable storage medium which stores a program causing a computer to execute the image display method according to claim 21.
