# US 8,280,483 B2 · Multi-modality medical image viewing

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 8,280,483 B2
- Document ID: US8280483B2
- Status: Granted
- Kind: B2
- Application number: 11/424,147
- Filed: 2006-06-14
- Published: 2008-01-10
- Granted: 2012-10-02
- Earliest claimed: 2006-06-14
- Assignees: Koninklijke Philips Electronics N.V.
- Inventors: Yang-Ming Zhu; Xiangyu Wu; Charles A. Nortmann; Ronald W. Sukalac; Steven M. Cochoff; L. Alan Love; Richard Cheng-Hsiu Chen; Chris A. Dauterman; Madhavi Ahuja; Dawn M. Maniawski
- Web page: https://patentgrep.com/patent/US8280483B2

## CPC

- G16H 30/40: for processing medical images, e.g. editing
- A61B 5/05: Detecting, measuring or recording for diagnosis by means of electric currents or magnetic fields; Measuring using microwaves or radio waves (measuring movement of the entire body or parts thereof A61B5/11; detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof A61B5/24)
- G16H 30/00: ICT specially adapted for the handling or processing of medical images (computed tomography A61B6/03)
- G16H 30/20: for handling medical images, e.g. DICOM, HL7 or PACS
- G16H 40/63: for local operation
- G16Z 99/00: Subject matter not provided for in other main groups of this subclass
- A61B 6/463: {characterised by displaying multiple images or images and diagnostic data on one display}
- G06F 16/957: Browsing optimisation, e.g. caching or content distillation
- G06F 16/9577: {Optimising the visualization of content, e.g. distillation of HTML documents}
- G06T 2200/24: involving graphical user interfaces [GUIs]
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G16Z: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS, NOT OTHERWISE PROVIDED FOR
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A medical imaging system (10) comprises one or more displays (66). A viewer device (86) generates an interactive user interface screen (80) on the display (66), which viewer device (86) enables a user to simultaneously inspect selected image data of multiple patients or multiple images.

## Claims

### Claim 1

A medical imaging system comprising:
one or more displays;
a viewer device for generating an interactive user interface screen on the display, which viewer device enables a user to simultaneously inspect selected image data of multiple patients or multiple images;
a registration device which identifies a global reference image in the selected image data, and determines a registration matrix which aligns an image with the global reference image; and
a group registration device which registers or aligns images of the selected groups and is programmed to perform steps of:
selecting a reference image in a first group;
selecting a reference image in a second group;
computing registration between the images of the first and second groups as
Mr1r2=Mr1−1Mr2,
where Mr1r2 is the registration between the images of the first and second groups,
Mr1 is a registration of the selected first group reference image with respect to the global reference image, and
Mr2 is the registration of the selected second group reference image with respect to the global reference image.

### Claim 2 (depends on 1)

The system as set forth in claim 1, wherein the viewer device includes:
a patient viewer manager which launches each patient for viewing in a preselected order; and
a patient viewing component which displays image data of each patient.

### Claim 3 (depends on 1)

The system as set forth in claim 1, wherein a patient viewing component displays image data of multiple patients for direct side by side comparison on one of a single display or the displays.

### Claim 4 (depends on 1)

The system as set forth in claim 1, further including:
a layout device which automatically selects a layout for display of the images based at least on the selected image data and user preferences.

### Claim 5 (depends on 1)

The system as set forth in claim 1, further including:
a comparator which compares selected viewing groups of images.

### Claim 6 (depends on 1)

The system as set forth in claim 1, wherein the group registration device is programmed to perform steps of:
identifying at least a first point in a first group image;
determining coordinates of the first point;
identifying at least a second point in a second group image;
determining coordinates of the second point; and
computing a registration relation between the first and second points.

### Claim 7 (depends on 1)

The system as set forth in claim 1, wherein the images are generated by scanners which include at least one of: PET, SPECT, MRI, ultrasound, fluoroscopy, CT, and digital x-ray.

### Claim 8

A method of medical imaging comprising:
generating an interactive user interface screen on a display;
simultaneously inspecting selected image data of multiple patients or multiple images on the display;
identifying a global reference image in the selected image data;
determining a registration matrix which aligns a registering image with the global reference image;
comparing a frame of reference of remaining images to a frame of reference of the global reference image; and
propagating the registration matrix to the images whose frames of reference coincide with the frame of reference of the registering image.

### Claim 9 (depends on 8)

A non-transitory computer readable memory carrying software which is run on one or more processors to perform the method as set forth in claim 8.

### Claim 10 (depends on 8)

A medical imaging system including:
at least one display;
one or more processors programmed to perform the method as set forth in claim 8.

### Claim 11

A medical imaging method comprising:
generating an interactive user interface screen on a display;
simultaneously inspecting selected image data of multiple patients or multiple images on the display;
identifying a global reference image;
defining a relationship between each image and the global reference image via a registration matrix, the registration matrix being an identity matrix;
determining a registration relation between first and second images from a registration relationship between the first image and the global reference image, and a registration relationship between the second image and the global reference image; and
aligning the first and second images to the selected global reference image.

### Claim 12 (depends on 11)

The method as set forth in claim 11, further including:
comparing a frame of reference of each image to the frame of reference of the global reference image; and
based on the comparison, propagating the registration matrix to the images whose frames of reference coincide with the frame of reference of the image.

### Claim 13 (depends on 11)

The method as set forth in claim 11, wherein determining the registration relation between the first and second images is calculated as
Mr1r2=Mr1−1Mr2,
where Mr1r2 is the registration relation between the first and second images,
Mr1 is the registration of the first image with respect to the global reference image; and
Mr2 is the registration of the second image with respect to the global reference image.

### Claim 14 (depends on 11)

A non-transitory computer readable memory carrying software which is run on one or more processors to perform the method as set forth in claim 11.

### Claim 15 (depends on 11)

A medical imaging system including:
at least one display;
one or more processors programmed to perform the method as set forth in claim 11.

### Claim 16

A medical imaging method comprising:
generating an interactive user interface screen on a display;
simultaneously inspecting selected image data of multiple patients or multiple images on the display;
identifying a global reference image;
aligning all images to the selected global reference image;
comparing a frame of reference of each image to the frame of reference of the global reference image
determining a 3D position of a point of interest in one image; based on the determined position of the point of interest in the image, determining positions of corresponding points of interest in associated images;
retrieving a position of the point of interest in the display coordinate system;
transforming the display coordinates of the point of interest into patient coordinates in accordance with image position and orientation;
determining a position of an original point of interest in the patient coordinate system;
transforming coordinates of the original point into the common coordinate system; and
updating the associated images.

### Claim 17

A medical imaging method comprising:
generating an interactive user interface screen on a display;
simultaneously inspecting selected image data of multiple patients or multiple images on the display;
comparing selected viewing groups of images, the images in each group having a known registration relation to a common global reference;
selecting a reference image in a first group;
selecting a reference image in a second group;
computing registration between the images of the first and second groups from the registration of the selected first group reference image with respect to the global reference image and the selected second group reference image with respect to the common global reference image; and
computing registration between the images of the first and second groups as
Mr1r2=Mr1−1Mr2,
where Mr1r2 the registration between the images of the first and second groups,
Mr1 is a registration of the selected first group reference image with respect to the global reference image, and
Mr2 is the registration of the selected second group reference image with respect to the global reference image.
