# US 2019/0378325 A1 · Method and system for rule based display of sets of images using image content derived parameters

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0378325 A1
- Document ID: US20190378325A1
- Status: Published application
- Kind: A1
- Application number: 16/531,436
- Filed: 2019-08-05
- Published: 2019-12-12
- Earliest claimed: 2013-03-15
- Assignees: Pme IP Pty Ltd
- Applicants: Pme IP Pty Ltd
- Inventors: MALTE WESTERHOFF; DETLEV STALLING
- Web page: https://patentgrep.com/patent/US20190378325A1

## CPC

- G16H 30/20: for handling medical images, e.g. DICOM, HL7 or PACS
- A61B 5/7475: {User input or interface means, e.g. keyboard, pointing device, joystick}
- A61B 6/032: {Transmission computed tomography [CT]}
- A61B 6/037: {Emission tomography}
- A61B 6/465: {adapted to display user selection data, e.g. graphical user interface, icons or menus}
- A61B 6/466: {adapted to display 3D data}
- A61B 6/5205: {involving processing of raw data to produce diagnostic data}
- G06F 3/147: using display panels
- G06T 11/10: Texturing; Colouring; Generation of textures or colours (retouching, inpainting or scratch removal G06T5/77)
- G06T 11/60: Creating or editing images; Combining images with text
- G06T 15/08: Volume rendering
- G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts
- G09G 5/363: {Graphics controllers}
- G16H 30/40: for processing medical images, e.g. editing
- G16H 50/70: for mining of medical data, e.g. analysing previous cases of other patients
- A61B 5/08: Measuring devices for evaluating the respiratory organs
- G06F 3/0481: based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06T 2200/04: involving 3D image data
- G06T 2200/24: involving graphical user interfaces [GUIs]
- G06T 2210/41: Medical
- G06T 2219/2012: Colour editing, changing, or manipulating; Use of colour codes
- G06T 2219/2024: Style variation
- G09G 2340/12: Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels
- G09G 2380/08: Biomedical applications
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)

## Abstract

The invention provides, in some aspects, a system for implementing a rule derived basis to display image sets. In various embodiments of the invention, the selection of the images to be displayed, the layout of the images, as well as the rendering parameters and styles can be determined using a rule derived basis. The rules are based on meta data of the examination as well as image content that is being analyzed by neuronal networks. In an embodiment of the present invention, the user is presented with images displayed based on their preferences without having to first manually adjust parameters.

## Claims

### Claim 1

A method comprising:
(A) receiving at a server from a client computer a plurality of studies,
the server comprising a server digital data processor, and
the client computer comprising a client digital data processor;
(B) receiving at the server from the client computer a primary Study of a patient selected from the plurality of studies;
(C) selecting a ParameterA from the primary study, where the ParameterA is selected from the group consisting of an anatomical characteristic, and a disease based characteristic;
(D) selecting ParameterB from the group consisting of one or more anatomical features of the ParameterA, parts of a skeletal system of the ParameterA, organs of the ParameterA, and a Modality of the primary Study;
(E) executing on the server one or more render server programs which apply one or more Study Selection Rules to generate a list of a plurality of secondary studies, where the one or more Study Selection Rules restrict the plurality of secondary studies to studies of the patient selected from the plurality of studies, where the list is selected based on a parameter selected from the group consisting of the ParameterA, the ParameterB and a combination of the ParameterA and the ParamaterB;
(F) executing on the server digital data processor the one or more render server programs which apply one or more Protocol Selection Rules to select a Display Protocol, where the one or more Protocol Selection Rules are based on two or more parameters selected from the group consisting of one or more DICOM parameters from the primary Study, one or more Abstract Tags from the primary Study, one or more DICOM parameters from the plurality of secondary studies and one or more Abstract Tags from the plurality of secondary studies; and
(G) sending from the server to the client computer the Display Protocol selected in step (F) and the list generated in step (E).

### Claim 2 (depends on 1)

The method of claim 1, where the anatomical characteristic is selected from the group consisting of SPINE, CHEST, ABDOMEN, BREAST, SHOULDER, TRAPEZIUS, ARM, ELBOW, WRIST, FINGER, PELVIS, HIP, FIBULAR, KNEE, TIBULAR, ANKLE, FOOT, NECK, HEAD, TEMPOROMANDIBULAR JUNCTION, FACE, BRAIN, DENTITION, SINUS, ADRENALS, RETINA, PITUITARY, and PROSTATE.

### Claim 3 (depends on 1)

The method of claim 1, where the ParameterB is a Modality in the primary study and a ParameterY a Modality in a secondary study, where in step (E) the one or more Study Selection Rules restrict to studies where ParameterB is equal to ParameterY.

### Claim 4 (depends on 1)

The method of claim 1, further comprising where a Study Selection Rule of the one or more Study Selection Rules in step (E) requires
SELECT other secondary studies for loading
WHERE (Primary.Dicom.Modality=“ParameterB” and Other.Dicom.Modality=“ParameterY” AND INTERSECTION(ParameterB,ParameterY) NOT EMPTY).

### Claim 5 (depends on 1)

The method of claim 1, where the ParameterB is a Modality selected from the group consisting of Computed Radiography (CR), Computer Tomography (CT), Digital Radiography (DX), Mammography (MG), Magnetic Resonance (MR), Opthalmic Photography (OP), Positron Emission Tomography (PT), Radio Fluoroscopy (RF), and X-Ray Angiography (XA).

### Claim 6 (depends on 1)

The method of claim 1, further comprising where a Study Selection Rule of the one or more Study Selection Rules in step (E) requires
IF (Primary.Dicom.AnatomicalCharacteristic=“ParameterA” and Primary.Dicom.Modality=“ParameterB”),
THEN SELECT other secondary studies for loading
WHERE (Other.Dicom.AnatomicalCharacteristic=“ParameterA” and Other.Dicom.Modality=“ParameterB”).

### Claim 7 (depends on 1)

The method of claim 1, further comprising where a Study Selection Rule of the one or more Study Selection Rules in step (E) requires
IF (Primary.Dicom.AnatomicalCharacteristic=“ParameterA” and Primary.Dicom.Modality=“ParameterB”),
THEN SELECT other secondary studies for loading
WHERE (Other.Dicom.AnatomicalCharacteristic=“ParameterA” and Other.Dicom.Modality=“ParameterY” AND INTERSECTION (ParameterB, ParameterY) NOT EMPTY).

### Claim 8 (depends on 1)

The method of claim 1, further comprising where a Study Selection Rule of the one or more Study Selection Rules in step (E) requires
IF (Primary.Dicom.AnatomicalCharacteristic=“ParameterA” and Primary.Dicom.Modality=“ParameterB”)
THEN SELECT other secondary studies for loading
WHERE (Other.Dicom.AnatomicalCharacteristic=“ParameterA” and Other.Dicom.Modality=“ParameterB” AND INTERSECTION(Primary.Dicom.AnatomicalFeature,Other.Dicom.AnatomicalFeature) NOT EMPTY).

### Claim 9 (depends on 1)

The method of claim 1, further comprising where a Study Selection Rule of the one or more Study Selection Rules in step (E) requires
IF (Primary.Dicom. AnatomicalCharacteristic=“ParameterA”)
THEN SELECT other secondary studies for loading
WHERE (Other.Dicom.AnatomicalCharacteristic=“ParameterA” AND INTERSECTION(Primary.Dicom.AnatomicalFeature,Other.Dicom.AnatomicalFeature) NOT EMPTY).

### Claim 10

A method comprising:
(A) receiving at a server from a client computer a primary Study of a patient,
the server comprising a server digital data processor, and
the client computer comprising a client digital data processor;
(B) selecting a ParameterA from the primary study, where the ParameterA is selected from the group consisting of an anatomical characteristic, and a disease based characteristic;
(C) selecting ParameterB from the group consisting of one or more anatomical features of the ParameterA, parts of a skeletal system of the ParameterA, organs of the ParameterA, and a Modality of the primary Study;
(D) executing on the server one or more render server programs which apply one or more Study Selection Rules to generate a list of a plurality of secondary studies based on the combination of the ParameterA and the ParameterB, where the one or more Study Selection Rules restrict the plurality of secondary studies to studies of the patient;
(E) executing on the server digital data processor the one or more render server programs which apply one or more Protocol Selection Rules to select a Display Protocol, where the one or more Protocol Selection Rules are based on two or more parameters selected from the group consisting of one or more DICOM parameters from the primary Study, one or more Abstract Tags from the primary Study, one or more DICOM parameters from the plurality of secondary studies and one or more Abstract Tags from the plurality of secondary studies; and
(F) sending from the server to the client computer the Display Protocol selected in step (E) and the list generated in step (D).

### Claim 11 (depends on 10)

The method of claim 10, where the anatomical characteristic is selected from the group consisting of SPINE, CHEST, ABDOMEN, BREAST, SHOULDER, TRAPEZIUS, ARM, ELBOW, WRIST, FINGER, PELVIS, HIP, FIBULAR, KNEE, TIBULAR, ANKLE, FOOT, NECK, HEAD, TEMPOROMANDIBULAR JUNCTION, FACE, BRAIN, DENTITION, SINUS, ADRENALS, RETINA, PITUITARY, and PROSTATE.

### Claim 12 (depends on 10)

The method of claim 10, where the ParameterB is a Modality in the primary study and a ParameterY a Modality in a secondary study, where in step (D) the one or more Study Selection Rules restrict to studies where ParameterB is equal to ParameterY.

### Claim 13 (depends on 10)

The method of claim 10, further comprising where a Study Selection Rule of the one or more Study Selection Rules in step (D) requires
SELECT other secondary studies for loading
WHERE (Primary.Dicom.Modality=“ParameterB” and (Other.Dicom.Modality=“ParameterY” AND INTERSECTION(ParameterB,ParameterY) NOT EMPTY).

### Claim 14 (depends on 10)

The method of claim 10, where the ParameterB is a Modality selected from the group consisting of Computed Radiography (CR), Computer Tomography (CT), Digital Radiography (DX), Mammography (MG), Magnetic Resonance (MR), Opthalmic Photography (OP), Positron Emission Tomography (PT), Radio Fluoroscopy (RF), and X-Ray Angiography (XA).

### Claim 15 (depends on 10)

The method of claim 10, further comprising where a Study Selection Rule of the one or more Study Selection Rules in step (D) requires
IF (Primary.Dicom.AnatomicalCharacteristic=“ParameterA” and Primary.Dicom.Modality=“ParameterB”),
THEN SELECT other secondary studies for loading
WHERE (Other.Dicom.AnatomicalCharacteristic=“ParameterA” and Other.Dicom.Modality=“ParameterB”).

### Claim 16 (depends on 10)

The method of claim 10, further comprising where a Study Selection Rule of the one or more Study Selection Rules in step (D) requires
IF (Primary.Dicom.AnatomicalCharacteristic=“ParameterA” and Primary.Dicom.Modality=“ParameterB”),
THEN SELECT other secondary studies for loading
WHERE (Other.Dicom.AnatomicalCharacteristic=“ParameterA” and Other.Dicom.Modality=“ParameterY” AND INTERSECTION (ParameterB, ParameterY) NOT EMPTY).

### Claim 17 (depends on 10)

The method of claim 10, further comprising where a Study Selection Rule of the one or more Study Selection Rules in step (D) requires
IF (Primary.Dicom.AnatomicalCharacteristic=“ParameterA” and Primary.Dicom.Modality=“ParameterB”)
THEN SELECT other secondary studies for loading
WHERE (Other.Dicom.AnatomicalCharacteristic=“ParameterA” and Other.Dicom.Modality=“ParameterB” AND INTERSECTION(Primary.Dicom.AnatomicalFeature,Other.Dicom.AnatomicalFeature) NOT EMPTY).

### Claim 18 (depends on 10)

The method of claim 10, further comprising where a Study Selection Rule of the one or more Study Selection Rules in step (D) requires
IF (Primary.Dicom. AnatomicalCharacteristic=“ParameterA”)
THEN SELECT other secondary studies for loading
WHERE (Other.Dicom.AnatomicalCharacteristic=“ParameterA” AND INTERSECTION(Primary.Dicom.AnatomicalFeature,Other.Dicom.AnatomicalFeature) NOT EMPTY).

### Claim 19

A method comprising:
(A) receiving at a server from a client computer a primary Study of a patient,
the server comprising a server digital data processor, and
the client computer comprising a client digital data processor;
(B) selecting a ParameterA from the primary study, where the ParameterA is selected from the group consisting of an anatomical characteristic, and a disease based characteristic;
(C) selecting ParameterB from the group consisting of one or more anatomical features of the ParameterA, parts of a skeletal system of the ParameterA, organs of the ParameterA, and a Modality of the primary Study;
(D) executing on the server one or more render server programs which apply one or more Study Selection Rules to generate a list of a plurality of secondary studies based on a combination of the ParameterA and the ParameterB, where the one or more Study Selection Rules select studies of the patient from a plurality of studies accessible to the server; and
(E) sending from the server to the client computer the list generated in step (D).

### Claim 20 (depends on 19)

The method of claim 19, further comprising where a Study Selection Rule of the one or more Study Selection Rules in step (D) requires
IF (Primary.Dicom. AnatomicalCharacteristic=“ParameterA”)
THEN SELECT other studies for loading
WHERE (Other.Dicom.AnatomicalCharacteristic=“ParameterA” AND INTERSECTION(Primary.Dicom.AnatomicalFeature,Other.Dicom.AnatomicalFeature) NOT EMPTY).
