# US 2022/0284542 A1 · Semantically Altering Medical Images

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0284542 A1
- Document ID: US20220284542A1
- Status: Published application
- Kind: A1
- Application number: 17/195,218
- Filed: 2021-03-08
- Published: 2022-09-08
- Earliest claimed: 2021-03-08
- Assignees: Embryonics LTD
- Applicants: Embryonics LTD
- Inventors: David H. Silver; Alex Bronstein; Shahar Rosentraub; Yael Gold-Zamir; Yotam Wolf
- Web page: https://patentgrep.com/patent/US20220284542A1

## CPC

- G06T 12/30: Image post-processing, e.g. metal artefact correction
- G06T 3/04: Context-preserving transformations, e.g. by using an importance map (panospheric to cylindrical image transformations G06T3/12)
- G06T 11/60: Creating or editing images; Combining images with text
- G06T 2210/41: Medical
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

The present invention extends to methods, systems, and computer program products for semantically altering a medical image. A medical image and a transform are accessed. The transform is used to transform the medical image to a simpler image having reduced complexity relative to the medical image. A semantic alteration is made to content of the simpler image. Another (and possibly inverse) transform is accessed. The other transform is used to transform the simpler image to a more complex image having increased complexity relative to the simpler image (e.g., complexity resembling the medical image). Transforming the simpler image to a more complex image can include propagating the semantic alteration with the increased complexity into content of the more complex image. A medical decision is made in view of the semantic alteration and based on at least a portion of the more complex image content.

## Claims

### Claim 1

A method comprising:
accessing a medical image;
accessing a transform;
using the transform transforming the medical image to a simpler image having reduced complexity relative to the medical image;
making a semantic alteration to content of the simpler image;
accessing another transform;
using the other transform transforming the simpler image to a more complex image having increased complexity relative to the simpler image, including propagating the semantic alteration with the increased complexity into content of the more complex image; and
making a medical decision in view of the semantic alteration and based on at least a portion of the more complex image content.

### Claim 2 (depends on 1)

The method of claim 1, wherein semantically altering the simpler image comprises semantically augmenting the simpler image.

### Claim 3 (depends on 2)

The method of claim 2, wherein semantically augmenting the simpler image comprises:
identifying a graphical element in the simpler image having at least a threshold diagnostic relevance to the medical decision; and
emphasizing the graphical element in the simpler image forming an emphasized graphical element; and
wherein using the other transform transforming the simpler image comprises propagating emphasis of the graphical element within the more complex image content.

### Claim 4 (depends on 2)

The method of claim 2, wherein semantically augmenting the simpler image comprises:
identifying a graphical element in the simpler image having less than a threshold diagnostic relevance to the medical decision; and
de-emphasizing the graphical element in the simpler image forming a de-emphasized graphical element; and
wherein using the other transform transforming the simpler image comprises propagating de-emphasis of the graphical element within the more complex image content.

### Claim 5 (depends on 2)

The method of claim 2, wherein semantically augmenting the simpler image comprises adding an annotation to a graphical element in the simpler image; and
wherein using the other transform transforming the simpler image comprises propagating within the more complex image content.

### Claim 6 (depends on 2)

The method of claim 2, wherein accessing a medical image comprises accessing a medical image associated with a patient;
wherein semantically altering the simpler image comprises:
identifying one or more of: an anatomical difference, a morphological difference, or a kinetic difference between the patient and one or more other patients within the content of the simpler image; and
indicating the one or more of: the anatomical difference, the morphological difference, or the kinetic difference in the simpler image; and
wherein using the other transform transforming the simpler image comprises propagating the indication of the one or more of: the anatomical difference, the morphological difference, or the kinetic difference within the more complex image

### Claim 7 (depends on 1)

The method of claim 1, wherein accessing a medical image comprises accessing a medical image associated with a patient;
wherein semantically altering the simpler image comprises:
locating patient identifiable content within the simpler image; and
obscuring the patient identifiable content within the simpler image; and
wherein using the other transform transforming the simpler image comprises propagating obscuring the patient identifiable content within the more complex image.

### Claim 8 (depends on 1)

The method of claim 1, wherein semantically altering the simpler image comprises removing content from the simpler image; and
wherein using the other transform transforming the simpler image comprises transforming the simpler image to the more complex image without considering the removed content.

### Claim 9 (depends on 8)

The method of claim 8, wherein removing content from the simpler image comprises:
identifying one of: irrelevant background in the simpler image or an image artifact in the simpler image; and
removing the one of: the irrelevant background or the image artifact from the simpler image.

### Claim 10 (depends on 1)

The method of claim 1, wherein accessing a medical image comprises accessing one of: a camera image, an X-ray image, a computer tomography (CT) image, a computerized axial tomography (CAT) image, a positron-emission tomography (PET) image, a Magnetic resonance imaging (MRI) image, an Ultrasound image, a fluoroscopy image, and Bone densitometry (DEXA or DXA) image.

### Claim 11 (depends on 1)

The method of claim 1, wherein accessing a medical image comprises accessing a three-dimensional medical image;
wherein using the transform transforming the medical image to a simpler image comprises using the transform transforming the three-dimensional medical image to a simpler three-dimensional image; and
wherein using the other transform transforming the simpler image to a more complex image comprises using the other transform transforming the simpler three-dimensional image to a more complex three-dimensional image.

### Claim 12 (depends on 1)

The method of claim 1, wherein accessing the other transform comprises accessing an inverse transform of the transform; and
wherein using the other transform transforming the simpler image to a more complex image comprises using the inverse transform transforming the simpler image to the more complex image.

### Claim 13

A system comprising:
a processor; and
system memory coupled to the processor and storing instructions configured to cause the processor to:
access a medical image;
access a transform;
use the transform transforming the medical image to a simpler image having reduced complexity relative to the medical image;
make a semantic alteration to content of the simpler image;
access another transform;
use the other transform transforming the simpler image to a more complex image having increased complexity relative to the simpler image, including propagating the semantic alteration with the increased complexity into content of the more complex image; and
make a medical decision in view of the semantic alteration and based on at least a portion of the more complex image content.

### Claim 14 (depends on 1)

The system of claim 1, wherein instructions configured to semantically alter the simpler image comprise instructions configured to semantically augment the simpler image.

### Claim 15 (depends on 14)

The system of claim 14, wherein instructions configured to semantically augment the simpler image comprise instructions configured to:
identify a graphical element in the simpler image having at least a threshold diagnostic relevance to the medical decision; and
emphasize the graphical element in the simpler image forming an emphasized graphical element; and
wherein instructions configured to use the other transform transforming the simpler image comprise instructions configured to semantically augment to propagate emphasis of the graphical element within the more complex image content.

### Claim 16 (depends on 14)

The system of claim 14, wherein instructions configured to semantically augment the simpler image comprise instructions configured to:
identify a graphical element in the simpler image having less than a threshold diagnostic relevance to the medical decision; and
de-emphasize the graphical element in the simpler image forming a de-emphasized graphical element; and
wherein instructions configured to use the other transform transforming the simpler image comprise instructions configured to propagate de-emphasis of the graphical element within the more complex image content.

### Claim 17 (depends on 13)

The system of claim 13, wherein instructions configured to accessing a medical image comprises instructions configured to access a medical image associated with a patient;
wherein instructions configured to semantically altering the simpler image comprise instructions configured to:
locate patient identifiable content within the simpler image; and
obscure the patient identifiable content within the simpler image; and
wherein instructions configured to use the other transform transforming the simpler image comprise instructions configured to propagating obscuring the patient identifiable content within the more complex image.

### Claim 18 (depends on 13)

The system of claim 13, wherein instructions configured to access a medical image comprise instructions configured to access one of: a camera image, an X-ray image, a computer tomography (CT) image, a computerized axial tomography (CAT) image, a positron-emission tomography (PET) image, a Magnetic resonance imaging (MRI) image, an Ultrasound image, a fluoroscopy image, and Bone densitometry (DEXA or DXA) image.

### Claim 19 (depends on 13)

The system of claim 13, wherein instructions configured to access a medical image comprise instructions configured to accessing a three-dimensional medical image;
wherein instructions configured to use the transform transforming the medical image to a simpler image comprise instructions configured to use the transform transforming the three-dimensional medical image to a simpler three-dimensional image; and
wherein instructions configured to use the other transform transforming the simpler image to a more complex image comprise instructions configured to use the other transform transforming the simpler three-dimensional image to a more complex three-dimensional image.

### Claim 20 (depends on 13)

The system of claim 13, wherein instructions configured to access the other transform comprise instructions configured to access an inverse transform of the transform; and
wherein instructions configured to use the other transform transforming the simpler image to a more complex image comprise instructions configured to use the inverse transform transforming the simpler image to the more complex image.
