# US 12,004,891 B1 · Methods and systems for detection of errors in medical reports

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,004,891 B1
- Document ID: US12004891B1
- Status: Granted
- Kind: B1
- Application number: 17/217,675
- Filed: 2021-03-30
- Granted: 2024-06-11
- Earliest claimed: 2021-03-30
- Assignees: Amazon Technologies, Inc.
- Applicants: Amazon Technologies, Inc.
- Inventors: Sharon Alpert; Antonio Criminisi
- Web page: https://patentgrep.com/patent/US12004891B1

## CPC

- A61B 6/5211: {involving processing of medical diagnostic data}
- A61B 5/055: involving electronic [EMR] or nuclear [NMR] magnetic resonance, e.g. magnetic resonance imaging
- A61B 6/032: {Transmission computed tomography [CT]}
- A61B 8/5215: {involving processing of medical diagnostic data}
- G06F 3/0482: Interaction with lists of selectable items, e.g. menus
- G06F 3/1423: {controlling a plurality of local displays, e.g. CRT and flat panel display}
- G06F 18/22: Matching criteria, e.g. proximity measures
- G06T 7/0012: {Biomedical image inspection}
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G16H 10/60: for patient-specific data, e.g. for electronic patient records
- G16H 15/00: ICT specially adapted for medical reports, e.g. generation or transmission thereof
- G16H 30/20: for handling medical images, e.g. DICOM, HL7 or PACS
- G16H 30/40: for processing medical images, e.g. editing
- G16H 40/63: for local operation
- G16H 40/67: for remote operation
- G16H 50/70: for mining of medical data, e.g. analysing previous cases of other patients
- A61B 6/463: {characterised by displaying multiple images or images and diagnostic data on one display}
- A61B 6/5217: {extracting a diagnostic or physiological parameter from medical diagnostic data}
- A61B 6/566: {involving communication between diagnostic systems}
- A61B 8/463: {characterised by displaying multiple images or images and diagnostic data on one display}
- A61B 8/5223: {for extracting a diagnostic or physiological parameter from medical diagnostic data (for algorithms to analyse biomedical images G06T7/0012)}
- A61B 8/565: {involving data transmission via a network}
- G06T 2200/24: involving graphical user interfaces [GUIs]
- G06T 2207/30004: Biomedical image processing
- G06V 2201/031: of internal organs
- G10L 15/18: using natural language modelling
- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L 2015/223: {Execution procedure of a spoken command}
- G16H 40/20: for the management or administration of healthcare resources or facilities, e.g. managing hospital staff or surgery rooms
- G16H 50/20: for computer-aided diagnosis, e.g. based on medical expert systems
- G16H 70/20: relating to practices or guidelines
- G16H 70/60: relating to pathologies
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

Systems for preparing a medical report, and related methods, generate and output feedback indicative or potential errors in the medical report. A system for preparing a medical report is configured to receive image data for a medical image of a patient, display the medical image, monitor content of the medical report during preparation of the medical report, process the image data to detect one or more organs of the patient imaged in the medical image, compare the content of the medical report with the one or more organs imaged in the medical image to detect one or more potential errors in the medical report, and output feedback indicative of the one or more potential errors in the medical report.

## Claims

### Claim 1

A system for preparing a medical report, the system comprising:
one or more displays operable to display a medical image of a patient;
one or more input devices;
one or more processors; and
one or more computer-readable media that store non-transitory instructions executable by the one or more processors to cause the one or more processors to:
receive image data for a medical image of a patient, wherein the image data is generated via a medical imaging system;
cause the one or more displays to display the medical image of the patient;
receive user input for preparation of the medical report via the one or more input devices;
display content of the medical report via the one or more displays during preparation of the medical report;
identify a subject organ of the patient referred to in the medical report by monitoring content of the medical report during preparation of the medical report;
process the image data to detect whether an image of the subject organ of the patient is included in the displayed medical image of the patient; and
output feedback via the one or more displays that indicates whether an image of the subject organ of the patient is included in the displayed medical image of the patient.

### Claim 2 (depends on 1)

A system of claim 1, wherein the non-transitory instructions are further executable by the one or more processors to cause the one or more processors to:
process the image data to detect and localize one or more images of a corresponding one or more organs of the patient in the displayed medical image of the patient; and
determine whether the one or more images of the corresponding one or more organs of the patient in the displayed medical image of the patient do not include an image of the subject organ.

### Claim 3 (depends on 1)

A system of claim 1, wherein the non-transitory instructions are further executable by the one or more processors to cause the one or more processors to:
perform image processing of the image data to check for a potential pathology of an organ imaged in the displayed medical image of the patient; and
output feedback indicative of a result of the check for the potential pathology of the organ imaged in the displayed medical image of the patient.

### Claim 4 (depends on 1)

A system of claim 1, wherein the non-transitory instructions are further executable by the one or more processors to cause the one or more processors to display a designation of the subject organ in the displayed medical image of the patient.

### Claim 5

A system for preparing a medical report, the system comprising:
one or more displays operable to display a medical image of a patient;
one or more processors; and
one or more computer-readable media that store non-transitory instructions executable by the one or more processors to cause the one or more processors to:
receive image data for a medical image of a patient, wherein the image data is generated via a medical imaging system;
display the medical image of the patient via the one or more displays;
monitor content of the medical report during preparation of the medical report;
process the image data to detect one or more organs of the patient imaged in the displayed medical image of the patient;
compare the content of the medical report with the one or more organs imaged in the displayed medical image of the patient to detect one or more potential errors in the medical report; and
output feedback indicative of the one or more potential errors in the medical report.

### Claim 6 (depends on 5)

A system of claim 5, wherein:
the processing of the image data to detect the one or more organs of the patient imaged in the displayed medical image of the patient comprises detecting and localizing one or more images of a corresponding one or more organs of the patient in the medical image; and
the comparing of the medical report with the one or more organs imaged in the displayed medical image of the patient to detect one or more potential errors in the medical report comprises determining whether the one or more images of the corresponding one or more organs of the patient in the displayed medical image of the patient include an image of an organ of the patient referred to in the medical report.

### Claim 7 (depends on 6)

A system of claim 6, wherein the non-transitory instructions are further executable by the one or more processors to cause the one or more processors to display a designation of an organ referred to in the medical report in the displayed medical image of the patient.

### Claim 8 (depends on 5)

The system of claim 5, wherein the non-transitory instructions are further executable by the one or more processors to cause the one or more processors to:
perform image processing of the image data to check for a potential pathology of an organ imaged in the displayed medical image of the patient; and
output feedback indicative of a result of the check for the potential pathology of the organ imaged in the displayed medical image of the patient.

### Claim 9 (depends on 5)

The system of claim 5, wherein the non-transitory instructions are further executable by the one or more processors to cause the one or more processors to determine whether an image of an organ referred to in the medical report is included in a list of organs of the patient that can be imaged by the medical imaging system.

### Claim 10 (depends on 5)

The system of claim 5, wherein:
the non-transitory instructions are further executable by the one or more processors to cause the one or more processors to limit a selection of the medical report to a list of selectable medical reports; and
each of the selectable medical reports is directed to an organ of the patient for which an image of the organ is included in the displayed medical image of the patient.

### Claim 11 (depends on 5)

The system of claim 5, wherein the non-transitory instructions are further executable by the one or more processors to cause the one or more processors to:
receive an input designating a portion of the displayed medical image of the patient; and
limit a selection of the medical report to a list of one or more selectable medical reports, wherein each of the one or more selectable medical reports corresponds to the designated portion of the displayed medical image of the patient.

### Claim 12 (depends on 5)

The system of claim 5, wherein the medical imaging system comprises one or more of an X-ray imaging system, a computed tomography (CT) imaging system, a magnetic resonance imaging (MM) system, or an ultrasound imaging system.

### Claim 13

A computer-implemented method of providing feedback identifying a potential error in a medical report, the method comprising:
receiving image data for a medical image of a patient by a medical report generation system, wherein the image data is generated via a medical imaging system;
displaying the medical image of the patient via one or more displays of the medical report generation system;
monitoring content of the medical report by the medical report generation system during preparation of the medical report;
processing the image data by the medical report generation system to detect one or more organs of the patient imaged in the displayed medical image of the patient;
comparing, by the medical report generation system, the content of the medical report with the one or more organs imaged in the displayed medical image of the patient to detect one or more potential errors in the medical report; and
outputting feedback by the medical report generation system indicative of the one or more potential errors in the medical report.

### Claim 14 (depends on 13)

A computer-implemented method of claim 13, wherein:
the processing of the image data to detect the one or more organs of the patient imaged in the displayed medical image of the patient comprises detecting and localizing one or more images of a corresponding one or more organs of the patient in the displayed medical image of the patient; and
the comparing of the content of the medical report with the one or more organs imaged in the displayed medical image of the patient to detect one or more potential errors in the medical report comprises determining whether the one or more images of the corresponding one or more organs of the patient in the displayed medical image of the patient include an image of an organ of the patient referred to in the medical report.

### Claim 15 (depends on 14)

A computer-implemented method of claim 14, comprising displaying, by the medical report generation system, a designation of an organ referred to in the medical report in the displayed medical image of the patient.

### Claim 16 (depends on 13)

The computer-implemented method of claim 13, comprising:
performing image processing of the image data by the medical report generation system to perform a check for a potential pathology of an organ imaged in the displayed medical image of the patient; and
outputting feedback, by the medical report generation system, indicative of results of the check for a potential pathology of an organ imaged in the displayed medical image of the patient.

### Claim 17 (depends on 13)

The computer-implemented method of claim 13, comprising determining, by the medical report generation system, whether an image of an organ referred to in the medical report is included in a list of organs of the patient that can be imaged by the medical imaging system.

### Claim 18 (depends on 13)

The computer-implemented method of claim 13, comprising limiting a selection of the medical report, by the medical report generation system, to a list of selectable medical reports, wherein each of the selectable medical reports is directed to an organ of the patient for which an image of the organ is included in the displayed medical image of the patient.

### Claim 19 (depends on 13)

The computer-implemented method of claim 13, comprising:
receiving, by the medical report generation system, an input designating a portion of the displayed medical image of the patient; and
limiting, by the medical report generation system, a selection of the medical report to a list of one or more selectable medical reports, wherein each of the one or more selectable medical reports corresponds to the designated portion of the displayed medical image of the patient.

### Claim 20 (depends on 13)

The computer-implemented method of claim 13, wherein the medical imaging system comprises one or more of an X-ray imaging system, a computed tomography (CT) imaging system, a magnetic resonance imaging (MRI) system, or an ultrasound imaging system.