# US 2026/0096786 A1 · Systems and methods for automatic state estimation of a current imaging exam using user actions on a console screen

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0096786 A1
- Document ID: US20260096786A1
- Status: Published application
- Kind: A1
- Application number: 19/112,526
- Filed: 2023-09-19
- Published: 2026-04-09
- Earliest claimed: 2022-09-20
- Assignees: Koninklijke Philips N.V.
- Applicants: Koninklijke Philips N.V.
- Inventors: SIVA CHAITANYA CHADUVULA; EKIN KOKER; OLGA STAROBINETS; RANJITH NAVEEN TELLIS; SANDEEP MADHUKAR DALAL; THOMAS ERIK AMTHOR; YUECHEN QIAN
- Web page: https://patentgrep.com/patent/US20260096786A1

## CPC

- A61B 5/747: {in case of emergency, i.e. alerting emergency services}
- G16H 30/40: for processing medical images, e.g. editing
- A61B 5/0077: {Devices for viewing the surface of the body, e.g. camera, magnifying lens}
- A61B 5/7282: {Event detection, e.g. detecting unique waveforms indicative of a medical condition (cough events A61B5/0823; seizures A61B5/4094; sleep apnoea A61B5/4818)}
- A61B 5/742: {using visual displays (displays for heart-related electrical signals, e.g. ECG, A61B5/339)}
- A61B 5/746: {Alarms related to a physiological condition, e.g. details of setting alarm thresholds or avoiding false alarms}
- G06T 7/0012: {Biomedical image inspection}
- G06T 7/20: Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51)
- G06V 10/75: Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries
- G06V 20/44: {Event detection}
- G16H 40/63: for local operation
- G16H 40/67: for remote operation
- G06T 2200/24: involving graphical user interfaces [GUIs]
- G06T 2207/10016: Video; Image sequence
- G06T 2207/30016: Brain
- G06V 2201/03: Recognition of patterns in medical or anatomical images
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A non-transitory computer readable medium (26s) stores instructions executable by at least one electronic processor (14s) to perform a method (100) of providing assistance during a medical imaging examination performed using a medical imaging device (2). The method includes acquiring video (17) of the medical imaging examination; determining, using a state machine (40) implemented in the at least one electronic processor, a current state of an imaging examination from the acquired video; and displaying an indication (46) of the determined current state of the imaging examination on an electronic processing device (8).

## Claims

### Claim 1

A non-transitory computer readable medium having stored instructions for determining a need for assistance during a medical imaging examination, the instructions, when executed by at least one processor, cause the at least one processor to:
acquire video of the medical imaging examination;
determine, using a state machine, a current state of the medical imaging examination from the acquired video;
display an indication of the determined current state of the medical imaging examination; and
identify a transition from the current state of the medical imaging examination to a next state of the medical imaging examination based on the acquired video and the state machine, wherein the transition indicates the need for assistance during the medical imaging examination.

### Claim 2

(canceled)

### Claim 3 (depends on 12)

The non-transitory computer readable medium of claim 12, wherein, to identify the transition, the instructions, when executed by the at least one processor, further cause the at least one processor to:
detect the transition as a change in content of the acquired video from a first user interface (UI) dialog screen corresponding to the current state in the state machine to a second UI dialog screen; and
determine the next state of the medical imaging examination by matching the second UI dialog screen with the next state in the state machine.

### Claim 4 (depends on 1)

The non-transitory computer readable medium of claim 1, wherein, to identify the transition, the instructions, when executed by the at least one processor, further cause the at least one processor to:
determine a change in content of the acquired video; and
detect the transition of the medical imaging examination from the current state of the medical imaging examination to the next state of the medical imaging examination based on the determined change in the content of the acquired video and permissible transitions out of the current state in the state machine.

### Claim 5 (depends on 1)

The non-transitory computer readable medium of claim 1, wherein the instructions, when executed by the at least one processor, further cause the at least one processor to:
determine an event of the medical imaging examination that triggered the transition from the current state of the medical imaging examination to the next state of the medical imaging examination based on a state transition of the state machine from the current state to the next state.

### Claim 6 (depends on 5)

The non-transitory computer readable medium of claim 5, wherein the instructions, when executed by the at least one processor, further cause the at least one processor to:
perform an assistive action to provide assistance during the medical imaging examination based on the determined event.

### Claim 7 (depends on 2)

The non-transitory computer readable medium of claim 2, wherein, to perform the assistive action, the instructions, when executed by the at least one processor, further cause the at least one processor to establish a natural communication pathway between a local operator performing the medical imaging examination and a remote expert.

### Claim 8 (depends on 6)

The non-transitory computer readable medium of claim 6, wherein, to perform the assistive action, the instructions, when executed by the at least one processor, further cause the at least one processor to automatically provide at least one of textual, graphical, video, or multimedia guidance respective to the determined event.

### Claim 9 (depends on 2)

The non-transitory computer readable medium of claim 2, wherein the current state of the medical imaging examination is defined by state variables and the instructions, when executed by the at least one processor, further cause the at least one processor to determine values for the state variables based on information determined from the acquired video including at least patient information and imaging examination information input by a local operator.

### Claim 10 (depends on 1)

The non-transitory computer readable medium of claim 1, wherein the instructions, when executed by the at least one processor, further cause the at least one processor to:
output an alert indicative of a duration of the current state of the medical imaging examination exceeding an expected duration of the current state of the medical imaging examination.

### Claim 11 (depends on 1)

The non-transitory computer readable medium of claim 1, wherein the instructions, when executed by the at least one processor, further cause the at least one processor to:
collect data on a performance of a local operator performing the medical imaging examination by detecting transitions of the medical imaging examination through states of the state machine by iterative repetition; and
store the collected data related to performance of the local operator.

### Claim 12 (depends on 1)

The non-transitory computer readable medium of claim 1, wherein, to display the indication, the instructions, when executed by the at least one processor, further cause the at least one processor to:
display the indication of the determined current state of the medical imaging examination on a remote processing device operable by a remote expert.

### Claim 13 (depends on 1)

The non-transitory computer readable medium of claim 1, wherein the instructions, when executed by the at least one processor, further cause the at least one processor to:
establish a natural communication pathway between a local operator performing the medical imaging examination and a remote expert based on the determined current state of the medical imaging examination.

### Claim 14

A method for determining a need for assistance during a medical imaging examination, the method comprising:
acquiring video of the medical imaging examination;
determining, using a state machine, a current state of the medical imaging examination from the acquired video;
displaying an indication of the determined current state of the medical imaging examination; and
identifying a transition from the current state of the medical imaging examination to a next state of the medical imaging examination based on the acquired video and the state machine, wherein the transition indicates the need for assistance during the medical imaging examination.

### Claim 15

The method of 14, wherein the tracking progress includes:
determining a current state of the medical imaging examination based on a user interface (UI) screen detected in the acquired video of the medical imaging examination that corresponds to a UI screen associated with the current state in the state machine;
detecting a transition of the medical imaging examination from the current state of the medical imaging examination by detecting a change in the acquired video feed from the first UI dialog screen to a second UI dialog screen; and
determining a next state of the medical imaging examination based on matching the second UI dialog screen with a UI screen associated with a next state in the state machine for which the state machine has a transition from the current state to the next state.

### Claim 16

The method of 14, wherein the tracking progress includes:
determining a change in content of the acquired video; and
detecting a transition of the medical imaging examination from a current state of the medical imaging examination to a next state of the medical imaging examination based on the detected change in the content of the acquired video.

### Claim 17 (depends on 15)

The method of claim 15, further comprising:
tracking progress of the medical imaging examination using the state machine, wherein the progress is tracked based on matching information extracted from the acquired video to state information of states of the state machine;
determining an assistive action based on at least one of the determined next state or the detected transition and based on the tracked progress of the medical imaging examination; and
performing the assistive action to provide assistance during the medical imaging examination.

### Claim 18 (depends on 17)

The method of claim 17, wherein the assistive action includes establishing a natural communication pathway between a local operator performing the medical imaging examination and a remote expert.

### Claim 19 (depends on 17)

The method of claim 17, wherein the assistive action includes automatically providing at least one of textual, graphical, video, or multimedia guidance respective to a determined event of the medical imaging examination.

### Claim 20

A system for determining a need for assistance during a medical imaging examination the system comprising:
at least one processor operatively coupled to memory, the at least one processor configured to:
acquire video of the medical imaging examination;
determine, using a state machine, a current state of an imaging examination from the acquired video;
display an indication of the determined current state of the imaging examination; and
identify a transition from the current state of the medical imaging examination to a next state of the medical imaging examination based on the acquired video and the state machine, wherein the transition indicates the need for assistance during the medical imaging examination.

### Claim 21 (depends on 1)

The system of claim 1, wherein the at least one processor is further configured to:
detect the transition as a change in content of the acquired video from a first UI dialog screen corresponding to the current state in the state machine to a second UI dialog screen; and
determine the next state of the medical imaging examination by matching the second UI dialog screen with the next state in the state machine.
