Systems and methods for automatic state estimation of a current imaging exam using user actions on a console screen

A method for determining a need for assistance during a medical imaging examination, the method comprising:

• acquiring video of the medical imaging examination;
• determining, using a state machine, a current state of the medical imaging examination from the acquired video;
• displaying an indication of the determined current state of the medical imaging examination;
• and
• identifying a transition from the current state of the medical imaging examination to a next state of the medical imaging examination based on the acquired video and the state machine, wherein the transition indicates the need for assistance during the medical imaging examination.

The method of 14, wherein the tracking progress includes:

• determining a current state of the medical imaging examination based on a user interface (UI) screen detected in the acquired video of the medical imaging examination that corresponds to a UI screen associated with the current state in the state machine;
• detecting a transition of the medical imaging examination from the current state of the medical imaging examination by detecting a change in the acquired video feed from the first UI dialog screen to a second UI dialog screen;
• and
• determining a next state of the medical imaging examination based on matching the second UI dialog screen with a UI screen associated with a next state in the state machine for which the state machine has a transition from the current state to the next state.

A system for determining a need for assistance during a medical imaging examination the system comprising:

• at least one processor operatively coupled to memory, the at least one processor configured to:
• acquire video of the medical imaging examination;
• determine, using a state machine, a current state of an imaging examination from the acquired video;
• display an indication of the determined current state of the imaging examination;
• and
• identify a transition from the current state of the medical imaging examination to a next state of the medical imaging examination based on the acquired video and the state machine, wherein the transition indicates the need for assistance during the medical imaging examination.