# US 2025/0095849 A1 · System and method for optimizing operations of a radiology service using ai powered gamification

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0095849 A1
- Document ID: US20250095849A1
- Status: Published application
- Kind: A1
- Application number: 18/588,468
- Filed: 2024-02-27
- Published: 2025-03-20
- Earliest claimed: 2023-09-18
- Assignees: Siemens Healthineers AG
- Applicants: Siemens Healthineers AG
- Inventors: Vivek Singh; Ankur Kapoor; Ingo Schmuecking; Scott Steingall; David Scholl; Dorin Comaniciu
- Web page: https://patentgrep.com/patent/US20250095849A1

## CPC

- G16H 40/20: for the management or administration of healthcare resources or facilities, e.g. managing hospital staff or surgery rooms
- G16H 50/20: for computer-aided diagnosis, e.g. based on medical expert systems
- G06N 3/006: based on simulated virtual individual or collective life forms, e.g. social simulations or particle swarm optimisation [PSO]
- G06N 20/00: Machine learning
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

Systems and methods for managing patient diagnostic and therapy workflows in a hospital and/or radiology centers. A radiology recommendation agent is trained using reinforcement learning and a simulation environment in which the agent takes actions and receives feedback from the simulation environment based on how its action affect the simulation environment over time.

## Claims

### Claim 1

An AI powered gamification method for radiology center management, the method comprising:
generating a simulation environment of a radiology center, the
training an agent using the simulation environment in which the agent takes actions and receives feedback from the simulation environment based on how its action affect the simulation environment over time; and
implementing the agent to provide real time recommendations that optimize the operation of the radiology system.

### Claim 2 (depends on 1)

The method of claim 1, wherein the simulation environment comprises radiology scheduling, planning, diagnostics, and therapy workflows in the radiology center.

### Claim 3 (depends on 1)

The method of claim 1, wherein the feedback from the simulation environment comprises one or more reward values related to estimated key performance indicators.

### Claim 4 (depends on 3)

The method of claim 3, wherein the estimated key performance indicators comprise at least one of reducing the patient wait times upon arrival, increasing throughput of patients and reducing the time to exam, keeping the staff utilization within a desirable range, and equipment utilization high.

### Claim 5 (depends on 3)

The method of claim 3, wherein the estimated key performance indicators are derived from real world results of actions used to generate the simulation environment.

### Claim 6 (depends on 1)

The method of claim 1, further comprising:
continuously re-training the agent with new data from the physical world.

### Claim 7 (depends on 1)

The method of claim 1, wherein the simulation environment comprises a Markov process defined over a state of physical entities and dynamics defined via state transition functions.

### Claim 8 (depends on 7)

The method of claim 7, wherein generating the simulation environment comprises:
iteratively refining state representations and state transition functions until a reality gap between the forecasted observations based on a world model and observed data is statistically small.

### Claim 9 (depends on 1)

The method of claim 1, wherein the simulation environment further comprises at least a patient specific model including an age, gender, and location of the patient.

### Claim 10 (depends on 1)

The method of claim 1, wherein the agent is modeled as a single agent that estimates the state of the world, take actions, and receives rewards based on whether the simulation environment evolves favorably or not.

### Claim 11 (depends on 1)

The method of claim 1, further comprising:
training an adversarial agent to perturb the simulation environment parameters such that the adversarial agent receives a reward when the agent fails to improve one or more key performance indicators when performing an action in the simulation environment.

### Claim 12 (depends on 1)

The method of claim 1, wherein a plurality of agents are trained to operate and generate recommendations collaboratively.

### Claim 13

A system for radiology center management, the system comprising:
an agent configured to provide recommendations for radiology scheduling and operations, the agent trained using reinforcement learning and a simulation environment in which the agent takes actions and receives feedback from the simulation environment based on how its action affect the simulation environment over time; and
a graphical user interface configured to output the recommendations to a radiology operator.

### Claim 14 (depends on 13)

The system of claim 13, wherein the wherein the feedback from the simulation environment comprises one or more reward values related to estimated key performance indicators.

### Claim 15 (depends on 14)

The system of claim 14, wherein the estimated key performance indicators comprise at least one of reducing the patient wait times upon arrival, increasing throughput of patients and reducing the time to exam, keeping the staff utilization within a desirable range, and equipment utilization high.

### Claim 16 (depends on 13)

The system of claim 13, wherein the agent is modeled as a single agent that estimates the state of the world, take actions, and receives rewards based on whether the simulation environment evolves favorably or not.

### Claim 17 (depends on 13)

The system of claim 13, wherein a plurality of agents are trained to operate and generate recommendations collaboratively.

### Claim 18

A system for radiology center management, the system comprising:
a medical imaging device configured to scan a patient;
a scheduling system configured to schedule the scan and radiology personal for the scan; and
a radiology recommendation agent configured to recommend one or more actions for the scheduling system and the medical imaging device, the radiology recommendation agent trained using reinforcement learning and a simulation environment in which the agent takes actions and receives feedback from the simulation environment based on how its action affect the simulation environment over time.

### Claim 19 (depends on 18)

The system of claim 18, wherein the medical imaging device comprises a CT scanning system.

### Claim 20 (depends on 18)

The system of claim 18, wherein the radiology recommendation agent is further configured to recommend follow up actions for the patient based on results of the scan.
