# US 2008/0187896 A1 · Multimodal Medical Procedure Training System

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2008/0187896 A1
- Document ID: US20080187896A1
- Status: Published application
- Kind: A1
- Application number: 11/720,515
- Filed: 2005-11-30
- Published: 2008-08-07
- Earliest claimed: 2004-11-30
- Assignees: The Regents of the University of California
- Inventors: Eric A. Savitsky
- Web page: https://patentgrep.com/patent/US20080187896A1

## CPC

- G09B 23/288: {for artificial respiration or heart massage}
- G09B 23/28: for medicine
- G09B 23/285: {for injections, endoscopy, bronchoscopy, sigmoidscopy, insertion of contraceptive devices or enemas}
- G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B)

## Abstract

The present invention teaches a medical procedure training system based on a PC platform that provides multimodal education within a virtual environment. The system integrates digital video, three-dimensional modeling, and force-feedback devices for the purpose of training medical professionals medical procedures.

## Claims

### Claim 1

A medical procedure training system comprising:
a control device;
a graphical interface connected to the control device providing a plurality of interface sections, wherein a first interface section displays a digital video and a second interface section displays a three-dimensional anatomical model; and
a user input device connected to the control device, wherein at least one of the three-dimensional anatomical model and the digital video displayed by the graphical interface varies at least indirectly in dependence upon signals provided by the user input device, wherein the system is configured to at least partially simulate medical procedures through system feedback.

### Claim 2 (depends on 1)

The system according to claim 1, wherein the plurality of interface sections include a digital video section, an anatomical section, an interactive three-dimensional model section and a library access section.

### Claim 3 (depends on 1)

The system according to claim 1, wherein the system has two graphical interfaces, wherein a first graphical interface displays a three-dimensional model and a second graphical interface displays a digital video.

### Claim 4 (depends on 1)

The system according to claim 1, further comprising a mechanical tracking device connected to the computer, wherein the mechanical tracking device simulates a medical tool.

### Claim 5 (depends on 1)

The system according to claim 1, further comprising a motion sensor connected to the control device for sensing motion of the first mechanical device, wherein the control device processes and relays motion data to the graphical interface.

### Claim 6 (depends on 2)

The medical procedure training system according to claim 2, wherein the anatomical section comprises data created from a CT scan.

### Claim 7 (depends on 2)

The medical procedure training system according to claim 2, wherein the anatomical section comprises data created from an MRI scan.

### Claim 8 (depends on 2)

The medical procedure training system according to claim 2, wherein the anatomical section comprises data created from ultrasound images.

### Claim 9 (depends on 1)

The medical procedure training system according to claim 1, wherein the digital video has been recorded from scanning a live subject and applied to the three-dimensional model.

### Claim 10 (depends on 1)

The medical procedure training system according to claim 1, wherein the central device is a Windows-based computer.

### Claim 11 (depends on 1)

The system according to claim 1, wherein the three-dimensional model has user selectable views, wherein the user may visually remove anatomical relevant data from the graphical computer interface thereby allowing a different three-dimensional view.

### Claim 12 (depends on 1)

The system according to claim 1, wherein the system is a platform for simulating medical procedures.

### Claim 13 (depends on 12)

The system according to claim 12, wherein simulated medical procedures are selected from the group consisting of Anoscopy, central line placement, cricothyrodotomy, Anterior and Posterior Nasal packing, arterial cannulation, arterial blood gas, arthrocentesis, bladder catheterization, cadiac massage, cardiac massage, cardiac placing/cardioversion, contrast injection for imaging, endotracheal intubation, foreign body removal from cornea, fracture reduction, incision and drainage of abscess, intraosseous line placement, local anesthesia, lumbar puncture, nail trephination, needle thorascotomy, nerve blocks, nasogastric tube placement, percutaneous transtracheal ventilation, pericardiocentesis, peripheral intravenous line placement, thoracentesis, tube thoracostomy, and venous cutdown.

### Claim 14 (depends on 12)

The system according to claim 12, wherein a medical procedure is selected from a group consisting of endotracheal intubation, cricothyroidotomy, venous cutdowns, central venous catheter placement, Foley catheter insertion, splinting of fractures, fracture reduction, thoracostomy tube placement, arthrocentesis, alteral canthotomy, cantholysis, and emergency thoracotomy.

### Claim 15 (depends on 1)

The system according to claim 1, further comprising a memory storage device having a library of medical data linked to simulated medical procedures, wherein the user may access the library during a training procedure.

### Claim 16 (depends on 1)

The system according to claim 1, further comprising a memory storage device, wherein user performance data is stored in the memory storage device.

### Claim 17 (depends on 1)

The system according to claim 1, wherein the user input device is a force-feedback device.

### Claim 18 (depends on 12)

The system according to claim 12, wherein the platform is multimodal and is configured to track a progression of a medical procedure based upon user input.

### Claim 19 (depends on 18)

The system according to claim 18, wherein the graphical interface displays dynamic images corresponding to a user input device as a user navigates through the simulated medical procedure.

### Claim 20 (depends on 16)

The system according to claim 16, wherein the force-feedback device simulates a medical tool and receives instructions from the computer based upon user defined input.

### Claim 21 (depends on 1)

The system according to claim 1, wherein the system is a desktop virtual reality system.

### Claim 22 (depends on 1)

The system according to claim 1, wherein the system is a multimodal virtual reality medical procedure training system.

### Claim 23 (depends on 1)

The system according to claim 1, wherein the three-dimensional anatomical image can be altered by a user.

### Claim 24 (depends on 20)

The system according to claim 20, wherein the three-dimensional model is selected by the user to simulate an abnormal or diseased individual.

### Claim 25 (depends on 1)

The system according to claim 1, wherein the system comprises at least two user input devices.

### Claim 26 (depends on 25)

The system according to claim 25, wherein the system comprises a first user input device and a second user input device.

### Claim 27 (depends on 26)

The system according to claim 26, wherein the first user input device is a force-feedback device.

### Claim 28 (depends on 27)

The system according to claim 27, wherein the force-feedback device simulates a first medical tool and a second user input device simulates a second medical tool.

### Claim 29 (depends on 28)

The system according to claim 28, wherein the force-feedback device simulates a combination needle and syringe, and the second user input device simulates a ultrasound probe.

### Claim 30 (depends on 28)

The system according to claim 28, wherein the plurality of interface sections include a digital video section corresponding to the orientation of the second user input device, an interactive three-dimensional model section corresponding to the first user input device in relation to an anatomical model, and a library access section for accessing data stored in a memory storage device.

### Claim 31 (depends on 30)

The system according to claim 30, wherein the library access section contains data accessed from an online source.

### Claim 32 (depends on 30)

The system according to claim 30, wherein the library access section contains medical data.

### Claim 33 (depends on 29)

The system according to claim 29, wherein the control device is a laptop PC.

### Claim 34

A method of operating a multimodal medical training system, comprising the steps of:
selecting a first simulated medical procedure from a library;
displaying images on a graphical interface, wherein the images correspond to the simulated medical procedure;
receiving a first input from a first user input device, wherein the first user input device is a simulated medical tool;
processing the first input in relation to the simulated medical procedure;
modifying images corresponding to the first user input device;
receiving a second input from a second user input device, wherein the second user input device is a force-feedback device simulating a medical tool;
processing the second input in relation to the simulated medical procedure;
modifying images corresponding to the second user input device;
providing force-feedback signals to the second user input device;
receiving input from the second user input device based upon the force-feedback signals; and
determining whether the simulated medical procedure reached a desired end point.

### Claim 35 (depends on 34)

The method according to claim 34, wherein the first device is a simulated ultrasound probe and the images corresponding to the first device are actual ultrasound images previously recorded.

### Claim 36 (depends on 34)

The method according to claim 34, wherein the images displayed by the graphical interface include a digital video section, an anatomical section, and an interactive three-dimensional model section.

### Claim 37 (depends on 34)

The method according to claim 34, wherein the simulated medical procedure is selected from the group consisting of Anoscopy, central line placement, cricothyrodotomy, Anterior and Posterior Nasal packing, arterial cannulation, arterial blood gas, arthrocentesis, bladder catheterization, cadiac massage, cardiac massage, cardiac placing/cardioversion, contrast injection for imaging, endotracheal intubation, foreign body removal from cornea, fracture reduction, incision and drainage of abscess, intraosseous line placement, local anesthesia, lumbar puncture, nail trephination, needle thorascotomy, nerve blocks, nasogastric tube placement, percutaneous transtracheal ventilation, pericardiocentesis, peripheral intravenous line placement, thoracentesis, tube thoracostomy, and venous cutdown.
