# US 2013/0093829 A1 · Instruct-or

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2013/0093829 A1
- Document ID: US20130093829A1
- Status: Published application
- Kind: A1
- Application number: 13/629,257
- Filed: 2012-09-27
- Published: 2013-04-18
- Earliest claimed: 2011-09-27
- Assignees: Allied Minds Devices LLC
- Inventors: Peter L. Rosenblatt; Omar Amirana; David S. Park; Thomas J. DiBartholomeo; Paul S. Jin; Charles W. Wilson; Daniel J. Keldsen
- Web page: https://patentgrep.com/patent/US20130093829A1

## CPC

- G06Q 10/00: Administration; Management
- G06T 7/0012: {Biomedical image inspection}
- G09B 5/00: Electrically-operated educational appliances (working with questions and answers G09B7/00; simulators G09B9/00; advertising or displaying in general G09F)
- G16H 20/40: relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture
- G16H 40/20: for the management or administration of healthcare resources or facilities, e.g. managing hospital staff or surgery rooms
- G16H 40/63: for local operation
- G16H 40/67: for remote operation
- G16H 70/20: relating to practices or guidelines
- H04N 7/14: Systems for two-way working ({H04N7/12, } H04N7/173 take precedence)
- H04N 7/18: Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B)
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

In embodiments, the present invention provides methods and systems for providing remote real-time guidance for a procedure with a device. The method and systems may include providing a user guidance application executing on a system during the procedure. The methods and systems may be enabled to receive voice commands, and may include providing a step-by-step guidance from a remote human specialist through the steps required to complete a procedure with a device. The systems and methods may include, displaying on the system, procedure reference material associated with the procedure and accessible to the user to assist the user in the use of the device.

## Claims

### Claim 1

A method of providing a remote real-time guidance for a procedure with a device, comprising:
providing a user guidance application executing on a system during the procedure, wherein the system is enabled to receive voice commands, and comprising:
providing a step-by-step guidance from a remote human specialist through the steps required to complete the procedure with the device; and
displaying on the system procedure reference material associated with the procedure and accessible to the user to assist the user in the use of the device.

### Claim 2 (depends on 1)

The method of claim 1, wherein the procedure takes place in an operating room.

### Claim 3 (depends on 1)

The method of claim 1, wherein the procedure reference material comprises at least one of text, audio, video, animations, and still image content.

### Claim 4 (depends on 1)

The method of claim 1, wherein step-by-step guidance comprises step-by-step training.

### Claim 5 (depends on 1)

The method of claim 1, wherein the system further comprises at least one of a tablet device, a computer, a laptop, an audio/visual system, a mobile device, and a handheld device.

### Claim 6 (depends on 5)

The method of claim 5, wherein the system further comprises at least one of a joystick a foot pedal, a microphone, a camera, a keyboard, virtual keyboard, headset, microphone enabled mask, voice recognition facility, and a voice command facility.

### Claim 7 (depends on 1)

The method of claim 1, wherein the system is further adapted to provide at least one of text chat capability, audio chat capability, and video chat capability.

### Claim 8 (depends on 1)

The method of claim 1, wherein the device is at least one of a medical device, a telecommunications system device, a mechanical tool, a maintenance device, a diagnostic device, and chemical treatment device.

### Claim 9

A procedure execution capture system for logging information, comprising:
a voice command facility adapted to receive a voice command during a procedure using a device and to control the procedure execution system in response to the voice command;
an information associating facility for recording information during the procedure and associating the information with one or more steps undertaken in a workflow for the procedure; and
wherein the information is time-stamped information about the steps undertaken during the procedure.

### Claim 10 (depends on 9)

The system of claim 9, wherein the time stamped information is comprised of data related to a medical procedure.

### Claim 11 (depends on 9)

The system of claim 9, wherein the information comprises contextual information about at least one of a patient, a user, the device, and the procedure.

### Claim 12 (depends on 9)

The system of claim 9, further comprising a medical device support communication system for providing an interaction between a practitioner performing the procedure with the device and a specialist having expertise in the use of the device, comprising:
a live video communications facility enabled to provide a live video communication between the practitioner and the device specialist.

### Claim 13 (depends on 9)

The system of claim 9, wherein the information further comprises status information of the one or more steps undertaken in a workflow for the procedure.

### Claim 14 (depends on 9)

The system of claim 9, wherein the system further comprises a data analyzer facility to associate the time-stamped information with data associated with at least one of the outcome of the procedure, the duration of steps undertaken, a practitioner, a medical practice, and the device used.

### Claim 15 (depends on 9)

The system of claim 9, further comprising a feedback system to improve at least one of:
a medical device, a medical procedure, a medical practitioner, and a medical practice.

### Claim 16

A support communication system for providing an interaction between a user and a specialist having expertise in a device, comprising:
a live video communications facility enabled to provide a live video communication; and
a tablet interface presenting the video communications facility, a workflow associated with the device, and content related to the usage of the device, wherein the live video communication comprises an interaction between the user and the specialist during the procedure for assisting the user in completing the workflow.

### Claim 17 (depends on 16)

The support communication system of claim 16, further comprising a privacy system, comprising:
a video capture facility to encode and decode live video;
an obfuscation facility to modify the live video by obfuscating a person's identity; and
an obfuscated video communication facility to communicate the modified live video.

### Claim 18 (depends on 16)

The support communication system of claim 16, wherein the live video communication further comprises a live text, and audio communication.

### Claim 19 (depends on 16)

The support communication system of claim 16, wherein the workflow is a medical procedure and said workflow is stored in one of a cloud or in a server in a hospital.

### Claim 20 (depends on 16)

The support communication system of claim 16, wherein the support communication system further comprises a mask worn by the user wherein said mask comprises:
a mask communications facility to connect the mask to another device; and
a microphone adapted to receive and transmit voice commands for communication between the user and specialist via said another device.
