US 9,754,512 B2 · Real-time feedback of task performance

Abstract

A method of providing real-time feedback of task performance includes receiving sensor data from sensors coupled to an object. The sensor data is received in response to tasks performed on the object and references positional data with respect to a location on the object at which tasks are performed. The method also includes applying the sensor data to a model of performance measurements, which reflect a standard of performance. The method further includes identifying any deviations of the sensor data from data in the model, and outputting feedback in real-time. The feedback includes indicators signaling tasks performed are correctly implemented and indicators signaling tasks performed are incorrectly implemented. Corrective indicators include measures for modifying task performance to achieve an outcome that approaches or meets the standard of performance. The indicators correspond to one or more locations on the object as determined by the positional data.

Claims26

Dependent claims

A method of providing real-time instructional information relating to task performance, comprising:

receiving sensor data from sensors coupled to a physical object, the sensor data received at a computer in response to a task performed on the physical object by a subject, the sensor data referencing positional data with respect to a location on the physical object to which the task is performed;
applying the sensor data to a model of performance with respect to the task;
receiving, at the computer, video data of the subject performing the task;
calculating at least one performance value resulting from applying the sensor data to the model;
and
outputting instructional information in real-time to the subject via at least one output device, wherein the computer derives the instructional information based on the at least one performance value and the video data such that the instructional information comprises:
indicators signaling whether the task was performed on the physical object in accordance with the model;
and
a representation of a human exhibiting a behavior that is a response to performance of the task by the subject on the human.

6 more elements

A system for providing real-time instructional information relating to task performance, the system comprising:

a computer;
sensors coupled to a physical object and in communication with the computer, wherein the physical object comprises, at least in part a simulated human anatomy;
and
an output device in communication with the computer, wherein the computer is configured to implement a method comprising:
receiving sensor data from the sensors, the sensor data received in response to a task performed on the physical object by a subject, the sensor data referencing positional data with respect to a location on the physical object to which the task is performed;
determining based on the sensor data an indication of performance of the task by comparing the sensor data to a model of performance;
determining, based on the indication of performance, at least one of an audio feedback element and a visual feedback element that is a representation of a human exhibiting a behavior responding to the task being performed on the human;
and
outputting, to the subject via the output device in real-time during performance of the task by the subject on the physical object, the representation of the human.

6 more elements

A method of providing a mixed environment for learning a medical procedure, wherein the mixed environment comprises at least one physical object representing a patient with which a subject interacts physically and at least one computer generated display visible to the subject, the method comprising:

determining physical interactions between the subject and the at least one physical object during performance of a simulated medical procedure;
with at least one computing device, assessing performance of the medical procedure by the subject based on comparing the determined physical interactions to a model of performance, and determining, based on the assessed performance of the medical procedure by the subject, at least one feedback element representing behavior of a human in response to the physical interactions;
and
concurrently rendering to the subject:
instructional information based on the assessed performance;
and
the at least one feedback element as simulated behavior of the patient during performance of the medical procedure.

4 more elements

Dependencies are inferred from the claim text.

Real-time feedback of task performance

Life of this patent

Real-time feedback of task performance

Life of this patent

Abstract

Claims26