# US 2016/0260346 A1 · System and computer method providing customizable and real-time input, tracking, and feedback of a trainee's competencies

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2016/0260346 A1
- Document ID: US20160260346A1
- Status: Published application
- Kind: A1
- Application number: 14/635,238
- Filed: 2015-03-02
- Published: 2016-09-08
- Earliest claimed: 2015-03-02
- Assignees: Foundation for Exxcellence In Women's Healthcare, Inc.
- Applicants: Foundation for Exxcellence In Women's Healthcare, Inc.
- Inventors: Taylor Lafrinere; Mario Ashley Rodriguez
- Web page: https://patentgrep.com/patent/US20160260346A1

## CPC

- G09B 19/00: Teaching not covered by other main groups of this subclass (teaching or practice apparatus for gun-aiming or gun-laying F41G3/26)
- G09B 5/06: with both visual and audible presentation of the material to be studied
- G09B 7/02: of the type wherein the student is expected to construct an answer to the question which is presented or wherein the machine gives an answer to the question presented by a student
- G09B 23/28: for medicine
- G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B)

## Abstract

System and computer-implemented method of facilitating real-time competency-based feedback by a trainer to a trainee in a training environment for independent professional practice. An interactive session is initiated during or immediately following an interaction in the training environment for independent professional practice where the trainer observes during the interaction the trainee interacting with a third party. A user, which can be the trainee or trainer, enters a goal or a skill level rating for a competency or procedure in a first blade. A topic indicating the inputted information is published, and a subscriber manager is notified, which instructs a corresponding subscriber to instruct a second blade to refresh a score based on the inputted information. A server calculates a new score based on the inputted information, and only the second blade, but not the first blade, which is decoupled from the second blade, is refreshed to display the new score.

## Claims

### Claim 1

A computer-implemented method of facilitating real-time competency-based feedback by a trainer to a trainee in a training environment for independent professional practice, using a computer, comprising the steps of:
during or immediately following an interaction in the training environment for independent professional practice where the trainer observes during the interaction the trainee interacting with a third party in which a medical service is being rendered to, or a medical procedure is being performed on, the third party by the trainer or by the trainee or by both, initiating an interactive session on a client computer and responsive thereto receiving input from a user interface device of the client computer indicative of at least one goal of a plurality of goals achieved by the trainee during the interactive session and causing to be displayed within a first frame on a display device of the client computer in the setting an indication of the at least one goal achieved, the plurality of goals being associated with a selected competency of a plurality of competencies and each of the plurality of goals being associated with one of a plurality of levels within the selected competency;
publishing a topic indicating that the at least one goal has been achieved and notifying a subscriber manager controlled by a server computer that the input has been received relative to the first frame;
a subscriber in the subscriber manager instructing a second frame to refresh a competency level score based on the received input indicating the at least one goal;
calculating a new competency level score for the selected competency based on the number of goals from among the plurality of goals inputted as being achieved by the trainee, and displaying simultaneously with the first frame, within the second frame on the display device, a representation based on at least the calculated competency level score without refreshing objects displayed in the first frame.

### Claim 2 (depends on 1)

The method of claim 1, further comprising the steps of:
receiving, via the user interface device or another user interface device, authentication credentials associated with the trainee to login the trainee to the interactive session;
responsive to authenticating the authentication credentials associated with the trainee, initiating the interactive session;
after receiving the input from the user interface device and before the publishing, receiving a selection corresponding to a username of the trainer and displaying in the first frame, the second frame, or a further frame, an indication for the trainer to input an authentication credential associated with the trainer;
receiving, via the user interface device or another user interface device, during the interactive session an authentication credential associated with the trainer to login the trainer to the interactive session; and
responsive to authenticating the authentication credential associated with the trainer, receiving, via the user interface device, a confirmation to submit the input indicative of at least one goal and then carrying out the publishing.

### Claim 3 (depends on 1)

The method of claim 1, further comprising the step of:
during the interactive session, in response to receiving from the user input device a selection input selecting an object displayed in a selected frame displayed on the display device, where the selection input requires displaying additional information on the display device, displaying a new frame on the display device immediately adjacent to the selected frame.

### Claim 4 (depends on 3)

The method of claim 3, wherein the selected frame is the first frame or the second frame or a further frame displayed on the display device, and the new frame is another of the first frame or the second frame or the further frame.

### Claim 5 (depends on 4)

The method of claim 4, further comprising the step of:
each time a new frame is added to be displayed on the display device, displaying the new frame immediately adjacent to the last frame that was displayed on the display device, such that all frames displayed on the display device appear in a temporal order in which each such one of the frames was added to be displayed on the display device.

### Claim 6 (depends on 1)

The method of claim 1, further comprising the step of:
during the interactive session, in response to receiving from the user input device an input to close any selected frame among a plurality of frames displayed on the display device, removing from display on the display device the selected frame and all other frames that were displayed after the selected frame.

### Claim 7 (depends on 1)

The method of claim 1, further comprising the step of:
during the interactive session, in response to receiving from the user input device an input made in a selected frame among a plurality of frames displayed on the display device, removing from the display those of the plurality of frames that were added after the selected frame and displaying a new frame immediately adjacent to the selected frame.

### Claim 8 (depends on 1)

The method of claim 1, further comprising the steps of:
displaying on the display device within a third frame a plurality of procedural steps performed within one of a plurality of procedures by the trainee;
receiving input from the user interface device indicative of a skill level rating for a selected one of the plurality of procedural steps;
publishing the inputted skill level rating to the subscriber manager; and
calculating a skill level score for the selected procedure step based on the skill level rating, and displaying simultaneously within the third frame, within a fourth frame whose objects are controlled by a second subscriber on the display device, a representation based on at least the calculated skill level score without refreshing objects displayed in the third frame.

### Claim 9 (depends on 8)

The method of claim 8, further comprising the steps of:
responsive to the interactive session being initiated by receiving authentication credentials associated with the trainee, displaying in the fourth frame an indication for the trainer to input an authentication credential associated with the trainer;
receiving, via the user interface device or another user interface device, during the interactive session an authentication credential associated with the trainer to login the trainer to the interactive session together with the trainee; and
responsive to authenticating the authentication credential associated with the trainer, receiving, via the user interface device, a confirmation to submit the input indicative of the skill level rating, wherein the displaying the representation based on at least the calculated skill level score is carried out responsive to receiving the confirmation to submit the input indicative of the skill level rating.

### Claim 10 (depends on 1)

The method of claim 1, wherein the first frame and the second frame are decoupled from one another.

### Claim 11 (depends on 1)

The method of claim 1, wherein the publisher is decoupled from the subscriber.

### Claim 12

A computer-implemented method of facilitating real-time competency-based feedback from a trainer to a trainee in a training environment for independent professional practice, using a computer, comprising the steps of:
initiating, responsive to authenticating authentication credentials associated with the trainee or responsive to authenticating authentication credentials associated with the trainer, an interactive session on a computer;
during the interactive session, receiving, via a user interface device associated with the computer, inputs indicative of a plurality of goals achieved by the trainee, each of the goals being associated with one of a plurality of competency levels related to the independent professional practice;
responsive to receiving each of the inputs indicative of the plurality of goals achieved by the trainee and during the interactive session, computing a competency level score for the associated one of the competency levels based on those of the goals achieved by the trainee and associated with the associated one of the competency levels, wherein the computing the competency level score is carried out only when the authentication credentials associated with the trainer have been authenticated;
responsive to the computing, displaying on a display device a representation based on at least the competency level score during the interactive session;
during the interactive session, receiving, via the user interface device, inputs indicative of a plurality of skill level ratings each associated with one of a plurality of procedural steps related to the independent professional practice;
responsive to receiving each of the inputs indicative of the plurality of skill level ratings and during the interactive session, computing a skill level score based on those of the skill level ratings for the associated one of the plurality of procedural steps, wherein the computing the skill level score is carried out only when the authentication credentials associated with the trainer have been authenticated;
responsive to the computing, displaying on the display device a representation based on at least the skill level rating during the interactive session; and
responsive to the interactive session being initiated responsive to authenticating the authentication credentials associated with the trainee:
receiving during the interactive session, via the user interface device or another user interface device, authentication credentials associated with the trainer; and
authenticating the authentication credentials associated with the trainer to log the trainer in to the interactive session with the trainee.

### Claim 13 (depends on 1)

The method of claim 1, wherein the representation based on at least the calculated competency level score is a color-coded bar or a progress meter.

### Claim 14 (depends on 13)

The method of claim 13, wherein the representation based on at least the calculated competency level score is also based on at least scoring bias, a frequency of scoring by the trainer, or trend information indicative of an assessment of the trainee's scores or overall progress in the training environment.
