# US 8,771,206 B2 · Interactive virtual care

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 8,771,206 B2
- Document ID: US8771206B2
- Status: Granted
- Kind: B2
- Application number: 13/213,930
- Filed: 2011-08-19
- Published: 2013-02-21
- Granted: 2014-07-08
- Earliest claimed: 2011-08-19
- Assignees: Accenture Global Services Limited
- Applicants: Craig A. Gettelman; Dadong Wan; Ankur Pogula; Ben Reierson; Terrianne Erickson
- Inventors: Craig A. Gettelman; Dadong Wan; Ankur Pogula; Ben Reierson; Terrianne Erickson
- Web page: https://patentgrep.com/patent/US8771206B2

## CPC

- A61B 5/0002: {Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network (endoradiosondes A61B5/07)}
- A61B 3/0041: {characterised by display arrangements}
- A61B 5/0062: {Arrangements for scanning}
- A61B 5/0077: {Devices for viewing the surface of the body, e.g. camera, magnifying lens}
- A61B 5/11: Measuring movement of the entire body or parts thereof, e.g. head or hand tremor or mobility of a limb {(A61B5/1038 takes precedence; motion detection to correct for motion artifacts in physiological signals A61B5/721)}
- A61B 5/1118: {Determining activity level}
- A61B 5/112: {Gait analysis}
- A61B 5/4803: {Speech analysis specially adapted for diagnostic purposes}
- A61B 5/744: {Displaying an avatar, e.g. an animated cartoon character}
- A61B 34/10: Computer-aided planning, simulation or modelling of surgical operations
- A61B 34/25: {User interfaces for surgical systems}
- G06T 7/0014: {using an image reference approach}
- G06V 40/23: {Recognition of whole body movements, e.g. for sport training}
- G16H 10/60: for patient-specific data, e.g. for electronic patient records
- G16H 40/67: for remote operation
- G16H 50/50: for simulation or modelling of medical disorders
- G16H 50/70: for mining of medical data, e.g. analysing previous cases of other patients
- G16Z 99/00: Subject matter not provided for in other main groups of this subclass
- A61B 5/6898: {Portable consumer electronic devices, e.g. music players, telephones, tablet computers}
- A61B 2505/07: Home care
- G06T 2207/10021: Stereoscopic video; Stereoscopic image sequence
- G06T 2207/10028: Range image; Depth image; 3D point clouds
- G06T 2207/30004: Biomedical image processing
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16Z: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS, NOT OTHERWISE PROVIDED FOR

## Abstract

An interactive virtual care system may include a user sensory module to acquire multi-modal user data related to user movement. A data analysis module may compare the multi-modal user data to predetermined historical user data and/or statistical norm data for users to identify an anomaly in the user movement.

## Claims

### Claim 1

An interactive virtual care system comprising:
a user sensory module to acquire multi-modal user data related to user movement of at least one portion of a user's body, wherein the user movement of the at least one portion of the user's body is to be performed at a distance away from the user sensory module, wherein the user sensory module includes a depth camera to acquire the multi-modal user data, and wherein the user sensory module is to provide real-time digitization of the user movement, based on an interpretation of the user movement by the user sensory module, to produce a computer-generated version of the user movement that highlights movement of the at least one portion of the user's body; a responder sensory module to acquire multi-modal responder data related to responder movement performed at a distance away from the responder sensory module; and a data analysis module, executed by a processor, to compare the multi-modal user data to predetermined historical user data and statistical norm data for users, and to compare the multi-modal user data to the multi-modal responder data to identify at least one anomaly in the user movement of the at least one portion of the user's body, wherein for comparison of the multi-modal user data to the predetermined historical user data, a range of the predetermined historical user data is selectable.

### Claim 2 (depends on 1)

The system of claim 1, wherein the user sensory module includes a microphone array to acquire multi-modal user data related to speech.

### Claim 3 (depends on 1)

The system of claim 1, wherein the responder sensory module is disposed at a remote location from a user.

### Claim 4 (depends on 1)

The system of claim 1, further comprising a responder interface module to display the computer-generated version of the user movement, wherein the data analysis module is to further highlight the at least one anomaly in the user movement in the computer-generated version of the user movement for display by the responder interface module.

### Claim 5 (depends on 4)

The system of claim 4, wherein the responder interface module is to further display a real-time version of the user movement at least one of adjacent to and superimposed on the computer-generated version of the user movement.

### Claim 6 (depends on 1)

The system of claim 1, further comprising a user interface module to display the computer-generated version of the user movement and a real-time version of the user movement at least one of adjacent to and superimposed on the computer-generated version of the user movement.

### Claim 7 (depends on 1)

The system of claim 1, further comprising a user interface module to display the computer-generated version of the user movement and highlight the at least one anomaly in the user movement in the computer-generated version of the user movement.

### Claim 8 (depends on 1)

The system of claim 1, wherein the user movement includes walking.

### Claim 9 (depends on 1)

The system of claim 1, wherein the responder sensory module is to further acquire the multi-modal responder data related to responder movement of at least one portion of a responder's body, wherein the responder movement of the at least one portion of the responder's body is to be performed at the distance away from the responder sensory module.

### Claim 10 (depends on 1)

The system of claim 1, further comprising a user interface module to display the computer-generated version of the user movement and a real-time version of the user movement superimposed on the computer-generated version of the user movement.

### Claim 11 (depends on 1)

The system of claim 1, wherein the computer-generated version of the user movement includes at least one of joints of the user's body displayed as connectors and bones of the user's body displayed as line segments between the connectors.

### Claim 12 (depends on 1)

The system of claim 1, wherein the highlights of movement of the at least one portion of the user's body include a computer-generated display of at least one internal feature of the at least one portion of the user's body.

### Claim 13 (depends on 1)

The system of claim 1, wherein the predetermined historical user data and statistical norm data for users respectively include computer-generated versions of movements of the at least one portion of the user's body and movements of the at least one portion of bodies of the users.

### Claim 14

A method for interactive virtual care, the method comprising: acquiring multi-modal user data related to user movement of at least one portion of a user's body by using a user sensory module, wherein the user movement of the at least one portion of the user's body is to be performed at a distance away from the user sensory module; performing real-time digitization of the user movement, based on an interpretation of the user movement, to produce a computer-generated version of the user movement that highlights movement of the at least one portion of the user's body; acquiring multi-modal responder data related to responder movement performed at a distance away from a responder sensory module; comparing, by a processor, the multi-modal user data to predetermined historical user data and statistical norm data for users, and the multi-modal user data to the multi-modal responder data, to identify at least one anomaly in the user movement of the at least one portion of the user's body, wherein for comparison of the multi-modal user data to the predetermined historical user data, a range of the predetermined historical user data is selectable; displaying the computer-generated version of the user movement with the highlights of movement of the at least one portion of the user's body; and highlighting the at least one anomaly in the user movement in the computer-generated version of the user movement.

### Claim 15 (depends on 14)

The method of claim 14, further comprising:
displaying a real-time version of the user movement at least one of adjacent to and superimposed on the computer-generated version of the user movement.

### Claim 16 (depends on 14)

The method of claim 14, further comprising:
generating metrics related to a degree of the anomaly in the user movement of the at least one portion of the user's body.

### Claim 17 (depends on 14)

The method of claim 14, further comprising:
displaying a real-time version of the user movement superimposed on the computer-generated version of the user movement.

### Claim 18

A non-transitory computer readable medium having stored thereon a computer executable program to provide interactive virtual care, the computer executable program when executed causes a computer system to: acquire multi-modal user data related to user movement of at least one portion of a user's body by using a user sensory module, wherein the user movement of the at least one portion of the user's body is to be performed at a distance away from the user sensory module; perform real-time digitization of the user movement, based on an interpretation of the user movement, to produce a computer-generated version of the user movement that highlights movement of the at least one portion of the user's body; acquire multi-modal responder data related to responder movement performed at a distance away from a responder sensory module; compare, by a processor, the multi-modal user data to predetermined historical user data and statistical norm data for users, and the multi-modal user data to the multi-modal responder data, to identify at least one anomaly in the user movement of the at least one portion of the user's body, wherein for comparison of the multi-modal user data to the predetermined historical user data, a range of the predetermined historical user data is selectable; display the computer-generated version of the user movement with the highlights of movement of the at least one portion of the user's body; and highlight the at least one anomaly in the user movement in the computer-generated version of the user movement.

### Claim 19

A method for interactive virtual care, the method comprising: acquiring multi-modal user data related to user movement of at least one portion of a user's body by using a user sensory module, wherein the user movement of the at least one portion of the user's body is to be performed at a distance away from the user sensory module; performing real-time digitization of the user movement, based on an interpretation of the user movement, to produce a computer-generated version of the user movement that highlights movement of the at least one portion of the user's body; comparing, by a processor, the multi-modal user data to predetermined historical user data and statistical norm data for users to identify at least one anomaly in the user movement of the at least one portion of the user's body, wherein for comparison of the multi-modal user data to the predetermined historical user data, a range of the predetermined historical user data is selectable; displaying the computer-generated version of the user movement with the highlights of movement of the at least one portion of the user's body; highlighting the at least one anomaly in the user movement in the computer-generated version of the user movement; and displaying predetermined user data for viewing by the user without receiving the predetermined user data.

### Claim 20

A method for interactive virtual care, the method comprising: acquiring multi-modal user data related to user movement of at least one portion of a user's body by using a user sensory module, wherein the user movement of the at least one portion of the user's body is to be performed at a distance away from the user sensory module; performing real-time digitization of the user movement, based on an interpretation of the user movement, to produce a computer-generated version of the user movement that highlights movement of the at least one portion of the user's body; comparing, by a processor, the multi-modal user data to predetermined historical user data and statistical norm data for users to identify at least one anomaly in the user movement of the at least one portion of the user's body, wherein for comparison of the multi-modal user data to the predetermined historical user data, a range of the predetermined historical user data is selectable; displaying the computer-generated version of the user movement with the highlights of movement of the at least one portion of the user's body; highlighting the at least one anomaly in the user movement in the computer-generated version of the user movement; and displaying predetermined user data for viewing by a responder without receiving the predetermined user data.
