# US 2023/0055990 A1 · Systems and methods for providing digital health services

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0055990 A1
- Document ID: US20230055990A1
- Status: Published application
- Kind: A1
- Application number: 17/891,086
- Filed: 2022-08-18
- Published: 2023-02-23
- Earliest claimed: 2021-08-18
- Assignees: Advanced Neuromodulation Systems, Inc.
- Applicants: Advanced Neuromodulation Systems, Inc.
- Inventors: Erika Ross; Mary Khun Hor-Lao; Binesh Balasingh; Scott DeBates; Doug Lautner; Kyuwan Choi
- Web page: https://patentgrep.com/patent/US20230055990A1

## CPC

- A61N 1/37282: {characterised by communication with experts in remote locations using a network}
- A61B 5/0002: {Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network (endoradiosondes A61B5/07)}
- A61B 5/1101: {Detecting tremor}
- A61B 5/1114: {Tracking parts of the body}
- A61B 5/1118: {Determining activity level}
- A61B 5/112: {Gait analysis}
- A61B 5/4082: {Diagnosing or monitoring movement diseases, e.g. Parkinson, Huntington or Tourette}
- A61B 5/7267: {involving training the classification device}
- A61B 5/742: {using visual displays (displays for heart-related electrical signals, e.g. ECG, A61B5/339)}
- A61B 5/7455: {characterised by tactile indication, e.g. vibration or electrical stimulation}
- A61N 1/36135: {using physiological parameters}
- A61N 1/37247: {User interfaces, e.g. input or presentation means}
- A61N 1/37264: {Changing the program; Upgrading firmware}
- G06F 21/6245: {Protecting personal data, e.g. for financial or medical purposes}
- G06F 21/6254: {by anonymising data, e.g. decorrelating personal data from the owner's identification}
- G06T 11/00: Two-dimensional [2D] image generation
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G06V 10/82: using neural networks
- G06V 40/25: {Recognition of walking or running movements, e.g. gait recognition}
- G16H 20/30: relating to physical therapies or activities, e.g. physiotherapy, acupressure or exercising
- G16H 30/40: for processing medical images, e.g. editing
- G16H 40/40: for the management of medical equipment or devices, e.g. scheduling maintenance or upgrades
- G16H 40/67: for remote operation
- G16H 50/20: for computer-aided diagnosis, e.g. based on medical expert systems
- G16H 50/30: for calculating health indices; for individual health risk assessment
- G16H 80/00: ICT specially adapted for facilitating communication between medical practitioners or patients, e.g. for collaborative diagnosis, therapy or health monitoring
- H04N 5/272: Means for inserting a foreground image in a background image, i.e. inlay, outlay
- H04N 7/141: {between two video terminals, e.g. videophone (telephonic communication systems combined with television receiver for reception of entertainment or information matter H04M11/085)}
- H04N 7/147: {Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals (selecting H04Q)}
- A61N 1/36067: {Movement disorders, e.g. tremor or Parkinson disease (stimulating motor muscle A61N1/36003)}
- A61N 1/36071: {Pain}
- A61N 1/36132: {using patient feedback}
- G06T 2210/41: Medical
- A61N: ELECTROTHERAPY; MAGNETOTHERAPY; RADIATION THERAPY; ULTRASOUND THERAPY (measurement of bioelectric currents A61B; surgical instruments, devices or methods for transferring non-mechanical forms of energy to or from the body A61B18/00; anaesthetic apparatus in general A61M; incandescent lamps H01K; infrared radiators for heating H05B)
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

The present disclosure is directed to providing digital health services. In some embodiments, systems and methods for conducting virtual or remote sessions between patients and clinicians are disclosed. During the sessions, media content (e.g., images, video content, audio content, etc.) may be captured as the patient performs one or more tasks. The media content may be presented to the clinician and used to evaluate a condition of the patient or a state of the condition, adjust treatment parameters, provide therapy, or other operations to treat the patient. The analysis of the media content may be aided by one or more machine learning/artificial intelligence models that analyze various aspects of the media content, augment the media content, or other functionality to aid in the treatment of the patient.

## Claims

### Claim 1

A method of remotely programming an implantable medical device that provides therapy to a patient, comprising:
establishing a first communication between a patient controller (PC) device and the implantable medical device, wherein the implantable medical device provides therapy to the patient according to one or more programmable parameters, the PC device communicates signals to the implantable medical device to set or modify the one or more programmable parameters, and the PC device comprises a video camera;
establishing a video connection between the PC device and a clinician programmer (CP) device of a clinician for a remote programming session in a second communication that includes an audio/video (A/V) session;
communicating a value for a respective programmable parameter of the medical device from the CP device to the PC device during the remote programming session; and
modifying, by the PC device, the respective programming parameter of the medical device according to the communicated value from the CP device during the remote programming session;
wherein the method further comprises:
automatically analyzing, by one or more processors, video data of the patient from the A/V session to identify a plurality of landmark points on a face of the patient indicative of facial expression of the patient;
processing data related to the landmark points to identify a first metric representing a ratio of a first area on a first side of the facial expression and a second area on a second side of the facial expression;
processing data related to the landmark points to identify a plurality of second metrics with each second metric representing a ratio of distances across the facial expression of the patient;
providing the first and second metrics to a trained neural network to generate a patient metric indicative of patient condition; and
displaying the patient metric using the CP device during the remote programming session.

### Claim 2 (depends on 1)

The method of claim 1 wherein the patient metric is related to a chronic pain state of the patient.

### Claim 3 (depends on 2)

The method of claim 2 further comprising:
detecting asymmetry in the facial expression of the patient.

### Claim 4 (depends on 1)

The method of claim 1 wherein the patient metric is related to a motor disorder state of the patient.

### Claim 5 (depends on 2)

The method of claim 2 comprising detecting a blank affect of the patient with a motor disorder.

### Claim 6

The method of claim further comprising:
processing a timeline of video data according to a sliding time window processing operation and repeating calculation of the first and second metrics for each time window of the sliding time window processing operation.

### Claim 7 (depends on 6)

The method of claim 6 further comprising:
identifying frames of video where a probability of accurate classification exceeds a predetermined level.

### Claim 8 (depends on 7)

The method of claim 7 further comprising:
modifying a video stream for frames of video to display the patient metric for the identified frames.

### Claim 9 (depends on 6)

The method of claim 6 further comprising:
identifying frames of video where a probability of accurate classification fails to exceed a predetermined level.

### Claim 10 (depends on 9)

The method of claim 9 further comprising:
omitting display the patient metric for the identified frames.

### Claim 11 (depends on 1)

The method of claim 1 wherein the distances across the facial expression of the patient comprises a distance along an approximate vertical midline of a face of the patient.

### Claim 12 (depends on 1)

The method of claim 1 wherein the distances across the facial expression of the patient comprises a horizontal distance along the approximate middle of a face of the patient.

### Claim 13 (depends on 1)

The method of claim 1 wherein the first and second areas are areas identified as disposed under a respective eye, on a respective side of a nose of the patient, and above a mouth of the patient.

### Claim 14 (depends on 1)

The method of claim 1 further comprising:
receiving user input from a clinician to toggle between video augmented with one or more graphical user interface (GUI) components modified according to the calculated patient metric and a video stream without display of the one or more GUI components.

### Claim 15 (depends on 1)

The method of claim 1 further comprising:
displaying, by the CP device, one or more graphical user interface (GUI) components defined by identified landmarks over a display of the patient in a video stream during the A/V session.
