# US 12,758,159 B2 · System and method for identifying and integrating digital SSL movement biomarkers

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,758,159 B2
- Document ID: US12758159B2
- Status: Granted
- Kind: B2
- Application number: 19/093,725
- Filed: 2025-03-28
- Published: 2025-08-07
- Granted: 2026-10-13
- Earliest claimed: 2024-03-29
- Assignees: Beneufit, Inc.
- Applicants: Beneufit, Inc.
- Inventors: Jeffery Broderick; Ugenteraan Manogaran
- Web page: https://patentgrep.com/patent/US12758159B2

## CPC

- A61B 5/7267: {involving training the classification device}
- A61B 5/0077: {Devices for viewing the surface of the body, e.g. camera, magnifying lens}
- A61B 5/1128: {using image analysis (A61B5/1127 takes precedence)}
- G06T 7/0012: {Biomedical image inspection}
- G06T 7/246: using feature-based methods, e.g. the tracking of corners or segments
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G16H 10/20: for electronic clinical trials or questionnaires
- G16H 10/60: for patient-specific data, e.g. for electronic patient records
- A61B 2576/00: Medical imaging apparatus involving image processing or analysis (A61B1/00009, A61B6/52 and A61B8/52 take precedence)
- G06T 2200/24: involving graphical user interfaces [GUIs]
- G06T 2207/10016: Video; Image sequence
- G06T 2207/20081: Training; Learning
- G06T 2207/30196: Human being; Person
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA

## Abstract

Disclosed examples relate to a system and method for creating and integrating self-supervised learning (SSL) digital movement biomarkers into electronic health records (EHRs) for enhanced diagnostic support and treatment monitoring, particularly for rare diseases and movement disorders. Example systems employ SSL techniques to analyze video data, tracking body key points and extracting kinematic data without the need for human-labeled annotations. Disclosed examples generate digital movement biomarker profiles that quantify symptoms and track disease progression, facilitating the objective measurement of drug impacts on symptoms. Example systems include components for video processing, compliance checking, pose estimation, context analysis, kinematic measurement, and classification. The digital movement biomarker profiles are stored securely and made accessible for clinical use, offering a novel approach to personalized medicine by enabling the identification of disorder-specific traits and symptom similarities across different disorders.

## Claims

### Claim 1

A system for generating a self-supervised learning (SSL) digital movement biomarker, comprising:
a video input and process configuration component configured to receive video data of a subject;
a compliance engine configured to assess the video data against predefined compliance criteria;
a pose detection component including an SSL model to perform pose estimation and object detection on the video data;
a kinematics component configured to derive kinematic features from the pose estimation;
a digital movement biomarker profile generator configured to create a digital movement biomarker profile based on the kinematic features; and
a data storage and access component configured to store the digital movement biomarker profile,
wherein the digital movement biomarker profile is generated based on movement characteristics identified by the SSL model from the subject's movement in relation to objects detected and segmented within the video environment, independently of pre defined clinical outcome measures.

### Claim 2 (depends on 1)

The system of claim 1, wherein the video input and process configuration component is further configured to convert video data from portrait to landscape orientation.

### Claim 3 (depends on 2)

The system of claim 2, wherein the compliance engine is further configured to detect compliance issues including at least one of: body parts out of frame, excessive camera movement, poor lighting conditions, and presence of multiple people in the video.

### Claim 4 (depends on 3)

The system of claim 3, wherein the SSL model is further trained to predict future body key point positions based on temporal context derived from the video data.

### Claim 5 (depends on 4)

The system of claim 4, wherein the kinematics component is configured to calculate kinematic features including at least one of: velocity, acceleration, angular velocity, and angular acceleration for each body part and joint.

### Claim 6 (depends on 5)

The system of claim 5, wherein the digital movement biomarker profile generator is further configured to assign a significance factor to each movement characteristic, with a scale ranging from a lower score, indicating normal movement, to a higher score, indicating severely impacted movement.

### Claim 7

A method for generating a self-supervised learning (SSL) digital movement biomarker, comprising:
receiving video data of a subject;
assessing the video data for compliance with predefined criteria;
applying an SSL model to the video data to perform pose estimation and object detection;
extracting kinematic features from the pose estimation;
creating a digital movement biomarker profile based at least in art on movement characteristics identified by the SSL model from the subject's movement in relation to objects detected and segmented within the video environment, and storing the digital movement biomarker in a data repository wherein the digital movement biomarker profile is generated independently of pre-defined clinical outcome measures.

### Claim 8 (depends on 7)

The method of claim 7, further comprising converting the video data from portrait to landscape orientation prior to assessing compliance.

### Claim 9 (depends on 8)

The method of claim 8, wherein assessing the video data for compliance includes detecting at least one of: incomplete capture of body parts, excessive camera movement, inadequate lighting, and a presence of additional individuals in the video.

### Claim 10 (depends on 9)

The method of claim 9, further comprising training the SSL model to recognize and classify objects within the video data to provide context to a movement analysis.

### Claim 11 (depends on 10)

The method of claim 10, wherein extracting kinematic features includes calculating at least one of: distance, velocity, acceleration, symmetry, and repetition of body movements.

### Claim 12 (depends on 11)

The method of claim 11, further comprising assigning a significance factor to each identified movement characteristic based on a scale from zero to one hundred.

### Claim 13 (depends on 12)

The method of claim 12, further comprising providing a user interface for clinicians to review and adjust the digital movement biomarker profiles prior to integration with electronic health records.

### Claim 14 (depends on 13)

The method of claim 13, further comprising generating visual representations of the digital movement biomarker profiles to aid clinicians in an interpretation and diagnosis of disorders.

### Claim 15

A system for integrating SSL digital movement biomarker profiles with electronic health records, comprising:
a biomarker profile generation component configured to process video data and generate digital movement biomarker profiles
based on movement characteristics identified by an SSL model from a subject's movement in relation to objects detected and segmented within the video environment, independently of pre-defined clinical outcome measures;
an EHR communication component configured to interface with electronic health records systems using standardized healthcare data exchange protocols;
a data correlation component configured to associate digital movement biomarker profiles with corresponding patient identifiers in the electronic health records;
a profile access component configured to enable clinician access to the correlated digital movement biomarker profiles within the electronic health records; and
wherein the biomarker profile generation component utilizes a self-supervised trained without reliance on pre-defined clinical outcome measures.

### Claim 16 (depends on 15)

The system of claim 15, wherein the EHR communication component employs Health Level Seven (HL7) or Fast Healthcare Interoperability Resources (FHIR) standards for data exchange.

### Claim 17 (depends on 16)

The system of claim 16, wherein the data correlation component further includes a matching algorithm to ensure accurate association of biomarker profiles with patient records.

### Claim 18 (depends on 17)

The system of claim 17, wherein the profile access component includes a user interface designed to display biomarker profiles in conjunction with clinical notes and lab results.

### Claim 19 (depends on 18)

The system of claim 18, wherein the system further comprises a data security component configured to encrypt digital movement biomarker profiles during storage and transmission.
