US 2020/0051446 A1 · CLASSIFICATION OF MUSCULOSKELETAL FORM USING MACHINE LEARNING MODEL

Abstract

An exercise feedback system receives exercise data such as images or video captured by client devices of users performing exercises. The exercise feedback system may access a machine learning model trained using image of a population of users. The images used for training may be labeled, for example, as having proper or improper musculoskeletal form. The exercise feedback system may determine a metrics describing the musculoskeletal form of a user by applying the trained machine learning model to images of the user as input features. The exercise feedback system may generate feedback for a certain exercise using the metrics based on output predictions of the model. The feedback can be provided to a client device of the user or a physical therapist for presentation.

Claims20

Dependent claims

A method comprising:

receiving one or more images captured by a camera of a client device of a user, the one or more images indicating musculoskeletal form of the user while performing an exercise;
accessing a machine learning model that predicts whether the user had proper musculoskeletal form while performing the exercise, the machine learning model trained using a plurality of images of users performing the exercise with and without proper musculoskeletal form;
determining a metric describing the musculoskeletal form of the user by applying the machine learning model to the one or more images as input features;
generating feedback for the exercise using at least the metric;
and
providing the feedback to the client device for presentation to the user.

3 more elements

A non-transitory computer-readable storage medium storing instructions for image processing, the instructions when executed by a processor causing the processor to:

receive one or more images captured by a camera of a client device of a user, the one or more images indicating musculoskeletal form of the user while performing an exercise;
accessing a machine learning model that predicts whether the user had proper musculoskeletal form while performing the exercise, the machine learning model trained using a plurality of images of users performing the exercise with and without proper musculoskeletal form;
determine a metric describing the musculoskeletal form of the user by applying the machine learning model to the one or more images as input features;
generate feedback for the exercise using at least the metric;
and
provide the feedback to the client device for presentation to the user.

3 more elements

Dependencies are inferred from the claim text.

Classification of musculoskeletal form using machine learning model

Life of this patent

Classification of musculoskeletal form using machine learning model

Life of this patent

Abstract

Claims20