Detection of kinetic events and mechanical variables from uncalibrated video
AssigneeQualiaOS, Inc.
InventorsKevin John Prince, Carlos Dietrich, Justin Ali Kennedy
Life of this patent
Estimating the term…
Abstract
Systems and techniques are provided to identify, analyze, and evaluate key events and mechanical variables in videos of human motion related to an action, such as may be used in training for various sports and other activities. Information about the action is calculated based on analysis of the video such as via keypoint identification, pose identification and/or estimation, and related calculations, and provided automatically to the user to allow for improvement of the action.
Claims18
A computer-implemented method comprising:
- receiving an uncalibrated video showing performance of an action by a human subject;
- extracting a plurality of two-dimensional (2D) poses of the human subject while performing the action;
- based upon the 2D poses, detecting one or more key events in the uncalibrated video, each of the key events corresponding to a predefined portion of the action;
- based upon the key events, computing one or more mechanical variables of the human subject performing the action;
- and
- based upon the one or more mechanical variables, automatically providing information about performance of the action by the human subject, the information indicating at least one portion of the action that was performed sub-optimally by the human subject.
A system comprising:
- a processor configured to:
- receive an uncalibrated video showing performance of an action by a human subject;
- extract a plurality of two-dimensional (2D) poses of the human subject while performing the action;
- based upon the 2D poses, detect one or more key events in the uncalibrated video, each of the key events corresponding to a predefined portion of the action;
- based upon the key events, compute one or more mechanical variables of the human subject performing the action;
- and
- based upon the one or more mechanical variables, automatically determine information about performance of the action by the human subject, the information indicating at least one portion of the action that was performed sub-optimally by the human subject;
- and
- a user interface comprising a display, the interface capable of providing the information about the performance of the action by the human subject.
A non-transitory computer-readable medium storing a plurality of instructions which, when executed by a processor, cause the processor to:
- receive an uncalibrated video showing performance of an action by a human subject;
- extract a plurality of two-dimensional (2D) poses of the human subject while performing the action;
- based upon the 2D poses, detect one or more key events in the uncalibrated video, each of the key events corresponding to a predefined portion of the action;
- based upon the key events, compute one or more mechanical variables of the human subject performing the action;
- and
- based upon the one or more mechanical variables, automatically determine information about performance of the action by the human subject, the information indicating at least one portion of the action that was performed sub-optimally by the human subject;
- and
- a user interface comprising a display, the interface capable of providing the information about the performance of the action by the human subject.
Dependencies are inferred from the claim text.