Detection of kinetic events and mechanical variables from uncalibrated video
AssigneeQualiaOS, Inc.
InventorsKevin John Prince, Carlos Dietrich, Justin Ali Kennedy
Life of this patent
Estimating the term…
Abstract
Systems and techniques are provided to identify, analyze, and evaluate key events and mechanical variables in videos of human motion related to an action, such as may be used in training for various sports and other activities. Information about the action is calculated based on analysis of the video such as via keypoint identification, pose identification and/or estimation, and related calculations, and provided automatically to the user to allow for improvement of the action.
Claims17
A computer-implemented method comprising:
- receiving an uncalibrated video showing performance of an action by a human subject;
- extracting a plurality of two-dimensional (2D) poses of the human subject while performing the action based on an arrangement of keypoints on the human subject in one or more frames of the uncalibrated video, the keypoints comprising repeatably-identifiable points on the human subject, wherein the 2D poses comprise discrete arrangements of portions of the human subject relative to one another;
- computing one or more mechanical variables of the human subject performing the action, the mechanical variables describing a physical arrangement of at least a part of the human subject performing the action;
- and
- based upon the one or more mechanical variables, automatically providing information about performance of the action by the human subject, the information indicating at least one portion of the action that was performed sub-optimally by the human subject.
A system comprising:
- a processor configured to:
- receive an uncalibrated video showing performance of an action by a human subject;
- extract a plurality of two-dimensional (2D) poses of the human subject while performing the action based on an arrangement of keypoints on the human subject in one or more frames of the uncalibrated video, the keypoints comprising repeatably-identifiable points on the human subject, wherein the 2D poses comprise discrete arrangements of portions of the human subject relative to one another;
- compute one or more mechanical variables of the human subject performing the action, the mechanical variables describing a physical arrangement of at least a part of the human subject performing the action;
- and
- based upon the one or more mechanical variables, automatically provide information about performance of the action by the human subject, the information indicating at least one portion of the action that was performed sub-optimally by the human subject.
A non-transitory computer-readable medium storing a plurality of instructions which, when executed by a processor, cause the processor to:
- receive an uncalibrated video showing performance of an action by a human subject;
- extract a plurality of two-dimensional (2D) poses of the human subject while performing the action based on an arrangement of keypoints on the human subject in one or more frames of the uncalibrated video, the keypoints comprising repeatably-identifiable points on the human subject, wherein the 2D poses comprise discrete arrangements of portions of the human subject relative to one another;
- compute one or more mechanical variables of the human subject performing the action, the mechanical variables describing a physical arrangement of at least a part of the human subject performing the action;
- and
- based upon the one or more mechanical variables, automatically provide information about performance of the action by the human subject, the information indicating at least one portion of the action that was performed sub-optimally by the human subject.
Dependencies are inferred from the claim text.