Motion error detection from partial body view
AssigneeAmazon Technologies, Inc.
InventorsIdo Yerushalmy, Amir Dudai, Eli Alshan
Life of this patent
Estimating the term…
Abstract
Described are systems and methods directed to the processing of two-dimensional (“2D”) images of a body to determine a physical activity performed by the body, repetitions of the physical activity, whether the body is performing the physical activity with proper form, and providing physical activity feedback. In addition, the disclosed implementations are able to determine the physical activity, repetitions, and/or form through the processing of 2D partial body images that include less than all of the body of the user.
Claims20
A computer-implemented method, comprising:
- receiving a plurality of two-dimensional (“2D”) partial body images of a human body from a 2D camera, wherein:
- each of the plurality of 2D partial body images are a time series of 2D partial body images;
- each of the plurality of 2D partial body images represent less than all of the human body;
- processing at least a portion of the plurality of 2D partial body images to at least:
- determine a first plurality of body landmarks corresponding to the human body that are visible in the plurality of 2D partial body images;
- and
- determine a second plurality of body landmarks corresponding to the human body that are not visible in the plurality of 2D partial body images;
- determining, based at least in part on a first position of a first body landmark of the first plurality of body landmarks with respect to a second position of a second body landmark of the second plurality of body landmarks, that the human body is in a poor form with respect to an exercise being performed by the human body;
- and
- sending, for presentation to the human body, an indication of the poor form and a correction to be made with respect to the poor form and the exercise.
A computing system, comprising:
- one or more processors;
- a memory storing program instructions that, when executed by the one or more processors, cause the one or more processors to at least:
- receive a two-dimensional (“2D”) partial body image of a body, wherein the 2D partial body image represents less than all of the body;
- process the 2D partial body image to at least:
- determine a first plurality of body landmarks corresponding to the body that are visible in the 2D partial body image;
- and
- determine a second plurality of body landmarks corresponding to the body that are not visible in the 2D partial body image;
- determine based at least in part on the first plurality of body landmarks and the second plurality of body landmarks, an accuracy of a form of the body with respect to a physical activity being performed by the body;
- and
- send, for presentation, a feedback indicating the accuracy of the form of the body with respect to the physical activity.
A method, comprising:
- processing a first two-dimensional (“2D”) body image that includes a representation of a body from a first view to produce a first plurality of body landmarks corresponding to the body that are visible in the first 2D body image;
- determining, based at least in part on the first plurality of body landmarks, a second plurality of body landmarks corresponding to a second portion of the body that is not represented in the first 2D body image;
- determining, based at least in part on at least a first portion of the first plurality of body landmarks and at least a second portion of the second plurality of body landmarks, an accuracy of a form of the body with respect to a physical activity being performed by the body;
- and
- causing a presentation of a feedback with respect to the accuracy of the physical activity.
Dependencies are inferred from the claim text.