Physical training assistant system
AssigneeGoogle Inc.
InventorsAlex Nicolaou, Ryan James Harrison
Life of this patent
Estimating the term…
Abstract
A computer-implemented method, a system and a computer-readable medium provide useful feedback for a user involved in exercise. A camera is used to track user motion by using image processing techniques to identify key points on a user's body and track their motion. The tracked points are compared to proper form for an exercise, and an embodiment gives feedback based on the relationship between the actual movement of the user and the proper form. Alternatively, silhouette information may be used in a similar manner in another embodiment.
Claims18
A computer-implemented method, comprising:
- receiving an indication of an exercise selection from a user;
- detecting a body in front of a camera;
- determining expected key points on the body based on the detecting;
- establishing a location and an orientation of the body based on height information and image processing;
- identifying key points on the body by transforming the expected key points based on the location and the orientation of the body;
- taking a picture of the body at a stage of an exercise associated with the exercise selection;
- detecting motions of the key points on the body;
- comparing the motions of the key points to a proper form while detecting the motion, the proper form comprising proper key points on an individual and motions of the proper key points;
- and
- determining whether the comparison is within a predetermined range and providing a response to the user in response to the determination.
A system, comprising:
- one or more processors;
- and
- a non-transitory machine-readable medium comprising instructions stored therein, which when executed by the processors, cause the processors to perform operations comprising:
- receiving an indication of an exercise selection from a user;
- detecting a body in front of a camera;
- determining expected key points on the body based on the detecting;
- determining a distance of the body based on height information;
- determining a location and an orientation of the body based on the distance and image processing;
- identifying key points on the body by transforming the expected key points based on the location and the orientation of the body;
- taking a picture of the body at a stage of an exercise associated with the exercise selection;
- detecting motions of the key points on the body;
- comparing the motions of the key points to a proper form while detecting the motion, the proper form comprising proper key points on an individual and motions of the proper key points;
- determining whether the comparison is within a predetermined range;
- and
- providing a response to the user in response to the determination.
A non-transitory computer readable storage medium having instructions stored thereon that, when executed by one or more processors, cause the one or more processors to execute a method, the method comprising:
- receiving an indication of an exercise selection from a user;
- detecting a body in front of a camera;
- determining expected key points on the body based on the detecting;
- determining a distance of the body based on height information;
- determining a location and an orientation of the body based on the distance and image processing;
- identifying key points on the body by transforming the expected key points based on the location and the orientation of the body;
- taking a picture of the body at a stage of an exercise associated with the exercise selection;
- detecting motions of the key points on the body based on the picture;
- comparing the motions of the key points to a proper form while detecting the motion, the proper form comprising proper key points on an individual and motions of the proper key points;
- and
- determining whether the comparison is within a predetermined range and providing a response to the user in response to the determination.
A computer-implemented method comprising:
- receiving a sequence of silhouettes of correct form associated with an exercise;
- detecting motion associated with the user;
- recording a generic silhouette of the user at each of a predetermined number of times with a camera based on detecting specific stages of the exercise;
- comparing the sequence of silhouettes with the generic silhouette at each of the predetermined number of times by subdividing each of the sequence of silhouettes and each of the generic silhouettes into regions and identifying a transformation associated with a motion of each region;
- and
- providing feedback of the comparison.
Dependencies are inferred from the claim text.