Using video tracking technology to create machine learning datasets for tasks

A system comprising:

• a processor;
• a data bus coupled to the processor;
• and
• a computer-usable medium embodying computer program code, the computer-usable medium being coupled to the data bus, the computer program code used for tracking selected points in a series of video images of capture video to determine motions made by a subject to perform an action to train a system to perform the action comprising instructions executable by the processor and configured for:
• receiving the series of video images of the captured video, wherein successive video images depict incremental steps of the subject performing the action;
• identifying selected key points associated with the subject useful for tracking the subject performing the action, wherein the key points associated with the subject are tracked over time and adjusted based on a sampling frequency of the captured video;
• mapping datasets of points to be used to train a model;
• using physical sensors for live reinforcement learning;
• and
• training the model utilizing the mapped datasets of points and live reinforcement training.

A non-transitory, computer-readable storage medium embodying computer program code for tracking selected points in a series of video images of captured video to determine motions made by a subject to perform an action to train a system to perform the action, the computer program code comprising computer executable instructions configured for:

• receiving the series of video images of the captured video, wherein successive video images depict incremental steps of the subject performing the action;
• identifying selected key points associated with the subject useful for tracking the subject performing the action, wherein the key points associated with the subject are tracked over time and adjusted based on a sampling frequency of the captured video;
• mapping datasets of points to be used to train a model;
• using physical sensors for live reinforcement learning;
• and
• training the model utilizing the mapped datasets of points and live reinforcement training.