Method of using physical movement for virtual gameplay control and associated apparatus

A computing system comprising:

• a processor;
• and
• a non-transitory memory for storing instructions that when executed by the processor cause the computing system to be configured to:
• receive, from a user interface, a selection of an exercise;
• read, from the non-transitory memory, data associated with the exercise, the data including indications of a plurality of joints to detect and a plurality of expected positions of each of the plurality of joints;
• receive, from a video source, a plurality of frames of a performance of a user performing the exercise;
• detect each of the plurality of joints within each of the plurality of frames;
• determine a change in positions of each of the plurality of joints over a timeframe corresponding to the plurality of frames;
• determine that the performance was a success based on comparing the changes in positions of each of the plurality of joints to the plurality of expected positions of each of the plurality of joints over the timeframe;
• and
• send, to the user interface, an indication of success that the exercise was performed correctly.