Computer vision based extraction and overlay for instructional augmented reality

A system comprising:

• an image capture device associated with a computing device;
• at least one processor;
• and
• memory storing instructions that, when executed by the at least one processor, cause the system to:
• obtain a plurality of segments of a first media content item;
• extract, from a first segment in the plurality of segments, a plurality of image frames, the plurality of image frames being associated with a plurality of tracked movements of at least one object represented in the extracted image frames;
• compare, objects represented in the image frames extracted from the first segment to tracked objects in a second media content item;
• in response to detecting that at least one of the tracked objects in the second media content item is similar to at least one object in the plurality of extracted image frames, generating, based on the extracted plurality of image frames, virtual content depicting the plurality of tracked movements from the first segment being performed on the at least one tracked object in the second media content item;
• and
• trigger rendering of the virtual content as an overlay on the at least one tracked object in the second media content item.

A computer readable medium tangibly embodied on a non-transitory computer-readable medium and comprising instructions that, when executed, are configured to cause at least one processor to:

• obtain a plurality of segments of a first media content item;
• extract, from a first segment in the plurality of segments, a plurality of image frames, the plurality of image frames being associated with a plurality of tracked movements of at least one object represented in the extracted image frames;
• compare, objects represented in the image frames extracted from the first segment to tracked objects in a second media content item;
• in response to detecting that at least one of the tracked objects in the second media content item is similar to at least one object in the plurality of extracted image frames, generating, based on the extracted plurality of image frames, virtual content depicting the plurality of tracked movements from the first segment being performed on the at least one tracked object in the second media content item;
• and
• trigger rendering of the virtual content as an overlay on the at least one tracked object in the second media content item.