Virtual guided fitness routines for augmented reality experiences

A virtual guided fitness system, comprising:

• an eyewear device comprising a camera, an inertial measurement unit, a microphone, a loudspeaker, a guided fitness application, an image processing system, and a display;
• programming in a memory, wherein execution of the programming by a processor configures the eyewear device to perform functions, including functions to:
• capture frames of motion data with the inertial measurement unit;
• detect a device motion of the eyewear device relative to a physical environment based on the captured frames of motion data;
• determine whether the detected device motion matches a first predefined exercise activity from among a plurality of predefined exercise activities stored in an activity library, wherein each predefined exercise activity is characterized by an exercise data record comprising at least one of an identifier, one or more positions, or one or more motions;
• retrieve a first exercise data record associated with the first predefined exercise activity;
• and
• present on the display a virtual fitness experience based on the retrieved first exercise data record as an overlay relative to the physical environment.

A non-transitory computer-readable medium storing program code which, when executed, is operative to cause an electronic processor to perform the steps of:

• capturing frames of motion data with an inertial measurement unit of an eyewear device, the eyewear device further comprising a camera, a microphone, a loudspeaker, a guided fitness application, an image processing system, and a display;
• detecting a device motion of the eyewear device relative to a physical environment based on the captured frames of motion data;
• determining whether the detected device motion matches a first predefined exercise activity from among a plurality of predefined exercise activities stored in an activity library, wherein each predefined exercise activity is characterized by an exercise data record comprising at least one of an identifier, one or more positions, or one or more motions;
• retrieving a first exercise data record associated with the first predefined exercise activity;
• presenting on the display a virtual fitness experience based on the retrieved first exercise data record as an overlay relative to the physical environment wherein the step of presenting the virtual fitness experience further comprises:
• presenting an avatar at an avatar position relative to the display;
• playing, through the avatar a start message associated with the retrieved first exercise data record;
• playing, through the avatar a lecture associated with the retrieved first exercise data record, wherein the process of playing through the avatar comprises one or more operations selected from the group consisting of presenting text in a text bubble playing audio through the loudspeaker and presenting a video on the display;
• and
• animating the avatar to perform a demonstration on the display adjacent the avatar position in correlation with a lesson wherein the demonstration is based on the retrieved first exercise data record.