Dynamic augmented reality experience

A computing system comprising:

• a processor;
• and
• a memory storing instructions that, when executed by the processor, configure the computing system to perform operations comprising:
• causing display of a first set of textual cues on a graphical user interface (GUI) of a computer device, the first set of textual cues associated with an augmented reality (AR) experience;
• receiving a first set of image data and a first set of audio data, corresponding to the first set of textual cues;
• generating a first AR object associated with the AR experience based on the first set of image data and an analysis of keywords in the first set of audio data, the keywords identified using a voice machine learning model;
• causing display of the first AR object on the GUI of the computer device and a second set of textual cues associated with the AR experience;
• receiving a second set of image data corresponding to the second set of textual cues;
• and
• in response to receiving the second set of image data, generating a second AR object associated with the AR experience;
• identifying a hand gesture from a user of the computer device;
• and
• in response to identifying the hand gesture, modifying the second AR object.

A non-transitory computer-readable storage medium, the computer-readable storage medium including instructions that when executed by a computer, cause the computer to:

• causing display of a first set of textual cues on a graphical user interface (GUI) of a computer device, the first set of textual cues associated with an augmented reality (AR) experience;
• receiving a first set of image data and a first set of audio data, corresponding to the first set of textual cues;
• generating a first AR object associated with the AR experience based on the first set of image data and an analysis of keywords in the first set of audio data, the keywords identified using a voice machine learning model;
• causing display of the first AR object on the GUI of the computer device and a second set of textual cues associated with the AR experience;
• receiving a second set of image data corresponding to the second set of textual cues;
• and
• in response to receiving the second set of image data, generating a second AR object associated with the AR experience;
• identifying a hand gesture from a user of the computer device;
• and
• in response to identifying the hand gesture, modifying the second AR object.