Augmented reality spatial audio experience

A method for use with an eyewear device configured to be head mounted on a user, the eyewear device comprising at least one image sensor having a field of view, a display having a viewing area corresponding to the field of view, a support structure configured to be head-mounted on a user, a processor, and a memory, the method comprising:

• capturing, with the at least one image sensor, image information of an environment surrounding the eyewear device;
• identifying an object location within the environment;
• associating a virtual object with the identified object location;
• monitoring position of the eyewear device with respect to the virtual object responsive to the captured image information;
• determining when the object location is within the viewing area of the display;
• presenting, on the display, video signals including the virtual object in the object location responsive to the monitored position when the identified object location is determined to be within the viewing area;
• selecting an object type for the virtual object from at least a first object type and second object type, the first object type associated with a first set of animation states and the second object type associated with a second set of animation states, wherein presenting the virtual object the eyewear device is configured to present the first set of animation states when the first object type is selected and presenting the second set of animation states when the second object type is selected;
• maintaining a tally for the user, wherein the first object type is associated with a first score and the second object type is associated with a second score;
• detecting when the eyewear device is within a predefined threshold of the object location;
• and
• adjusting the tally by the first score when the virtual object has the first object type and adjust the tally by the second score when the virtual object has the second object type.

A non-transitory computer-readable medium storing program code for use with an eyewear device configured to be head mounted on a user, the eyewear device comprising a processor, a memory, at least one image sensor having a field of view, and a display having a viewing area corresponding to the field of view, the program code, when executed, is operative to cause an electronic processor to:

• capture, with the at least one image sensor, image information of an environment surrounding the eyewear device;
• identify an object location within the environment;
• associate a virtual object with the identified object location;
• monitor position of the eyewear device with respect to the virtual object responsive to the captured image information;
• determine when the object location is within the viewing area of the display;
• present, on the display, video signals including the virtual object in the object location responsive to the monitored position when the identified object location is determined to be within the viewing area;
• select an object type for the virtual object from at least a first object type and second object type, the first object type associated with a first set of animation states and the second object type associated with a second set of animation states,
• wherein to present the virtual object the eyewear device is configured to present the first set of animation states when the first object type is selected and to present the second set of animation states when the second object type is selected;
• maintain a tally for the user, wherein the first object type is associated with a first score and the second object type is associated with a second score;
• detect when the eyewear device is within a predefined threshold of the object location;
• and
• adjust the tally by the first score when the virtual object has the first object type and adjust the tally by the second score when the virtual object has the second object type.