Hand-movement based interaction with augmented reality objects

At least one non-transitory computer-readable storage medium storing instructions, which, when executed by at least one data processor of a system, causes the system to:

• determine a set of hand gestures associated with interactions with an object in an augmented reality environment,
• wherein each respective hand gesture in the set of hand gestures is associated with a respective interaction with the object in the augmented reality environment;
• capture, using a viewfinder, an environment within the field of view of the viewfinder;
• provide the augmented reality environment,
• wherein the augmented reality environment includes a plurality of objects comprising a virtual object and a virtual rendering of a physical object from the captured environment within the field of view of the viewfinder;
• capture a first hand gesture performed in the field of view of the viewfinder;
• capture a second hand gesture performed in the field of view of the viewfinder;
• determine that the first hand gesture corresponds to a particular hand gesture from the set of hand gestures,
• wherein the particular hand gesture is associated, in the set of hand gestures, with a particular type of interaction with the object in the augmented reality environment;
• determine that the second hand gesture corresponds to an additional particular hand gesture from the set of hand gestures,
• wherein the additional particular hand gesture is associated, in the set of hand gestures, with an absolute amount of interaction with the object in the augmented reality environment, the absolute amount of interaction unrelated to a relationship between the second hand gesture and the augmented reality environment;
• and
• in response to the determination that the first hand gesture corresponds to the particular hand gesture and the second hand gesture corresponds to the additional particular hand gesture, interact, in the augmented reality environment, with a particular object of the plurality of objects in accordance with a particular interaction,
• wherein the particular interaction is of the particular type and by the absolute amount.

A system comprising:

• at least one hardware processor;
• and
• at least one non-transitory memory storing instructions, which, when executed by the at least one hardware processor, cause the system to:
• determine a set of hand gestures associated with interactions with an object in an augmented reality environment,
• wherein each respective hand gesture in the set of hand gestures is associated with a respective interaction with the object in the augmented reality environment;
• capture, using a viewfinder, an environment within the field of view of the viewfinder;
• provide the augmented reality environment,
• wherein the augmented reality environment includes a plurality of objects comprising a virtual object and a virtual rendering of a physical object from the captured environment within the field of view of the viewfinder;
• capture a first hand gesture performed in the field of view of the viewfinder;
• capture a second hand gesture performed in the field of view of the camera;
• determine that the first hand gesture corresponds to a particular hand gesture from the set of hand gestures,
• wherein the particular hand gesture is associated with a particular type of interaction with the object in the augmented reality environment;
• determine that the second hand gesture corresponds to an additional particular hand gesture from the set of hand gestures,
• wherein the additional particular hand gesture is associated, in the set of hand gestures, with an absolute amount of interaction with the virtual object in the augmented reality environment, the absolute amount of interaction unrelated to a relationship between the second hand gesture and the augmented reality environment;
• and
• in response to the determination that the first hand gesture corresponds to the particular hand gesture and the second hand gesture corresponds to the additional particular hand gesture, interact, in the augmented reality environment, with a particular object of the plurality of objects in accordance with a particular interaction,
• wherein the particular interaction is of the particular type and by the absolute amount.