Apparatus and method for automatic action selection based on image context

An apparatus for providing context-related feedback to a user, the apparatus comprising:

• an image sensor configured to be worn by the user and to capture real time image data from an environment of the user;
• at least one processor device configured to:
• identify a trigger in the image data, wherein multiple context-based alternative actions are associated with the trigger;
• identify an object in the image data based on the trigger;
• identify a background of the object in the image data;
• determine a particular context using information about at least one of the identified object and the identified background;
• select one of the multiple alternative actions associated with the trigger based on the particular context associated with the identified object;
• execute the selected alternative action;
• and
• output the context-related feedback based on a result of the executed alternative action.

A method for providing context-related feedback to a user, the method comprising:

• capturing real time image data from an environment of the user;
• identifying in the image data a hand-related trigger, wherein multiple context-based alternative actions are associated with the hand-related trigger;
• identifying in the image data an object based on the hand-related trigger, wherein the object is further-associated with a particular context;
• selecting one of the multiple alternative actions associated with the hand-related trigger based on the particular context associated with the identified object;
• and
• outputting the context-related feedback based on a result of the executed alternative action.