Artificial intelligence assisted wearable

A hands-free digital assistant device, comprising:

• a camera;
• a microphone;
• a speaker;
• a network interface;
• a processor;
• and
• a storage having instructions which, when executed by the processor, cause the processor to:
• receive a contextual voice command from the user via the microphone, wherein the contextual voice command uses a non-explicit reference to an object in an environment;
• capture an image of the environment including the object via the camera;
• cause transmission of the contextual voice command and the image to an engine via the network interface to cause a contextual task to be performed, the contextual task including a computerized action relating to the object;
• receive a response associated with the contextual task that was performed based at least on the contextual voice command;
• and
• output the response to the user via the speaker.

A system for hands-free digital assistant device, comprising:

• a wearable device;
• a sensor attached to the wearable device, the sensor being fixed relative to a body of a user and capable of sensing an environment;
• a processor;
• and
• a storage having instructions which, when executed by the processor, cause the processor to:
• receive a contextual voice command that includes a pronoun for a contextual signal that refers to an object in the environment;
• detect the object in the environment using the sensor;
• cause an engine to perform a contextual task relating to the object in response to the contextual voice command;
• and
• output a response associated with the contextual task to the user.

A method for hands-free digital assistance, comprising:

• receiving a contextual voice command that makes a reference to an object in an environment without explicitly identifying the object;
• capturing a recording of the environment including the object;
• using an engine to determine an identification of the object and to interpret the contextual voice command based at least on the identification of the object;
• and
• causing a contextual task to be performed in response to the contextual voice command, the contextual task including a computerized action relating to the object in the environment.