Methods and systems for augmented reality to display virtual representations of robotic device actions

A non-transitory computer readable medium having stored thereon instructions that, upon execution by a computing device, cause the computing device to perform functions comprising:

• receiving information that indicates an action or an intent of a robotic device to perform a task, wherein the action or the intent includes one or more of a planned trajectory of the robotic device to perform at least a portion of the task and an object to be handled by the robotic device to perform at least a portion of the task;
• receiving a camera feed from a field of view of the robotic device;
• displaying on an augmented reality interface, a virtual representation of the action or the intent, wherein the virtual representation includes as annotations on the augmented reality interface at least a portion of the planned trajectory of the robotic device or highlighting the object to be handled by the robotic device overlaid onto the camera feed from the field of view of the robotic device;
• providing, by the computing device which is remote from the robotic device, a projection of light along a pathway to modify the action or the intent of the robotic device;
• and
• in response to providing the projection of light, receiving from the robotic device one or more of an updated planned trajectory of the robotic device and an updated object to be handled by the robotic device.