Methods for an autonomous robotic device to identify locations captured in an image

An apparatus, comprising:

• a robot comprising:
• a chassis;
• drive wheels connected to the chassis;
• one or more processors;
• one or more sensors;
• and,
• one or more tangible, non-transitory, machine-readable medium storing instructions that when executed by the one or more processors effectuate operations comprising:
• receiving, with the one or more processors of the robot, an image of an environment captured by an imaging device separate from the robot;
• obtaining, with the one or more processors of the robot, raw pixel intensity values of the image;
• extracting, with the one or more processors of the robot, objects and features in the image by grouping pixels with similar raw pixel intensity values, and by identifying areas in the image with greatest change in raw pixel intensity values;
• determining, with the one or more processors of the robot, an area within a map of the environment corresponding with the image by comparing the objects and features of the image with objects and features of the map;
• inferring, with the one or more processors of the robot, one or more locations captured in the image based on the location of the area of the map corresponding with the image;
• and,
• instructing, by the one or more processors of the robot, the robot to navigate to the location captured in the image and execute a task;
• wherein the robot is paired with an application of a smart device configured to:
• receive an input designating a modification to the map of the environment;
• and
• transmit the modified map to at least one of:
• the one or more processors of the robot via the cloud, the cloud, the one or more processors of the robot and the cloud, and the one or more processors of the robot.

A method, comprising:

• generating, with a processor of a robot, a map of an environment of the robot and a path of the robot within the environment;
• transmitting, with the processor of the robot, the map of the environment and the path of the robot to an application of a computing device paired with a wireless controller of the robot;
• displaying, with the application of the computing device, the map and the path of the robot;
• receiving, with the application of the computing device, an input designating an instruction comprising at least one of:
• the path of the robot, an adjustment to the path of the robot, an adjustment to the map, an order of rooms within the environment the robot is to perform work within, areas within the environment the robot is to perform work within, areas within the environment the robot is to avoid, a type of work the robot is to perform within an area, a location within the environment the robot is to navigate to, a modification to a pre-existing label of an area within the environment, and a label for an area within the environment, wherein:
• the robot comprises:
• a chassis;
• drive wheels connected to the chassis;
• a plurality of sensors comprising at least one of a laser distance sensor and a camera;
• and
• a tangible, non-transitory, machine-readable medium;
• and
• the computing device comprises:
• a processor;
• a tangible, non-transitory, machine-readable medium;
• a microphone;
• a speaker;
• a screen;
• at least one user interface;
• and
• a camera.