Methods for an autonomous robotic device to identify locations captured in an image

A system, comprising:

• a robot, comprising:
• a chassis;
• a plurality of sensors;
• a processor;
• and
• a tangible, non-transitory, machine-readable medium storing instructions that, when executed by the processor, effectuates operations comprising:
• capturing, with an image sensor disposed on the robot, a plurality of images of an environment of the robot;
• extracting, with the processor of the robot, at least one feature from the captured plurality of images by obtaining, with the processor of the robot, raw pixel intensity values of the captured images, wherein features in the images are extracted from raw pixel intensity values;
• generating, with the processor of the robot, a map of the environment based on at least the plurality of images and the extracted features;
• actuating, with the processor of the robot, the robot to execute work in the environment based on the generated map within at least a particular sub area or labeled area of the environment upon receiving, with the processor of the robot, at least one voice command comprising an instruction for executing work within the at least particular sub area or labeled area;
• a set of instructions and executable code that, when executed by a processor of an external communication and computing device, effectuates operations comprising:
• pairing the external communication and computing device with the processor of the robot to communicate with the robot;
• receiving the map of the environment created by the robot;
• display the map of the environment of the robot;
• receiving at least one input designating an instruction for the robot in relation to the at least one subarea within the environment based on the map of the environment by:
• accessing the camera of the communication and computing device for capturing images of the environment;
• capturing an image of the environment;
• displaying the image;
• and
• receiving at least one input in relation to the displayed image.

A tangible, non-transitory, machine-readable medium storing instructions that, when executed by a processor of a robot, effectuate operations comprising:

• capturing, with an image sensor disposed on the robot, a plurality of images of an environment of the robot;
• extracting, with the processor of the robot, at least one feature from the captured plurality of images by obtaining, with the processor of the robot, raw pixel intensity values of the captured images, wherein features in the images are extracted from raw pixel intensity values;
• generating, with the processor of the robot, a map of the environment of the robot at least partly based on the captured plurality of images and the extracted features;
• actuating, with the processor of the robot, the robot to execute work in the environment based on the generated map within at least a particular sub area or labeled area of the environment upon receiving, with the processor of the robot, at least one voice command comprising an instruction for executing work within the at least particular sub area or labeled area;
• wherein a set of instructions and executable code that when executed by the processor of an external communication and computing device effectuates operations comprising:
• pairing;
• the external communication and computing device with the processor of the robot to communicate with the robot;
• receiving the map of the environment created by the robot;
• displaying the map of the environment of the robot;
• and
• receiving at least one input designating an instruction for the robot in relation to at least a subarea within the map of the environment by:
• accessing the camera of the communication and computing device for capturing images of the environment;
• capturing an image of the environment;
• displaying the image;
• and
• receiving at least one input in relation to the displayed image.

A method for operating a robot, comprising:

• capturing, with an image sensor disposed on the robot, a plurality of images of an environment of the robot;
• extracting, with a processor of the robot, at least one feature from the captured plurality of images by obtaining, with the processor of the robot, raw pixel intensity values of the captured images, wherein features in the images are extracted from raw pixel intensity values;
• generating, with the processor of the robot, a map of the environment of the robot at least partly based on the features in the captured plurality of images and extracted features;
• actuating, with the processor of the robot, the robot to execute work in the environment based on the generated map within at least a particular sub area or labeled area of the environment upon receiving, with the processor of the robot, at least one voice command comprising an instruction for executing work within the at least particular sub area or labeled area;
• wherein a set of instructions and executable code that, when executed by the processor of an external communication and computing device, effectuates operations comprising:
• pairing, the external communication and computing device with the processor of the robot to communicate with the robot;
• receiving the map of the environment created by the robot;
• displaying the map of the environment of the robot;
• and
• receiving at least one input designating an instruction for the robot in relation to at least a subarea within the map of the environment based on the map of the environment by:
• accessing the camera of the communication device and computing device for capturing images of the environment;
• capturing an image of the environment;
• displaying the image;
• and
• receiving at least one input in relation to the displayed image.