Systems and methods for distributed autonomous robot interfacing using live image feeds

An autonomous method including autonomous robot devices, the method comprising:

• transmitting, via a first computing system including an interactive display, a first request for a plurality of physical objects from a facility;
• navigating, via a plurality of autonomous robot devices including a controller, a drive motor, an articulated arm, a reader, an inertial navigation system and an image capturing device, autonomously through the facility;
• receiving, via a second computing system in communication with the first computing system and the plurality of autonomous robot devices, the first request for the plurality of physical objects from the first computing system;
• transmitting, via the second computing system, instructions the at least one of the plurality of autonomous robot devices to retrieve the plurality of physical objects from the facility;
• detecting, via the second computing system, the at least one autonomous robot device has picked up at least one of the plurality of physical objects;
• controlling, via the second computing system, the image capturing device of the at least autonomous robot device to capture a live image feed of the at least one physical object picked up by the at least autonomous robot device;
• switching, via the second computing system, an input feed of the first computing system to display the live image feed on the display of the first computing system;
• receiving, via the second computing system, a second request from first computing system to discard the at least one of the physical objects picked up by the at least one autonomous robot device and to pick up a replacement physical object;
• transmitting, via the second computing system, instructions to the at least one autonomous device to discard the at least one of the physical objects picked up by the at least one autonomous robot device and to pick up the replacement physical object, the instructions from the second computing system include one or more identifiers for the plurality of physical objects;
• querying, via the at least one of the autonomous robot devices, a database operatively coupled to the second computing system and the plurality of the autonomous robot devices using the one or more identifiers for the plurality of physical objects;
• navigating, via the at least one autonomous robot device, autonomously through the facility to the first set of object locations in response to operation of the drive motor by the controller;
• locating and scanning, via the at least one autonomous robot device, one or more machine readable elements encoded with the one or more identifiers;
• detecting, via at least one image captured by the image capture device of the at least one autonomous robot device, that the first group of physical objects are disposed at the first set of locations;
• and
• picking up, via the at least one autonomous robot device, a first quantity of physical objects in the first group using the articulated arm.