Observational support systems and methods for robotic picking and other environments

A computing system for providing observational support in a conventional robotic pick cell comprising a robot, an imaging system, and a vision system, the computing system comprising:

• at least one computing processor;
• and
• memory comprising instructions that, when executed by the at least one computing processor, enable the computing system to:
• obtain a trigger signal, the trigger signal obtained by a processor associated with an observational support system, the observational support system positioned in relation to a robotic pick cell such that the observational support system can obtain pick scene data associated with the robotic pick cell;
• obtain, in response to the trigger signal, auxiliary pick scene data associated with the robotic pick cell, wherein the auxiliary pick scene data is obtained by an auxiliary sensor module associated with the observational support system, wherein the auxiliary pick scene data is obtained in addition to pick scene data obtained by a first sensor module associated with a first vision system, wherein both the first vision system and the observational support system are configured to provide pick control information to a robot, wherein the trigger signal is associated with the first vision system being unable to determine appropriate pick control information for the robot based on the data obtained by the first sensor module;
• send the auxiliary pick scene data obtained by the auxiliary sensor module to a remote intervention system via network communication, wherein the intervention system is operable to communicate with the observational support system;
• obtain response data from the intervention system via network communication, wherein the response data comprises pick control information which the first vision system did not provide to the robot;
• and
• send the response data to the robot for use in controlling the robot, wherein the robot is configured to accept instructions from the observational support system when the first vision system is unable to determine appropriate pick control information for the robot.

A computer readable medium comprising instructions that when executed by a processor enable the processor to:

• obtain a trigger signal, the trigger signal obtained by a processor associated with an observational support system, the observational support system positioned in relation to a robotic pick cell such that the observational support system can obtain pick scene data associated with the robotic pick cell;
• obtain, in response to the trigger signal, auxiliary pick scene data associated with the robotic pick cell, wherein the auxiliary pick scene data is obtained by an auxiliary sensor module associated with the observational support system, wherein the auxiliary pick scene data is obtained in addition to pick scene data obtained by a first sensor module associated with a first vision system, wherein both the first vision system and the observational support system are configured to provide pick control information to a robot, wherein the trigger signal is associated with the first vision system being unable to determine appropriate pick control information for the robot based on the data obtained by the first sensor module;
• send the auxiliary pick scene data obtained by the auxiliary sensor module to a remote intervention system via network communication, wherein the intervention system is operable to communicate with the observational support system;
• obtain response data from the intervention system via network communication, wherein the response data comprises pick control information which the first vision system did not provide to the robot;
• and
• send the response data to the robot for use in controlling the robot, wherein the robot is configured to accept instructions from the observational support system when the first vision system is unable to determine appropriate pick control information for the robot.