Methods of collecting data through test interactions

A system comprising:

• a robotic picking mechanism;
• one or more computer-readable storage media;
• a processing system operatively coupled to the one or more computer-readable storage media;
• and
• program instructions, stored on the one or more computer-readable storage media, wherein the program instructions, when read and executed by the processing system, direct the processing system to:
• direct the robotic picking mechanism to, in a test mode, attempt to pick up an object, wherein the object is representative of other instances of the object and the robotic picking mechanism has never previously attempted to pick up any instances of the object;
• if the robotic picking mechanism successfully picks up the object in the test mode:
• direct the robotic picking mechanism to subject the object to one or more test stimuli while the robotic picking mechanism is in possession of the object;
• record test results indicating a physical reaction of the object to the one or more test stimuli and a level of confidence associated with the successful picking up of the object based on the physical reaction;
• and
• add the object to a whitelist indicating that the robotic picking mechanism may attempt to pick up the other instances of the object during normal operation;
• and
• if the robotic picking mechanism does not successfully pick up the object in the test mode:
• record failed pick results indicating that the robotic picking mechanism failed to pick up the object;
• and
• add the object to a blacklist indicating that the robotic picking mechanism should not attempt to pick the other instances of the object during the normal operation.

One or more non-transitory computer-readable storage media having program instructions stored thereon for controlling a robotic device, wherein the program instructions, when read and executed by a processing system, direct the processing system to at least:

• attempt, via the robotic device and while the robotic device is in a test mode, to pick up an object, wherein the object is representative of other instances of the object and the robotic device has never previously attempted to pick up any instances of the object;
• if the robotic device successfully picks up the object in the test mode:
• subject the object, via the robotic device, to one or more test stimuli while the robotic device is in possession of the object;
• record test results indicating a physical reaction of the object to the one or more test stimuli and a level of confidence associated with the successful picking up of the object based on the physical reaction;
• and
• add the object to a whitelist indicating that the robotic device may attempt to pick up the other instances of the object during normal operation;
• and
• if the robotic device does not successfully pick up the object in the test mode:
• record failed pick results indicating that the robotic device failed to pick up the object;
• and
• add the object to a blacklist indicating that the robotic device should not attempt to pick up the other instances of the object during the normal operation.