Real-time validation of robotic sensing systems

A device comprising:

• a sensor configured to capture sensor data within a field of view of a robot, wherein the sensor data comprises image data comprising a series of frames within the field of view;
• a processor configured to:
• perform an identification of a detected object within the field of view of the robot, wherein the identification is output from an object detection model based on the sensor data;
• and
• determine an accuracy metric associated with the identification that is output from the object detection model;
• generate detection information associated with the identification of the detected object, wherein the detection information comprises:
• a frame number of a frame within the series of frames in which the detected object is detected;
• a location of the detected object within the frame;
• and the accuracy metric;
• and
• an audio interface communicatively coupled with the processor, the audio interface configured to request a verbal feedback regarding the identification of the detected object, wherein the processor is configured to update the object detection model into an updated object detection model based on the verbal feedback, wherein the processor configured to update the object detection model into the updated object detection model based on the verbal feedback comprises the processor further configured to:
• generate, from the verbal feedback and the detection information, training information for training the object detection model based on the verbal feedback and the detection information, wherein the training information comprises the verbal feedback regarding the identification, the frame number, the location, and the accuracy metric;
• and
• train the object detection model based on the training information to obtain the updated object detection model.