Systems, devices, and methods for the distribution and collection of multimodal data associated with robots

A method of operation in a computing system, including a robot, the method comprising:

• causing, by a processor, a robot to perform a task in an environment;
• capturing, by a camera coupled to the processor, media data of the robot performing the task in the environment, the media data including a video feed;
• generating, by the processor, a dynamic representation of the robot performing the task in the environment from the captured media data;
• providing, by the processor, the dynamic representation of the robot performing the task in the environment to at least one observer agent;
• collecting data from at least one observer agent responsive to the observer agent observing the dynamic representation of the robot performing the task in the environment;
• computing, by the processor, a value of a metric for the robot based on the collected data;
• returning, by the processor, the value of the metric;
• and
• receiving, by the processor, a score from the observer agent, wherein the score is related to the performance of the task by the robot, and wherein the score is used to train a machine learning model.