Systems and methods to adjust actions based on latency levels

A system comprising:

• a robotic device having a sensor;
• a computing system including a non-transitory computer-readable medium;
• and
• program instructions stored on the non-transitory computer-readable medium and executable to cause the computing system to:
• determine an action being performed by a robotic device, wherein the robotic device includes a mechanical actuator;
• based on execution of the action, the robotic device generating data for a computing device, wherein the generated data includes video data having a first resolution, and protocol data indicative of a communication protocol for the robotic device to communicate the video data;
• receive information from the computing device that is indicative of a latency attributable to communication between the robotic device and the computing device;
• based on the latency, determine a latency level associated with the latency attributable to the communication of the generated data and a priority at which to provide the generated data to the computing device, wherein the priority is based on a frequency at which the generated data changes over a period of time;
• responsive to determining that the latency level is above a first threshold and below a second threshold, provide, by the robotic device, the generated data to the computing device in an order based on the priority at a reduced resolution version of the video data to the computing device and discontinuing transmission of the audio data to the computing device, wherein the second threshold is more than the first threshold;
• and
• responsive to determining that the latency level is above the second threshold, determining an alternate communication pathway by which the robotic device is capable to communicate with the computing device, and communicating with the computing device over the alternate communication pathway.

A non-transitory computer-readable memory having stored thereon instructions executable by a computing device having at least one processor to cause the computing device to perform functions comprising:

• determining an action being performed by a robotic device, wherein the robotic device includes a mechanical actuator;
• based on execution of the action, the robotic device generating data for a computing device, wherein the generated data includes video data having a first resolution, and protocol data indicative of a communication protocol for the robotic device to communicate the video data;
• receiving information from the computing device that is indicative of a latency attributable to communication between the robotic device and the computing device;
• based on the latency, determining a latency level associated with the latency attributable to the communication of the generated data and a priority at which to provide the generated data to the computing device, wherein the priority is based on a frequency at which the generated data changes over a period of time;
• responsive to determining that the latency level is above a first threshold and below a second threshold, providing, by the robotic device, the generated data to the computing device in an order based on the priority at a reduced resolution version of the video data to the computing device and discontinuing transmission of the audio data to the computing device, wherein the second threshold is more than the first threshold;
• and
• responsive to determining that the latency level is above the second threshold, determining an alternate communication pathway by which the robotic device is capable to communicate with the computing device, and communicating with the computing device over the alternate communication pathway.