Systems and Methods to Test an Autonomous Vehicle

A computer-implemented method for autonomous vehicle testing, the method comprising:

• receiving, by a computing system comprising one or more computing devices and from one or more test nodes of a preconfigured test track, log data indicating positions of elements of the test track over a period of time;
• receiving, by the computing system and from an autonomous vehicle, log data indicating parameters of the autonomous vehicle over the period of time;
• and
• comparing, by the computing system, the log data indicating the positions of the elements of the test track over the period of time with the log data indicating the parameters of the autonomous vehicle over the period of time to determine a performance metric of the autonomous vehicle on the test track over the period of time.

A computing system comprising:

• one or more processors;
• and
• one or more non-transitory computer-readable media that collectively store instructions that, when executed by the one or more processors, cause the computing system to perform operations, the operations comprising:
• comparing log data indicating positions of elements of a test track over a first period of time with log data indicating parameters of an autonomous vehicle over the first period of time to determine a performance metric of the autonomous vehicle on the test track over the first period of time;
• comparing log data indicating positions of the elements of the test track over a second period of time with log data indicating parameters of the autonomous vehicle over the second period of time to determine a performance metric of the autonomous vehicle on the test track over the second period of time;
• and
• comparing the performance metric of the autonomous vehicle on the test track over the first period of time with the performance metric of the autonomous vehicle on the test track over the second period of time to determine an effect of modifying software configured to control operations of the autonomous vehicle.

One or more non-transitory computer-readable media that collectively store instructions that, when executed by one or more processors, cause a computing system to perform operations, the operations comprising:

• comparing log data indicating positions of elements of a test track over a first period of time with log data indicating positions of the elements of the test track over a second period of time;
• comparing log data indicating parameters of an autonomous vehicle over the first period of time with log data indicating the parameters of the autonomous vehicle over the second period of time;
• and
• determining an effect of modifying, between the first period of time and the second period of time, software configured to control operations of the autonomous vehicle.