Support tools for autonomous vehicle testing

A computer system for assessing autonomous vehicle performance, the computer system comprising:

• at least one memory storing computer-readable instructions;
• and
• at least one processor coupled to the at least one memory and configured to execute the computer-readable instructions, which upon execution cause the at least one processor to:
• receive performance data of at least one autonomous driving run, the performance data comprising at least one time series of perception errors and at least one time series of driving performance results, wherein the at least one time series of perception errors are generated by a real-time perception system during the at least one autonomous driving run;
• and
• generate rendering data for rendering a graphical user interface, the graphical user interface for visualizing the performance data and comprising:
• (i) a perception error timeline, and
• (ii) a driving assessment timeline,
• wherein the timelines are aligned in time, and divided into multiple time steps of the at least one autonomous driving run, wherein, for each time step:
• the perception error timeline comprises a visual indication of whether a perception error occurred at that time step, and the driving assessment timeline comprises a visual indication of driving performance at that time step.

A non-transitory computer readable medium embodying computer program instructions, the computer program instructions configured so as, when executed on one or more hardware processors, to implement operations comprising:

• receiving performance data of at least one autonomous driving run, the performance data comprising at least one time series of perception errors and at least one time series of driving performance results, wherein the at least one time series of perception errors are generated by a real-time perception system during the at least one autonomous driving run;
• and
• generating rendering data for rendering a graphical user interface, the graphical user interface for visualizing the performance data and comprising:
• (i) a perception error timeline, and
• (ii) a driving assessment timeline,
• wherein the timelines are aligned in time, and divided into multiple time steps of the at least one autonomous driving run, wherein, for each time step:
• the perception error timeline comprises a visual indication of whether a perception error occurred at that time step, and the driving assessment timeline comprises a visual indication of driving performance at that time step.