Test visualisation tool

A method for visualising runs of a driving scenario in which an ego agent navigates a road layout, the method comprising:

• receiving a map of the road layout of the driving scenario and run data of a run of the driving scenario, wherein the run data comprises:
• a sequence of timestamped ego agent states,
• a time-varying numerical score quantifying performance of the ego agent with respect to each rule of a set of run evaluation rules, computed by applying the run evaluation rule to the run,
• generate rendering data for causing a graphical user interface to display:
• for each rule of the run evaluation rules:
• a plot of the time-varying numerical score, and
• a marker denoting a selected time index on a time axis of the plot, the marker being movable along the time axis via user input at the graphical user interface to change the selected time index, and
• a scenario visualization comprising a visualization of the road layout, overlaid with an agent visualization of the run at the selected time index, whereby moving the marker along the time axis causes an update to the scenario visualization as the selected time index is changed.

A non-transitory computer readable medium embodying computer program instructions, the computer program instructions configured so as, when executed on one or more hardware processors, to implement operations comprising:

• receiving a map of a road layout of a driving scenario and run data of a run of the driving scenario, wherein the run data comprises:
• a sequence of timestamped ego agent states,
• a time-varying numerical score quantifying performance of the ego agent with respect to each rule of a set of run evaluation rules, computed by applying the run evaluation rule to the run,
• generate rendering data for causing a graphical user interface to display:
• for each rule of the run evaluation rules:
• a plot of the time-varying numerical score, and
• a marker denoting a selected time index on a time axis of the plot, the marker being movable along the time axis via user input at the graphical user interface to change the selected time index, and
• a scenario visualization comprising a visualization of the road layout, overlaid with an agent visualization of the run at the selected time index, whereby moving the marker along the time axis causes the computer program instructions to update the scenario visualization as the selected time index is changed.