Vehicle analysis environment with displays for vehicle sensor calibration and/or event simulation

A method for simulation, the method comprising:

• receiving a plurality of camera datasets from a camera coupled to a housing, wherein the camera captures the plurality of camera datasets observing one or more displays external to an autonomous vehicle (AV) over a course of a simulation time period, wherein the plurality of camera datasets capture a simulation of a dynamic scene within a virtual environment presented on the one or more displays for testing or training performance of cameras coupled to the housing;
• identifying, within at least a subset of the plurality of camera datasets, one or more visual representations of one or more portions of the virtual environment displayed on the one or more displays external to the AV in an analysis environment;
• generating a mapped representation of the virtual environment based on the one or more visual representations of the one or more portions of the virtual environment;
• identifying an event occurring within the virtual environment over the course of the simulation time period based on the mapped representation of the virtual environment;
• identifying one or more actions to be taken by the AV in response to the event occurring within the virtual environment;
• and
• outputting the one or more actions for calibrating AV response to the event.

A non-transitory computer readable storage medium having embodied thereon a program, wherein the program is executable by a processor to perform a method of simulation, the method comprising:

• receiving a plurality of camera datasets from a camera coupled to a housing, wherein the camera captures the plurality of camera datasets observing one or more displays external to an autonomous vehicle (AV) over a course of a simulation time period, wherein the plurality of camera datasets capture a simulation of a dynamic scene within a virtual environment presented on the one or more displays for testing or training performance of cameras and actuators coupled to the housing;
• identifying, within at least a subset of the plurality of camera datasets, one or more visual representations of one or more portions of the virtual environment displayed on the one or more displays external to the AV in an analysis environment;
• generating a mapped representation of the virtual environment based on the one or more visual representations of the one or more portions of the virtual environment;
• identifying an event occurring within the virtual environment over the course of the simulation time period based on the mapped representation of the virtual environment;
• identifying one or more actions to be taken by the AV in response to the event occurring within the virtual environment;
• and
• outputting the one or more actions for calibrating AV response to the event.