Validation of virtual camera models

A system for validating a simulated camera in a simulation environment, comprising:

• a storage configured to store instructions;
• a processor configured to execute the instructions and cause the processor to:
• present at least one reference chart in the simulated environment;
• capture images of the at least one reference chart in the simulated environment using the simulated camera;
• interrupt an image pipeline of the simulated camera after at least one simulated process in the image pipeline to extract a raw image, wherein the simulated camera is a simulation of a real-world camera and the simulation of the simulated camera includes a simulation of components of the real-world camera and the image pipeline of the real-world camera, wherein extracting at least one raw image from the image signal processor occurs after a particular image processing step;
• analyze the raw image to derive measurements of metrics to characterize the simulated camera;
• and
• compare the measurements of metrics to metrics of a calibrated real-world camera to verify that the measurements of metrics are within a threshold delta that is indicative that the simulated camera sufficiently approximates the real-world camera.

A non-transitory computer readable medium comprising instructions, the instructions, when executed by a computing system, cause the computing system to:

• present at least one reference chart in the simulated environment;
• capture images of the at least one reference chart in the simulated environment using a simulated camera;
• interrupt an image pipeline of the simulated camera after at least one simulated process in the image pipeline to extract a raw image, wherein the simulated camera is a simulation of a real-world camera and the simulation of the simulated camera includes a simulation of components of the real-world camera and the image pipeline of the real-world camera, wherein extracting at least one raw image from the image signal processor occurs after a particular image processing step;
• analyze the raw image to derive measurements of metrics to characterize the simulated camera;
• and
• compare the measurements of metrics to metrics of a calibrated real-world camera to verify that the measurements of metrics are within a threshold delta that is indicative that the simulated camera sufficiently approximates the real-world camera.