Data synthesis for autonomous control systems

A system comprising:

• one or more processors configured to:
• obtain sensor data comprising first sensor data generated by a first sensor and second sensor data generated by a second sensor, the sensor data generated during operation of a vehicle through an environment;
• provide the sensor data to a model to cause the model to generate an output, the model configured to receive the sensor data and output reconstructed sensor data based on the sensor data, the reconstructed sensor data comprising the sensor data generated by the first sensor and updated second sensor data,
• wherein the updated second sensor data comprises the second sensor data and augmented data associated with the sensor data generated by the first sensor;
• generate one or more control signals based on the reconstructed sensor data;
• and
• provide control data associated with the one or more control signals, the control data configured to cause the vehicle to navigate through the environment based on the reconstructed sensor data.

A non-transitory computer storage media storing instructions that, when executed by a system of one or more processors, cause the one or more processors to:

• obtain sensor data comprising first sensor data generated by a first sensor and second sensor data generated by a second sensor, the sensor data generated during operation of a vehicle through an environment;
• provide the sensor data to a model to cause the model to generate an output, the model configured to receive the sensor data and output reconstructed sensor data based on the sensor data, the reconstructed sensor data comprising the sensor data generated by the first sensor and updated second sensor data,
• wherein the updated second sensor data comprises the second sensor data and augmented data associated with the sensor data generated by the first sensor;
• generate one or more control signals based on the reconstructed sensor data;
• and
• provide control data associated with the one or more control signals, the control data configured to cause the vehicle to navigate through the environment based on the reconstructed sensor data.