Framework for validating autonomy and teleoperations systems

An apparatus comprising:

• a memory;
• a network interface configured to enable network communications;
• and
• a processor, wherein the processor is configured to perform operations comprising:
• obtaining simulation data of an autonomous driving system of a vehicle, the simulation data including first environment data representing an environment in which the vehicle is driven using the autonomous driving system;
• obtaining teleoperations driving data of a teleoperations driving system in which the vehicle is remotely controlled with an aid of a human, the teleoperations driving data including second environment data representing the environment in which the vehicle is driven using the teleoperations driving system;
• and
• determining whether the autonomous driving system in conjunction with the teleoperations driving system meets a minimum deployment standard based on the simulation data and the teleoperations driving data.

One or more non-transitory computer readable storage media encoded with instructions that, when executed by a processor, cause the processor to execute a method comprising:

• obtaining simulation data of an autonomous driving system of a vehicle, the simulation data including first environment data representing an environment in which the vehicle is driven using the autonomous driving system;
• obtaining teleoperations driving data of a teleoperations driving system in which the vehicle is remotely controlled with an aid of a human, the teleoperations driving data including second environment data representing the environment in which the vehicle is driven using the teleoperations driving system;
• and
• determining whether the autonomous driving system in conjunction with the teleoperations driving system meets a minimum deployment standard based on the simulation data and the teleoperations driving data.