Automated vehicle testing system based on requirements written in natural language

An apparatus for testing vehicle applications, the apparatus comprising:

• at least one memory storing computer-executable instructions;
• and
• at least one processor configured to execute the computer-executable instructions to:
• generate a ticket, wherein the ticket comprises at least one natural language incident scenario description;
• determine whether collected sensor data from a vehicle matches the at least one natural language incident scenario description in the ticket;
• and
• based on determining that the collected sensor data from the vehicle matches the at least one natural language incident scenario description:
• generate a requirements as code (RaC) file based on the ticket and the collected sensor data from a vehicle;
• and
• evaluate a ML model based on the RaC file to determine whether the ML model achieves a testing requirement, wherein the ML model is used to implement a vehicle application.