Automatic testing tool for testing autonomous systems

A system for virtually testing an autonomous vehicle, the system comprising:

• one or more processors and memory storing executable instructions for the one or more processors;
• and
• a virtual tester implemented using the one or more processors, wherein the virtual tester is configured for:
• receiving one or more status reports from a simulated system of the autonomous vehicle for each simulated scene of a plurality of simulated scenes;
• and
• outputting one or more test results for the system of the autonomous vehicle by, for each of the simulated scenes, performing operations comprising:
• fuzzifying one or more status parameters from the status report for the simulated scene into one or more fuzzy input parameters;
• mapping the fuzzy input parameters through a set of rules for the system of the autonomous vehicle into one or more fuzzy output parameters;
• and
• mapping the fuzzy output parameters into one or more crisp test result outputs.

A non-transitory computer readable medium comprising computer executable instructions embodied in the non-transitory computer readable medium that when executed by at least one processor of at least one computer cause the at least one computer to perform steps comprising:

• receiving, at a virtual tester implemented on a computer system comprising one or more processors, one or more status reports from a simulated system of the autonomous vehicle for each simulated scene of a plurality of simulated scenes;
• and
• outputting, from the virtual tester, one or more test results for the system of the autonomous vehicle by, for each of the simulated scenes, performing operations comprising:
• fuzzifying one or more status parameters from the status report for the simulated scene into one or more fuzzy input parameters;
• mapping the fuzzy input parameters through a set of rules for the system of the autonomous vehicle into one or more fuzzy output parameters;
• and
• mapping the fuzzy output parameters into one or more crisp test result outputs.