Multi-architecture rapid testing framework

A system comprising:

• an electronic processor configured to:
• receive, via a user interface, user input indicating a plurality of build architectures to be used in compiling a set of source code;
• instantiate a plurality of build environments, wherein each of the plurality of build environments is instantiated respectively according to the plurality of build architectures;
• compile the set of source code in each of the plurality of build environments to generate a respective binary file;
• and
• present, via the user interface, a respective set of one or more metrics corresponding to each respective binary file.

A method for testing binary files, the method comprising:

• obtaining, with an electronic processor, a plurality of compute types and a plurality of compilation methods, each of the plurality of compute types specifying respective build architecture;
• generating, with the electronic processor, a plurality of test scenarios based on permutations of the plurality of compute types and the plurality of compilation methods, wherein each of the plurality of test scenarios specifies a respective build architecture from the set of build architectures and a respective compilation method from the plurality of compilation methods;
• and
• for each respective test scenarios of the plurality of test scenarios:
• instantiating a respective build environment according to the respective build architecture,
• compiling the set of source code in the respective build environment using the respective compilation method to generate a respective binary file, and
• generating a respective set of one or more metrics for the respective binary file.