System level testing of artificial intelligence primitives
AssigneeInternational Business Machines Corporation
InventorsAli Y. DUALE, Timothy SLEGEL, Patrick DUFFY
Life of this patent
Estimating the term…
Abstract
Methods, system, and computer program product are disclosed for enhanced system level testing of an AI hardware accelerator comprising Artificial Intelligence (AI) primitives. The system level testing provides uncompromised test coverage of the AI hardware accelerator while enabling efficient and effective testing performance. Enhanced test data generation, result prediction, and test execution are provided for system level testing of AI hardware accelerator including the AI primitives.
Claims20
A computer implemented method comprising:
- providing a set of input data;
- replicating the set of input data to produce multiple units of input data;
- processing each of the multiple units using an Artificial Intelligence (AI) hardware accelerator to provide a first output;
- processing the set of input data using a software machine learning model to produce a result prediction output that is smaller than the multiple units of input data processed by the AI hardware accelerator;
- replicating the result prediction output to generate an expected result output which is the size as the first output;
- and
- comparing the first output and the expected result output to validate the AI hardware accelerator.
A system, comprising:
- a processor;
- and
- a memory, wherein the memory includes a computer program product to perform operations for testing of Artificial Intelligence (AI) hardware accelerator, the operations comprising:
- providing a set of input data;
- replicating the set of input data to produce multiple units of input data;
- processing each of the multiple units using the AI hardware accelerator to provide a first output;
- processing the set of input data using a software machine learning model to produce a result prediction output that is smaller than the multiple units of input data processed by the AI hardware accelerator;
- replicating the result prediction output to generate an expected result output which is the size as the first output;
- and
- comparing the first output and the expected result output to validate the AI hardware accelerator.
A computer program product for testing an Artificial Intelligence (AI) hardware accelerator, the computer program product comprising:
- a non-transitory computer-readable storage medium having computer-readable program code embodied therewith, the computer-readable program code executable by one or more computer processors to perform an operation comprising:
- providing a set of input data;
- replicating the set of input data to produce multiple units of input data;
- processing each of the multiple units using an AI hardware accelerator to provide a first output;
- processing the set of input data using a software machine learning model to produce a result prediction output that is smaller than the multiple units of input data processed by the AI hardware accelerator;
- replicating the result prediction output to generate an expected result output which is the size as the first output;
- and
- comparing the first output and the expected result output to validate the AI hardware accelerator.
Dependencies are inferred from the claim text.