Circuitry for Accelerating Processing of Artificial Intelligence Models

Abstract

Embodiments relate to enhancing operations associated with an artificial intelligence (AI) model by distributing accumulator operations across multiple parallel lanes of circuit pipelines. The incoming tensors are multiplied and then the multiplied values are sent to a subset of the parallel lanes. The multiplication operations take a shorter time than the subsequent accumulation operations. By distributing the accumulator operations to multiple parallel lanes, the incoming tensors are processed seamlessly without interruption despite the accumulation operations taking longer than the multiplication operations. Operations for comparing accumulated results are also partly distributed across parallel lanes so that the highest accumulated values and their indices may also be determined seamlessly. In this way, the AI model may be executed faster and more efficiently.

Dependencies are inferred from the claim text.