Allocating blocks of unified memory for integrated circuit executing neural network
AssigneeAmazon Technologies, Inc.
InventorsJung Ko, Kenneth Duong, Steven L. Teig, Won Rhee
Life of this patent
Estimating the term…
Loading patent…
AssigneeAmazon Technologies, Inc.
InventorsJung Ko, Kenneth Duong, Steven L. Teig, Won Rhee
Estimating the term…
Some embodiments provide a method that receives a specification of a neural network for execution by an integrated circuit. The integrated circuit includes a neural network inference circuit for executing the neural network to generate an output based on an input, an input processing circuit for providing the input to the neural network inference circuit, a microprocessor circuit for controlling the neural network inference circuit and the input processing circuit, and a unified memory accessible by the microprocessor circuit, the neural network inference circuit, and the input processing circuit. The method determines usage of the unified memory by the neural network inference circuit while executing the neural network. Based on the determined usage by the neural network inference circuit, the method allocates portions of the unified memory to the microprocessor circuit and input processing circuit.
A method for a compiler that generates configuration data to enable an integrated circuit (IC) to execute a neural network, the method comprising:
A non-transitory machine-readable medium storing a program for execution by at least one processing unit, the program comprising sets of instructions for:
Dependencies are inferred from the claim text.