Deep neural network on field-programmable gate array
AssigneeInternational Business Machines Corporation
InventorsMitra Purandare, Dionysios Diamantopoulos, Raphael Polig
Life of this patent
Estimating the term…
Loading patent…
AssigneeInternational Business Machines Corporation
InventorsMitra Purandare, Dionysios Diamantopoulos, Raphael Polig
Estimating the term…
A field programmable gate array (FPGA) may be used for inference of a trained deep neural network (DNN). The trained DNN may comprise a set of parameters and the FPGA may have a first precision configuration defining first number representations of the set of parameters. The FPGA may determine different precision configurations of the trained DNN. A precision configuration of the precision configurations may define second number representations of a subset of the set of parameters. For each precision configuration of the determined precision configurations a bitstream file may be provided. The bitstream files may be stored so that the FPGA may be programmed using one of the stored bitstream files for inference of the trained DNN.
A method for inference of a trained deep neural network (DNN) using a field programmable gate array (FPGA), the trained DNN comprising a set of parameters, wherein the FPGA has a first precision configuration defining first number representations of the set of parameters, the method comprising:
A field programmable gate array (FPGA) configured for inference of a trained deep neural network (DNN), the trained DNN comprising a set of parameters, wherein the trained DNN is mapped to the FPGA via a configuration map by partitioning the FPGA into a static region and a reconfigurable region, partitioning the reconfigurable region into sub-regions, and mapping the trained DNN to the sub-regions of the reconfigurable dynamic regions, wherein the FPGA has a first precision configuration defining first number representations of the set of parameters, and wherein the FPGA has access to a precompiled bitstream pool with different stored bitstream files, wherein there is a compilation of a combination of layers of the trained DNN for each of the different precision configurations, the FPGA being configured for:
Dependencies are inferred from the claim text.