Back to results
US 12,694,701 B1Granted
Partial neural network activation
AssigneeNVIDIA Corporation
InventorsJorge Albericio Latorre, Michael Ranzinger
Life of this patent
Estimating the term…
Abstract
Apparatuses, systems, and techniques to perform inferencing with neural networks. In at least one embodiment, portions of one or more neural networks are selected for use in inferencing based, at least in part, on information to be inferenced by the one or more neural networks.
Claims20
A processor, comprising:
- one or more circuits to:
- cause one or more layers of one or more neural networks to generate output values from performing a portion of inferencing based, at least in part, on input data;
- cause one or more sub-networks to be selected from among a plurality of sub-networks of the one or more neural networks to complete the inferencing based, at least in part, on the input data or the output values from the one or more layers;
- and
- provide the output values from the one or more layers to the selected one or more sub-networks, wherein the output values are duplicated to each selected sub-network such that the portion of inferencing is common to the plurality of sub-networks to complete the inferencing.
2 more elements
A method, comprising:
- performing a portion of inferencing by one or more layers of one or more neural networks to generate output values based, at least in part, on input data;
- selecting one or more sub-networks from among a plurality of sub-networks of the one or more neural networks to complete the inferencing based, at least in part, on the input data or the output values from the one or more layers;
- and
- providing the output values from the one or more layers to the selected one or more sub-networks, wherein the output values are duplicated to each selected sub-network such that the portion of inferencing is common to the plurality of sub-networks to complete the inferencing.
1 more element
A system, comprising:
- one or more processors to:
- cause one or more layers of one or more neural networks to generate output values from performing a portion of inferencing based, at least in part, on input data;
- cause one or more sub-networks to be selected from among a plurality of sub-networks of the one or more neural networks to complete the inferencing based, at least in part, on the input data or the output values from the one or more layers;
- and
- provide the output values from the one or more layers to the selected one or more sub-networks, wherein the output values are duplicated to each selected sub-network such that the portion of inferencing is common to the plurality of sub-networks to complete the inferencing.
2 more elements
Dependencies are inferred from the claim text.