US 11,769,036 B2Granted

Optimizing performance of recurrent neural networks

AssigneeQUALCOMM Incorporated

InventorsRosario Cammarota, Michael Goldfarb, Manu Rastogi, Sarang Ozarde

Life of this patent

Estimating the term…

Loading patent…

Abstract

An apparatus for optimizing a computational network is configure to receive an input at a first processing component. The first processing component may include at least a first programmable processing component and a second programmable processing component. The first programmable processing component is configured to compute a first nonlinear function and the second programmable processing component is configured to compute a second nonlinear function which is different than the second nonlinear function. The computational network which may be a recurrent neural network such as a long short-term memory may be operated to generate an inference based at least in part on outputs of the first programmable processing component and the second programmable processing component.

Claims28

Dependent claims

A method of a device operating a computational network, comprising:

computing, at a second processing component, one or more linear functions to obtain one or more outputs, the second processing component configured to compute the one or more linear functions, wherein the second processing component is different from a first processing component configured to compute a plurality of nonlinear functions;
generating, at the second processing component, at least one control signal based at least in part on the one or more outputs of the second processing component;
receiving, at the first processing component and from the second processing component, an input and a plurality of control signals including the at least one control signal, the first processing component comprising at least a first programmable processing component and a second programmable processing component, wherein the input corresponds to the one or more outputs of the second processing component, and wherein the at least one control signal includes
an indication of at least a first nonlinear function to be applied to a first portion of the input and a second nonlinear function to be applied to a second portion of the input;
configuring, in accordance with the at least one control signal, the first programmable processing component to compute the first nonlinear function of the first portion of the input and the second programmable processing component to compute the second nonlinear function of the second portion of the input, the first nonlinear function being different than the second nonlinear function, and the first nonlinear function being computed simultaneously with the second nonlinear function;
and
operating the computational network to generate an inference based at least in part on simultaneous outputs of the first programmable processing component that computes the first nonlinear function, and the second programmable processing component that computes the second nonlinear function.

4 more elements

An apparatus for operating a computational network, comprising:

a memory;
and
at least one processor coupled to the memory, the at least one processor being configured to:
compute, at a second processing component, one or more linear functions to obtain one or more outputs, the second processing component configured to compute the one or more linear functions, wherein the second processing component is different from a first processing component configured to compute a plurality of nonlinear functions;
generate, at the second processing component, at least one control signal based at least in part on the one or more outputs of the second processing component;
receive, at the first processing component and from the second processing component, an input and a plurality of control signals including the at least one control signal, the first processing component comprising at least a first programmable processing component and a second programmable processing component, wherein the input corresponds to the one or more outputs of the second processing component, and wherein the at least one control signal includes
an indication of at least a first nonlinear function to be applied to a first portion of the input and a second nonlinear function to be applied to a second portion of the input;
configure, in accordance with the at least one control signal, the first programmable processing component to compute the first nonlinear function of the first portion of the input and the second programmable processing component to compute the second nonlinear function of the second portion of the input, the first nonlinear function being different than the second nonlinear function, and the first nonlinear function being computed simultaneously with the second nonlinear function;
and
operate the computational network to generate an inference based at least in part on simultaneous outputs of the first programmable processing component that computes the first nonlinear function, and the second programmable processing component that computes the second nonlinear function.

7 more elements

An apparatus for operating a computational network, comprising:

circuitry configured for:
computing, at a second processing component, one or more linear functions to obtain one or more outputs, the second processing component configured to compute the one or more linear functions, wherein the second processing component is different from a first processing component configured to compute a plurality of nonlinear functions;
generating, at the second processing component, at least one control signal based at least in part on the one or more outputs of the second processing component;
receiving, at the first processing component and from the second processing component, an input and a plurality of control signals including the at least one control signal, the first processing component comprising at least a first programmable processing component and a second programmable processing component, wherein the input corresponds to the one or more outputs of the second processing component, and wherein the at least one control signal includes
an indication of at least a first nonlinear function to be applied to a first portion of the input and a second nonlinear function to be applied to a second portion of the input;
configuring, in accordance with the at least one control signal, the first programmable processing component to compute the first nonlinear function of the first portion of the input and the second programmable processing component to compute the second nonlinear function of the second portion of the input, the first nonlinear function being different than the second nonlinear function, and the first nonlinear function being computed simultaneously with the second nonlinear function;
and
operating the computational network to generate an inference based at least in part on outputs of the first programmable processing component that computes the first nonlinear function, and the second programmable processing component that computes the second nonlinear function.

5 more elements

A non-transitory computer readable medium having executable code for operating a computational network, the code being executable to perform operations comprising:

computing, at a second processing component, one or more linear functions to obtain one or more outputs, the second processing component configured to compute the one or more linear functions, wherein the second processing component is different from a first processing component configured to compute a plurality of nonlinear functions;
generating, at the second processing component, at least one control signal based at least in part on the one or more outputs of the second processing component;
receiving, at the first processing component and from the second processing component, an input and a plurality of control signals including the at least one control signal, the first processing component comprising at least a first programmable processing component and a second programmable processing component, wherein the input corresponds to the one or more outputs of the second processing component, and wherein the at least one control signal includes
an indication of at least a first nonlinear function to be applied to a first portion of the input and a second nonlinear function to be applied to a second portion of the input;
configuring, in accordance with the at least one control signal, the first programmable processing component to compute the first nonlinear function of the first portion of the input and the second programmable processing component to compute the second nonlinear function of the second portion of the input, the first nonlinear function being different than the second nonlinear function, and the first nonlinear function being computed simultaneously with the second nonlinear function;
and
operating the computational network to generate an inference based at least in part on simultaneous outputs of the first programmable processing component that computes the first nonlinear function, and the second programmable processing component that computes the second nonlinear function.

4 more elements

Dependencies are inferred from the claim text.

Facts

Application: 15/956,674Filed 18 Apr 2018
Published: US 2019/0325289 A124 Oct 2019
Granted: 26 Sep 2023
Term ends: Not estimatedThe source records don’t support an estimate.

Classification7 codes

G06N 3/0442
Recurrent networks, e.g. Hopfield networks: characterised by memory or gating, e.g. long short-term memory [LSTM] or gated recurrent units [GRU]
G06N 3/063
Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons: using electronic means
G06N 3/044
Architecture, e.g. interconnection topology: recurrent networks, e.g. Hopfield networks
G06N 3/0464
Architecture, e.g. interconnection topology: convolutional networks [CNN, ConvNet]