Number format selection for bidirectional recurrent neural networks
OwnerBiswarup Choudhury, Cagatay Dikici +2inventors
InventorsBiswarup Choudhury, Cagatay Dikici, Jason Rogers, Pedro Silva
Life of this patent
Estimating the term…
Loading patent…
OwnerBiswarup Choudhury, Cagatay Dikici +2inventors
InventorsBiswarup Choudhury, Cagatay Dikici, Jason Rogers, Pedro Silva
Estimating the term…
A computer-implemented method of selecting a number format for use in configuring a hardware implementation of a bidirectional recurrent neural network (BRNN) for operation on a sequence of inputs. A received BRNN representation is implemented as a test neural network equivalent to the BRNN over a sequence of input tensors, each step of the test neural network being for operation on (a) an input tensor of the sequence, (b) a corresponding backward state tensor generated in respect of a subsequent input tensor of the sequence, and (c) a corresponding forward state tensor generated in respect of a preceding input tensor of the sequence. The test neural network includes a forward recurrent neural network (RNN) for operation on the forward state tensors over the input tensors of the sequence; and a backward RNN for operation on the backward state tensors over the input tensors of the sequence. A number format selection algorithm is applied to collected operating statistics so as to derive a common number format for a plurality of instances of one or more selected tensors of the test neural network.
A computer-implemented method of selecting a number format for use in configuring a hardware implementation of a bidirectional recurrent neural network (BRNN) for operation on a sequence of inputs, the method comprising:
A data processing system for selecting a number format for use in configuring a hardware implementation of a bidirectional recurrent neural network (RNN) for operation on a sequence of inputs, the data processing system comprising:
A non-transitory computer readable storage medium having stored thereon computer readable instructions that, when executed at a computer system, cause the computer system to perform a computer-implemented method of selecting a number format for use in configuring a hardware implementation of a bidirectional recurrent neural network (BRNN) for operation on a sequence of inputs, the method comprising:
Dependencies are inferred from the claim text.