Sub-matrix input for neural network layers
AssigneeGoogle Inc.
InventorsIgnacio Lopez Moreno, Yu-hsin Joyce Chen
Life of this patent
Estimating the term…
Abstract
Methods, systems, and apparatus, including computer programs encoded on computer storage media, for training a neural network. One of the methods includes generating, by a speech recognition system, a matrix from a predetermined quantity of vectors that each represent input for a layer of a neural network, generating a plurality of sub-matrices from the matrix, using, for each of the sub-matrices, the respective sub-matrix as input to a node in the layer of the neural network to determine whether an utterance encoded in an audio signal comprises a keyword for which the neural network is trained.
Claims21
1-20. (canceled)
A method performed by one or more computing devices, the method comprising:
- obtaining, by the one or more computing devices, a set of values indicating acoustic characteristics of an utterance;
- providing, by the one or more computing devices, the set of values as input to a neural network of a keyword detection system, wherein the neural network comprises a layer having nodes configured to respectively receive input derived from different proper subsets of the values provided as input to the neural network;
- obtaining, by the one more computing devices, output that the neural network provided in response to receiving the set of values;
- and
- determining, by the one or more computing devices, whether the utterance includes a keyword based on the output of the neural network.
A device comprising:
- one or more processing devices and one or more data storage devices, one or more processing devices and the one or more data storage devices being configured to implement a keyword detection function by causing the device to perform operations comprising:
- obtaining a set of values indicating acoustic characteristics of an utterance;
- providing the set of values as input to a neural network of a keyword detection system, wherein the neural network comprises a layer having nodes configured to respectively receive input derived from different proper subsets of the values provided as input to the neural network;
- obtaining output that the neural network provided in response to receiving the set of values;
- and
- determining whether the utterance includes a keyword based on the output of the neural network.
One or more non-transitory data storage devices storing instructions that, when executed by one or more processing devices, cause the one or more processing devices to perform operations comprising:
- obtaining, by the one or more processing devices, a set of values indicating acoustic characteristics of an utterance;
- providing, by the one or more processing devices, the set of values as input to a neural network of a keyword detection system, wherein the neural network comprises a layer having nodes configured to respectively receive input derived from different proper subsets of the values provided as input to the neural network;
- obtaining, by the one more processing devices, output that the neural network provided in response to receiving the set of values;
- and
- determining, by the one or more processing devices, whether the utterance includes a keyword based on the output of the neural network.
Dependencies are inferred from the claim text.