Back to results
US 2018/0018990 A1Published application
Device specific multi-channel data compression
AssigneeGoogle Inc.
InventorsCHANWOO KIM, Rajeev Conrad Nongpiur, TARA SAINATH
Life of this patent
Estimating the term…
Abstract
A sensor device may include a computing device in communication with multiple microphones. A neural network executing on the computing device may receive audio signals from each microphone. One microphone signal may serve as a reference signal. The neural network may extract differences in signal characteristics of the other microphone signals as compared to the reference signal. The neural network may combine these signal differences into a lossy compressed signal. The sensor device may transmit the lossy compressed signal and the lossless reference signal to a remote neural network executing in a cloud computing environment for decompression and sound recognition analysis.
Claims35
A method comprising:
- determining, by at least a first neural network layer of a neural network of a first device, a first signal difference between a signal characteristic of a first audio signal and a signal characteristic of a second audio signal, wherein the first signal difference includes a difference in a frequency response;
- compressing, by at least a second neural network layer of the neural network and based on the first signal difference, the first audio signal and the second audio signal into a third audio signal;
- and
- providing, by the first device to a second device, the first audio signal and the third audio signal.
1 more element
A non-transitory, computer-readable medium storing instructions that, when executed by a processor, cause the processor to perform operations comprising:
- determining, by at least a first neural network layer of a neural network of a first device, a first signal difference between a signal characteristic of a first audio signal and a signal characteristic of a second audio signal, wherein the first signal difference includes a difference in a frequency response;
- compressing, by at least a second neural network layer of the neural network and based on the first signal difference, the first audio signal and the second audio signal into a third audio signal;
- and
- providing, by the first device to a second device, the first audio signal and the third audio signal.
1 more element
A first device comprising:
- a processor;
- and
- a non-transitory, computer-readable medium in communication with the processor and storing instructions that, when executed by the processor, cause the processor to perform operations comprising:
- determining, by at least a first neural network layer of a neural network of a first device, a first signal difference between a signal characteristic of a first audio signal and a signal characteristic of a second audio signal, wherein the first signal difference includes a difference in a frequency response;
- compressing, by at least a second neural network layer of the neural network and based on the first signal difference, the first audio signal and the second audio signal into a third audio signal;
- and
- providing, to a second device, the first audio signal and the third audio signal.
4 more elements
A method comprising:
- generating, by a first device and based on a first audio signal and a second audio signal, a third audio signal;
- determining, by at least a first neural network layer of a neural network of the first device, a first signal difference between a signal characteristic of the first audio signal and a signal characteristic of the third audio signal;
- determining, by at least the first neural network layer, a second signal difference between a signal characteristic of the second audio signal and a signal characteristic of the third audio signal;
- compressing, by at least a second neural network layer of the neural network based on the first signal difference and the second signal difference, the first audio signal and the second audio signal into a fourth audio signal;
- and
- providing, by the first device to a second device, the third audio signal and the fourth audio signal.
3 more elements
A non-transitory, computer-readable medium storing instructions that, when executed by a processor, cause the processor to perform operations comprising:
- generating, by a first device based on a first audio signal and a second audio signal;
- a third audio signal;
- determining, by at least a first neural network layer of a neural network of the first device, a first signal difference between a signal characteristic of the first audio signal and a signal characteristic of the third audio signal;
- determining, by at least the first neural network layer, a second signal difference between a signal characteristic of the second audio signal and a signal characteristic of the third audio signal;
- compressing, by at least a second neural network layer of the neural network based on the first signal difference and the second signal difference, the first audio signal and the second audio signal into a fourth audio signal;
- and
- providing, by the first device to a second device, the third audio signal and the fourth audio signal.
4 more elements
A method comprising:
- determining, by a first neural network executing on one or more first computing devices, a plurality of signal differences between one or more signal characteristics of a first audio signal of a first plurality of audio signals and one or more signal characteristics of one or more other audio signals of the first plurality of audio signals, wherein the first signal difference includes a difference in a frequency response;
- compressing, by the first neural network and based on the plurality of signal differences, the first plurality of audio signals into a compressed audio signal;
- providing, by the one or more first computing devices, the first audio signal and the compressed audio signal to a second neural network executing on one or more second computing devices;
- receiving, by the first neural network from the second neural network, a second plurality of audio signals decompressed by the second neural network from the first audio signal and the compressed audio signal;
- comparing, by the one or more first computing devices, the first plurality of audio signals to the second plurality of audio signals;
- and
- training, by the one or more first computing devices, the first neural network based on the comparison of the first plurality of audio signals to the second plurality of audio signals.
4 more elements
Dependencies are inferred from the claim text.