Spatial region based audio separation
AssigneeGoogle Inc.
InventorsGeorge Chiachi Sung, Yang Yang, Shao-Fu Shih, Hakan Erdogan, Kevin Lee
Life of this patent
Estimating the term…
Abstract
A method includes receiving target audio data captured by a first audio input device, the target audio data comprising a target audio signal and a first version of an interfering audio signal, and receiving reference audio data captured by a second audio input device different from the first audio input device, the reference audio data comprising a second version of the interfering audio signal. The method also includes processing, using a trained neural network, the target audio data and the reference audio data to generate enhanced audio data, the neural network attenuating the interfering audio signal in the enhanced audio data.
Claims22
A computer-implemented method executed on data processing hardware that causes the data processing hardware to perform operations comprising:
- receiving target audio data captured by a first audio input device, the target audio data comprising a target audio signal and a first version of an interfering audio signal;
- receiving reference audio data captured by a second audio input device different from the first audio input device, the reference audio data comprising a second version of the interfering audio signal;
- processing, using a trained neural network, the target audio data and the reference audio data to generate enhanced audio data;
- determining at least one of a delay contrast or a magnitude contrast between the first version of the interfering audio signal and the second version of the interfering audio signal;
- and
- attenuating, using the trained neural network, at least one of the first version of the interfering audio signal or the second version of the interfering audio signal in the enhanced audio signal based on the at least one of the delay contrast or the magnitude contrast.
A system comprising:
- data processing hardware;
- and
- memory hardware in communication with the data processing hardware, the memory hardware storing instructions that, when executed on the data processing hardware, cause the data processing hardware to perform operations comprising:
- receiving target audio data captured by a first audio input device, the target audio data comprising a target audio signal and a first version of an interfering audio signal;
- receiving reference audio data captured by a second audio input device different from the first audio input device, the reference audio data comprising a second version of the interfering audio signal;
- processing, using a trained neural network, the target audio data and the reference audio data to generate enhanced audio data;
- determining at least one of a delay contrast or a magnitude contrast between the first version of the interfering audio signal and the second version of the interfering audio signal;
- and
- attenuating, using the trained neural network, at least one of the first version of the interfering audio signal or the second version of the interfering audio signal in the enhanced audio signal based on the at least one of the delay contrast or the magnitude contrast.
Dependencies are inferred from the claim text.