Textual echo cancellation
AssigneeGoogle Inc.
InventorQuan Wang
Life of this patent
Estimating the term…
Abstract
A method includes receiving an overlapped audio signal that includes audio spoken by a speaker that overlaps a segment of synthesized playback audio. The method also includes encoding a sequence of characters that correspond to the synthesized playback audio into a text embedding representation. For each character in the sequence of characters, the method also includes generating a respective cancelation probability using the text embedding representation. The cancelation probability indicates a likelihood that the corresponding character is associated with the segment of the synthesized playback audio overlapped by the audio spoken by the speaker in the overlapped audio signal.
Claims20
A computer-implemented method when executed on data processing hardware causes the data processing hardware to perform operations comprising:
- obtaining a plurality of training examples, each training example of the plurality of training examples comprising:
- a ground truth audio signal corresponding to non-synthesized speech;
- a training overlapped audio signal comprising the ground truth audio signal overlapping a synthesized audio signal;
- and
- training text comprising a respective sequence of characters representing the synthesized audio signal;
- and
- training a cancelation neural network on the plurality of training examples to teach the cancelation neural network to generate the ground truth audio signals based on the training overlapped audio signals and the training text.
A system comprising:
- data processing hardware;
- and
- memory hardware in communication with the data processing hardware, the memory hardware storing instructions that when executed on the data processing hardware cause the data processing hardware to perform operations comprising:
- obtaining a plurality of training examples, each training example of the plurality of training examples comprising:
- a ground truth audio signal corresponding to non-synthesized speech;
- a training overlapped audio signal comprising the ground truth audio signal overlapping a synthesized audio signal;
- and
- training text comprising a respective sequence of characters representing the synthesized audio signal;
- and
- training a cancelation neural network on the plurality of training examples to teach the cancelation neural network to generate the ground truth audio signals based on the training overlapped audio signals and the training text.
Dependencies are inferred from the claim text.