Dialogue enhancement based on synthesized speech
AssigneeDolby Laboratories Licensing Corporation
InventorsTimothy Alan Port, Winston Chi Wai Ng, Mark William Gerrard
Life of this patent
Estimating the term…
Abstract
A method and a system for dialogue enhancement of an audio signal, comprising receiving (step S1) the audio signal and a text content associated with dialogue occurring in the audio signal, generating (step S2) parameterized synthesized speech from the text content, and applying (step S3) dialogue enhancement to the audio signal based on the parameterized synthesized speech. With the invention text captions, subtitles, or other forms of text content included in an audio stream, can be used to significantly improve dialogue enhancement on the playback side.
Claims20
A method for dialogue enhancement of an audio signal, comprising:
- receiving (step S1), by a microprocessor, said audio signal and a text content associated with dialogue occurring in the audio signal,
- generating (step S2), by the microprocessor, parameterized synthesized speech (Ŝ) from said text content, and
- applying (step S3), by the microprocessor, dialogue enhancement to said audio signal based on said parameterized synthesized speech (Ŝ)
- wherein the text content includes annotations identifying a specific speaker, and wherein generation of the synthesized speech is aligned with a model of the identified speaker, and
- wherein applying the dialogue enhancement includes comparing an energy of the parameterized synthesized speech (Ŝ) to a threshold, wherein the dialogue enhancement is applied when the energy exceeds the threshold.
A system for dialogue enhancement of an audio signal, based on a text content associated with dialogue occurring in the audio signal, the system comprising:
- a speech synthesizer for generating a parameterized synthesized speech (ŝ) from said text content, and
- a dialogue enhancement module, implemented by one or more processors, for applying dialogue enhancement to said audio signal based on said parameterized synthesized speech (Ŝ)
- wherein the text content includes annotations identifying a specific speaker, and wherein generation of the synthesized speech by the speech synthesizer is aligned with a model of the identified speaker, and
- wherein applying the dialogue enhancement includes comparing an energy of the parameterized synthesized speech (Ŝ) to a threshold, wherein the dialogue enhancement is applied when the energy exceeds the threshold.
A single ended receiver, comprising:
- a receiving module, implemented by one or more processors, for receiving a bit stream including an audio signal and a text content associated with dialogue occurring in the audio signal;
- a speech synthesizer for generating a parameterized synthesized speech (Ŝ) from said text content;
- and
- a dialogue enhancement module, implemented by the one or more processors, for applying dialogue enhancement to said audio signal based on said parameterized synthesized speech (Ŝ)
- wherein the text content includes annotations identifying a specific speaker, and wherein generation of the synthesized speech by the speech synthesizer is aligned with a model of the identified, and
- wherein applying the dialogue enhancement includes comparing an energy of the parameterized synthesized speech (Ŝ) to a threshold, wherein the dialogue enhancement is applied when the energy exceeds the threshold.
Dependencies are inferred from the claim text.