Apparatus for generating from an audio signal a moving visual lip image from which a speech content of the signal can be comprehended by a lipreader
OwnerRobert P. Slagerinventor
Life of this patent
Estimating the term…
Abstract
A device for facilitating comprehension by a hearing impaired person of a telephone conversation includes a cord coupling to a telephone line a circuit which can convert the received audio speech signal into a series of phonemes. The circuit also includes an arrangement which correlates the series of phonemes to respective human lip shapes and displays on a display device a succession of images of the respective lip shapes. This permits the hearing impaired person to carry out lip reading of the displayed lip shapes while listening to the telephone conversation, which improves the person's level of comprehension of the conversation.
Claims9
An apparatus comprising:
- a circuit, means for coupling said circuit to a line carrying an audio speech signal, and display means coupled to said circuit, said circuit including means for breaking the audio speech signal into a series of successive phonemes representative of vowels and consonants, and means responsive to said series of phonemes for generating and for displaying on said display means an image of moving human lips substantially synchronized in real time to said audio speech signal and having an accuracy which permits a person with lipreading skills to comprehend a substantial portion of a speech content of the audio speech signal through lipreading of said image, said image including a succession of lip shapes respectively corresponding to respective said phonemes in said series of phonemes.
An apparatus comprising:
- a circuit, means for providing at an input to said circuit an audio speech signal, and display means coupled to said circuit, said circuit including means responsive to the audio speech signal for determining a phonetic content of said audio speech signal which is representative of vowels and consonants embodied in said audio speech signal, for synthesizing from said phonetic content an image of human lips forming a succession of lip shapes representative of said phonetic content, and for displaying on said display means said synthesized image of human lips forming said succession of lip shapes, said image being substantially synchronized in real time to said audio speech signal and having an accuracy which permits a person with lipreading skills to comprehend a substantial portion of a speech content of said audio speech signal through lipreading of said image.
An apparatus comprising:
- a circuit, means for supplying to an input of said circuit an audio speech signal, and display means coupled to said circuit, said circuit including means for breaking the audio speech signal into a series of successive phonemes representative of vowels and consonants, and means for associating with each of said phonemes in said series a respective image of human lips forming a respective lip shape which corresponds to the phoneme, and for displaying on said display means each of said images in an order corresponding to the order in said series of the associated phonemes, said image being substantially synchronized in real time to said audio speech signal and having an accuracy which permits a person with lipreading skills to comprehend a substantial portion of a speech content of said audio speech signal through lipreading of said image.
Dependencies are inferred from the claim text.