Speech recognition apparatus and speech recognition method
AssigneeOlympus Corporation
InventorsHiroyuki Tokiwa, Kenta Yumoto, Osamu Nonaka
Life of this patent
Estimating the term…
Abstract
A speech recognition apparatus according to an embodiment includes a microphone that acquires an audio stream in which speech vocalized by a person is recorded, a camera that acquires an image data in which at least a mouth of the person is captured, and an operation element that recognizes speech including a consonant vocalized by the person, based on the audio stream, estimates the consonant vocalized by the person, based on the shape of the mouth of the person in the image data, and specifies the consonant based on the estimated consonant and the speech-recognized consonant.
Claims9
A speech recognition apparatus comprising:
- a microphone configured to acquire an audio stream in which speech vocalized by a person is recorded;
- a camera configured to acquire an image data in which at least a mouth of the person is captured;
- an operation element configured to recognize speech including a consonant vocalized by the person based on the audio stream, estimate the consonant vocalized by the person based on a mouth shape of the person in the image data, and specify the consonant based on the estimated consonant and the speech-recognized consonant,
- wherein the operation element specifies a consonant vocalization frame which is a frame in which it is estimated that the person in the image data has vocalized a consonant before a vowel based on a timing when the vowel is detected, and estimates the consonant vocalized by the person based on the mouth shape of the person in the consonant vocalization frame and a mouth shape model that indicates a change in mouth shape for each consonant.
Dependencies are inferred from the claim text.