Speech recognition using multiple sensors
AssigneeNura Holdings Pty Ltd
InventorsLuke John Campbell, Dragan Petrovic
Life of this patent
Estimating the term…
Abstract
Introduced here are systems and methods to increase accuracy of speech recognition by utilizing multiple sensors placed at multiple speech transmission regions such as a user's lips, throat, ear canal, etc. The various speech transmission regions are better at transmitting certain phonemes, and a sensor placed close to a particular speech transition region can more accurately detect the phoneme transmitted through the particular speech transmission region. For example, a microphone placed close to the lips can better detect labial phonemes such as m, n, p, and b, than a microphone placed close to the throat. Further, disclosed here are ways to reduce energy consumption while performing speech recognition.
Claims32
A system comprising:
- a first microphone, to be disposed at an entrance or within a user's ear canal, to measure a first sound transmitted through the user's ear canal;
- a second microphone, to be disposed proximate to a user's lips, to measure a second sound transmitted through the user's lips;
- a processor configured to:
- receive a first measurement of the first sound and a second measurement of the second sound;
- and
- enhance an accuracy of a speech recognition algorithm by determining a difference between a part of the first sound and a part of the second sound and based on the difference modify probabilities of phoneme predictions, the difference between the part of the first sound and the part of the second sound comprising a difference between an amplitude and a phase associated with the first sound and the second sound recorded from each microphone.
A system comprising:
- a plurality of sensors, a first sensor in the plurality of sensors to be disposed at an entrance of or within a user's ear canal and a second sensor in the plurality of sensors to be disposed in proximity to a speech transmission region associated with a user's speech system, the first sensor to sense a first sound in the user's ear canal and the second sensor to sense a second sound transmitted by the speech transmission region;
- a processor configured to:
- receive one or more measurements of the first sound and the second sound;
- and
- enhance an accuracy of a speech recognition algorithm by determining a difference between a part of the first sound and a part of the second sound and based on the difference modify probabilities of phoneme predictions.
A method comprising:
- measuring a plurality of sounds transmitted by a plurality of speech transmission regions associated with a user's speech system by a plurality of sensors, a first sensor in the plurality of sensors to be disposed at an entrance of or within a user's ear canal and a second sensor in the plurality of sensors to be disposed in proximity to a speech transmission region, the first sensor to measure a first sound at the entrance of or within the user's ear canal and the second sensor to measure a second sound transmitted by the speech transmission region;
- and
- enhancing an accuracy of a speech recognition algorithm by determining a difference between a part of the first sound and a part of the second sound and based on the difference modify probabilities of phoneme predictions.
Dependencies are inferred from the claim text.