Speech recognition accuracy in a multimodal input system
AssigneeCanon Kabushiki Kaisha
InventorsRobert Alexander Keiller, Nicolas Davis Fortescue
Life of this patent
Estimating the term…
Abstract
A speech recognition method for use in a multimodal input system comprises receiving a multimodal input comprising digitized speech as a first modality input and data in at least one further modality input. Features in the speech and in the data in at least one further modality are identified. The identified features in the speech and in the data are used in the recognition of words by comparing the identified features with states in models for the words. The models have states for the recognition of speech and for words having features in at least one further modality associated with the words, the models also have states for the recognition of events in the or each further modality.
Claims24
A speech recognition method for use in a complementary multimodal input system, the method comprising:
- receiving a complementary multimodal input comprising digitized speech as a first modality input and data in at least one further modality input;
- identifying at least one feature in the speech and at least one feature in the data in said at least one further modality input;
- and
- recognising words by comparing identified features in the speech and in the data with states in models for words, said models having states for the recognition of speech, and for words having at least one feature in said at least one further modality associated therewith the models also having states for the recognition of events in said at least one further modality.
A multimodal input method comprising the speech recognition method according to any preceding claim to generate recognised words as a first modality input;
- receiving at least one further modality input;
- and
- processing the recognised words and the or each further modality input in accordance with rules to generate an input for a process.
Speech recognition apparatus for use in a complementary multimodal input system, the apparatus comprising:
- receiving means for receiving a complementary multimodal input comprising digitized speech as a first modality input and data in at least one further modality input;
- identifying means for identifying at least one feature in the speech and at least one feature in the data in said at least one further modality input;
- and
- recognition means for recognising words by comparing identified features in the speech and in the data with states in models for words, said models having states for the recognition of speech, and for words having at least one feature in said at least one further modality associated therewith the models also having states for the recognition of events in said at least one further modality.
Dependencies are inferred from the claim text.