System and method of handling problematic input during context-sensitive help for multi-modal dialog systems
AssigneeAT&T Corp.
InventorsPatrick Ehlen, Helen Hastie, Michael Johnston
Life of this patent
Estimating the term…
Abstract
A method of presenting a multi-modal help dialog move to a user in a multi-modal dialog system is disclosed. The method comprises presenting an audio portion of the multi-modal help dialog move that explains available ways of user inquiry and presenting a corresponding graphical action performed on a user interface associated with the audio portion. The multi-modal help dialog move is context-sensitive and uses current display information and dialog contextual information to present a multi-modal help move that is currently related to the user. A user request or a problematic dialog detection module may trigger the multi-modal help move.
Claims25
In a multi-modal dialog system, a method of presenting a multi-modal help dialog move to a user in a problematic dialog situation, the method comprising:
- receiving a plurality of utterances that do not meet a successful recognition threshold;
- presenting an audio portion of a multi-modal help dialog move that explains available ways of user inquiry;
- and
- presenting a corresponding graphical action performed on a user interface associated with the audio portion.
In a multi-modal dialog system, a method of presenting a multi-modal help dialog move to a user in a problematic dialog situation, the method comprising:
- receiving at least one utterance that does not meet an utterance recognition threshold and at least one graphical user input that does not meet a graphical user input recognition threshold;
- presenting an audio portion of a multi-modal help dialog move that explains available ways of user inquiry;
- and
- presenting a corresponding graphical action performed on a user interface associated with the audio portion.
In a multi-modal dialog system, a method of presenting a multi modal help dialog move to a user in a problematic situation, comprising:
- analyzing a current dialog state with the user, including a visual context, to determine whether a problematic condition exists;
- if the multi-modal dialog system determines that a problematic condition exists:
- presenting the multi-modal help dialog move having an audio portion and a graphical portion that utilize the visual context of the current dialog state with the user.
In a multi-modal dialog system, a method of presenting a multi-modal help dialog move to a user in a problematic dialog situation, the method comprising:
- receiving a plurality of utterances that do not meet a successful recognition threshold, the number of plurality of utterances being set according to user experience and automatic speech recognition parameters;
- presenting an audio portion of a multi-modal help dialog move that explains available ways of user inquiry;
- and
- presenting a corresponding graphical action performed on a user interface associated with the audio portion.
In a multi-modal dialog system, a method of presenting a multi-modal help dialog move to a user, comprising:
- upon detecting a problematic dialog situation wherein a multi-modal dialog system receives a plurality of user inputs that do not meet recognition thresholds, presenting the multi modal help dialog move having an audio portion and a graphical portion that utilize a visual context of the current dialog state with the user, wherein the multi-modal help dialog move provides information to the user regarding how to interact with the system in a multi-modal fashion.
In a multi-modal dialog system using a map display having an entity of interest thereon, a method of presenting a multi-modal help dialog move to a user in a problematic situation, comprising:
- determining whether the user is in a problematic situation wherein at least one type of multi-modal input is not recognized by the system, and if a problematic situation exists and when an entity of interest is currently being displayed to the user:
- presenting a multi-modal help dialog move having an audio portion and a graphical portion, the audio portion stating a plurality of types of information available to the user associated with the entity of interest, and the graphical portion corresponding to the audio portion.
A method of assisting a user to interact with a system having a multi-modal interface, the method comprising:
- determining whether a problematic situation exists wherein a system with a multi-modal interface has received a plurality of multi-modal user inputs that do not meet a recognition threshold;
- and
- upon determining that help is needed, presenting to the user a multi-modal dialog help move having an audio portion and a graphical portion, the multi-modal dialog help move audibly explaining to the user available multi-modal actions the user can take to obtain information while providing corresponding graphics demonstrating the kind of graphic input the user can make to obtain the information.
In a multi-modal dialog system using a map display having a plurality of entities of interest thereon, a method of presenting a multi modal help dialog move to a user in a problematic situation, comprising:
- determining whether a problematic situation exists wherein the multi-modal dialog system has received a plurality of user inputs that do not meet recognition thresholds, and if a problematic situation exists:
- selecting an entity of interest from the plurality of entities of interest currently displayed to the user;
- and
- presenting a multi-modal help dialog move having an audio portion and a graphical portion, the audio portion stating a plurality of types of information available to the user associated with the selected entity of interest, and the graphical portion being associated with the audio portion.
Dependencies are inferred from the claim text.