Navigating network-based electronic information using spoken input with multimodal error feedback
AssigneeSRI International
InventorsChristine Halverson, Luc Julia, Dimitris Voutsas, Aden J. Cheyer
Life of this patent
Estimating the term…
Abstract
A system, method, and article of manufacture are provided for navigating an electronic data source by means of spoken language. When a spoken input request is received from a user, it is interpreted. Additional input is solicited from the user in a modality different than the original request and used to refine the navigation query. The resulting interpretation of the request is thereupon used to automatically construct an operational navigation query to retrieve the desired information from one or more electronic network data sources.
Claims130
A method for speech-based navigation of an electronic data source, the electronic data source being located at one or more network servers located remotely from a user, comprising the steps of:
- (a) receiving a spoken request for desired information from the user;
- (b) rendering an interpretation of the spoken request;
- (c) constructing at least part of a navigation query based upon the interpretation;
- (d) soliciting additional input from the user, including user interaction in a non-spoken modality different than the original request without requiring the user to request said non-spoken modality;
- (e) refining the navigation query, based upon the additional input;
- (f) using the refined navigation query to select a portion of the electronic data source;
- and
- (g) transmitting the selected portion of the electronic data source from the network server to a client device of the user.
The method of claim 3, wherein the step of extracting the input template includes dynamically scraping the online scripted interface.
The method of claim 11, wherein the deficiencies include existence of more than one data record within the data source responsive to the navigation query.
The method of claim 11, wherein the deficiencies include failure to identify a single data record within the data source responsive to the navigation query.
A system for speech-based navigation of an electronic data source, the electronic data source being located at one or more network servers located remotely from a user, the system comprising:
- (a) a portable microphone operable to receive a spoken request for desired information from the user;
- (b) language processing logic, operable to render an interpretation of the spoken request;
- (c) query construction logic, operable to construct a navigation query in response to the interpretation of the spoken request;
- (d) user interaction logic, operable to solicit additional input from the user, including user interaction in a non-spoken modality different than the original request without requiring the user to request said non-spoken modality;
- (e) query refining logic, operable to refine the navigation query, based upon the additional input;
- (f) navigation logic, operable to select a portion of the electronic data source using the navigation query;
- and
- (g) electronic communications infrastructure for transmitting the selected portion of the electronic data source from the network server to a primarily stationary, display device located locally with the user.
A computer program embodied on a computer readable medium for speech-based navigation of an electronic data source, the electronic data source being located at one or more network servers located remotely from a user, comprising:
- (a) a code segment that receives a spoken request for desired information from the user;
- (b) a code segment that renders an interpretation of the spoken request;
- (c) a code segment that constructs at least part of a navigation query based upon the interpretation;
- (d) a code segment that solicits additional input from the user, including user interaction in a non-spoken modality different than the original request without requiring the user to request said non-spoken modality;
- (e) a code segment that refines the navigation query, based upon the additional input;
- (f) a code segment that uses the refined navigation query to select a portion of the electronic data source;
- and
- (g) a code segment that transmits the selected portions of the electronic data source from the network server to a primarily stationary, display device located locally with the user.
A method for utilizing spoken natural language for navigating an electronic data source, the electronic data source being located at one or more network servers located remotely from a user;
- comprising the steps of:
- (a) receiving a spoken natural language (“NL”) request for desired information from the user;
- (b) rendering an interpretation of the spoken request;
- (c) constructing at least part of a navigation query based upon the interpretation;
- (d) soliciting additional input from the user, including user interaction in a non-spoken modality different than the original request without requiring the user to request said non-spoken modality;
- (e) refining the navigation query, based upon the additional input;
- (f) using the refined navigation query to select a portion of the electronic data source;
- and
- (g) transmitting the selected portion of the electronic data source from the network server to a client device,of the user.
A system or utilizing spoken natural language to navigate an electronic data source, the electronic data source being located at one or more network servers located remotely from a user, the system comprising:
- (a) a portable microphone operable to receive a spoken natural language (“NL”) request for desired information from the user;
- (b) spoken language processing logic, operable to render an interpretation of the spoken natural language request;
- (c) query construction logic, operable to construct a navigation query in response to the interpretation of the spoken natural language request;
- (d) user interaction logic, operable to solicit additional input from the user, including user interaction in a non-spoken modality different than the original request without requiring the user to request said non-spoken modality;
- (e) query refining logic, operable to refine the navigation query, based upon the additional input;
- (f) navigation logic, operable to select a portion of the electronic data source using the navigation query;
- and
- (g) electronic communications infrastructure for transmitting the selected portion of the electronic data source from the network server to a primarily stationary, display device located locally with the user.
A computer program embodied on a computer readable medium for utilizing spoken natural language for navigating an electronic data source, the electronic data source being located at one or more network servers located remotely from a user, comprising:
- (a) a code segment that receives a spoken natural language (“NL”) request for desired information from the user;
- (b) a code segment that renders an interpretation of the spoken natural language request,
- (c) a code segment that constructs at least part of a navigation query based upon the interpretation;
- (d) a code segment that solicits additional input from the user, including user interaction in a non-spoken modality different than the original request without requiring the user to request said non-spoken modality;
- (e) a code segment that refines the navigation query, based upon the additional inputs;
- (f) a code segment that uses the refined navigation query to select a portion of the electronic data source;
- and
- (g) a code segment that transmits the selected portion of the electronic data source from the network server to a primarily stationary, display device located locally with the user.
A method for utilizing spoken natural language for navigating an electronic data source, the electronic data source being located at one or more network servers located remotely from a user, comprising the steps of:
- (a) receiving a spoken natural language (“NL”) request for desired information from the user;
- (b) rendering an interpretation of the spoken request;
- (c) constructing at least part of a navigation query based upon the interpretation;
- (d) soliciting additional input from the user, including user interaction in a non-spoken modality different than the original request, in accordance with results generated from said at least part of a navigation query;
- (e) refining the navigation query, based upon the additional input;
- (f) using the refined navigation query to select a portion of the electronic data source;
- and
- (g) transmitting the selected portion of the electronic data source from the network server to a client device of the user.
A method for utilizing spoken natural language for navigating an electronic data source, the electronic data source being located at one or more network servers located remotely from a user, comprising the steps of:
- (a) receiving a spoken natural language (“NL”) request for desired information from the user;
- (b) rendering an interpretation of the spoken request;
- (c) constructing at least part of a navigation query based upon the interpretation;
- (d) soliciting additional input from the user, including user interaction in a non-spoken modality different than the original request, in response to one or more deficiencies encountered during the step of constructing said at least part of a navigation query;
- (e) refining the navigation query, based upon the additional input;
- (f) using the refined navigation query to select a portion of the electronic data source;
- and
- (g) transmitting the selected portion of the electronic data source from the network server to a client device of the user.
Dependencies are inferred from the claim text.