# US 2013/0297312 A1 · Systems and Methods for Off-Board Voice-Automated Web Searching

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2013/0297312 A1
- Document ID: US20130297312A1
- Status: Published application
- Kind: A1
- Application number: 13/937,362
- Filed: 2013-07-09
- Published: 2013-11-07
- Earliest claimed: 2005-01-05
- Assignees: Agero Connected Services, Inc.
- Applicants: Agero Connected Services, Inc.
- Inventors: Thomas Barton Schalk
- Web page: https://patentgrep.com/patent/US20130297312A1

## CPC

- G01C 21/3608: {using speech input, e.g. using speech recognition}
- G01C 21/26: specially adapted for navigation in a road network
- G10L 15/00: Speech recognition (G10L17/00 takes precedence)
- G10L 15/04: Segmentation; Word boundary detection
- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L 15/30: Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
- G10L 21/06: Transformation of speech into a non-audible representation, e.g. speech visualisation or speech processing for tactile aids (G10L15/26 takes precedence)
- G10L 2015/221: {Announcement of recognition results}
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

A system for surfing the web includes a mobile system for processing and transmitting through a wireless link a voice stream spoken by a user of the mobile system and a data center for processing the voice stream received into voice web search information. The continuous voice stream includes a web search request. The data center performs automated voice recognition processing on the voice web search information to recognize components of the web search request, confirms the recognized components of the web search request through interactive speech exchanges with the user through the wireless link and the mobile system, selectively allows human data center operator intervention to assist in identifying the selected recognized web search components having a recognition confidence below a selected threshold value, and downloads web search results pertaining to the web search request for transmission to the mobile system derived from the confirmed recognized web search components.

## Claims

### Claim 1

A method of entering a web search string, which comprises:
receiving at a mobile processing system a continuous voice stream spoken by a user of the mobile processing system, the continuous voice stream including a web search request being at least one of:
a search phrase; and
a keyword;
processing the continuous voice stream into web search information;
transmitting the processed web search information through a wireless link to a remote data center;
analyzing the processed web search information with a voice recognition system at the remote data center to recognize components of the web search request spoken by the user;
generating at the remote data center a list of hypothetical recognized components of the web search request listed by confidence levels as calculated for each component of the web search request analyzed by the voice recognition system;
displaying the list of hypothetical recognized components and confidence levels at the remote data center for selective checking by a human data center operator;
selecting a set of hypothetical recognized components based on the confidence levels in the list;
confirming the accuracy of the selected set of hypothetical recognized components of the web search request through interactive voice exchanges between the user and the remote data center;
determining web search results from confirmed components of the web search request;
formatting the determined web search results at the remote data center; and
transmitting the determined web search results to the mobile processing system from the remote data center through the wireless link.

### Claim 2 (depends on 1)

The method according to claim 1, which further comprises carrying out the accuracy confirming step by:
transmitting a computer-generated representation of at least one hypothetical recognized component of the web search request to the user through the wireless link; and
prompting the user through the wireless link to aurally confirm the accuracy of the component of the web search request.

### Claim 3 (depends on 2)

The method according to claim 2, which further comprises carrying out the accuracy confirming step by:
determining if a confidence level of a hypothetical recognized component is above a selected threshold; and
computer generating a representation of the hypothetical recognized component for transmission to the user when the confidence level is above the selected threshold.

### Claim 4 (depends on 1)

The method according to claim 1, which further comprises carrying out the accuracy confirming step by:
transmitting at least one recorded hypothetical recognized component of the web search request by the user to the user through the wireless link; and
prompting the user through the wireless link to aurally confirm the accuracy of the hypothetical recognized component of the web search request.

### Claim 5 (depends on 1)

The method according to claim 1, which further comprises carrying out the web search result determining step by providing human data center operator assistance using the developed list of hypothetical recognized components and confidence levels to recognize the web search request.

### Claim 6 (depends on 5)

The method according to claim 5, which further comprises carrying out the operator assistance providing step by:
playing back recorded representations of the web search request spoken by the user to a data center operator for analysis by the data center operator; and
receiving information from the data center operator identifying the web search requested.

### Claim 7 (depends on 6)

The method according to claim 6, which further comprises carrying out the data center operator information receiving step by entering a choice from the displayed list of hypothetical recognized components from the data center operator.

### Claim 8 (depends on 1)

The method according to claim 1, which further comprises carrying out the accuracy confirming step by transmitting aural representations of hypothetical recognized components of the web search request to the user, the hypothetical recognized components of the web search request being selected from aural representations of portions of the web search request.

### Claim 9

A system for surfing the web, comprising:
a mobile system for processing and transmitting through a wireless link a continuous voice stream spoken by a user of the mobile system, the continuous voice stream including a web search request; and
a data center for processing the continuous voice stream received through the wireless link into voice web search information and operable to:
perform automated voice recognition processing on the voice web search information to recognize components of the web search request;
confirm the recognized components of the web search request through interactive speech exchanges with the user through the wireless link and the mobile system;
selectively allow human data center operator intervention to assist in identifying the selected recognized web search components having a recognition confidence below a selected threshold value; and
download web search results pertaining to the web search request for transmission to the mobile system derived from the confirmed recognized web search components.

### Claim 10 (depends on 9)

The system according to claim 9, wherein the data center is further operable to download the voice web search information in response to position information received from the mobile system through the wireless link.

### Claim 11 (depends on 9)

The system according to claim 9, wherein the data center is further operable to:
generate a list of possible web search components corresponding to the continuous voice stream;
assign a confidence score for each of possible components of the voice web search information on the list;
determine if a possible web search component with a highest confidence score has a confidence score above a threshold; and
computer-generate an aural representation of the web search requested for transmission to the mobile system for confirmation by the user if the confidence score is above the threshold.

### Claim 12 (depends on 9)

The system according to claim 9, wherein the data center is further operable to:
determine that at least one of components of the web search request of the continuous voice stream has a recognition confidence value below a threshold; and
playback a recording in the voice of the user of at least the components of the web search request with the recognition confidence value below the threshold to the user through the mobile system for confirmation.

### Claim 13 (depends on 12)

The system according to claim 12, wherein the data center further comprises a data center operator facility for playing back the components of the web search request for assisting in identifying the web search request.

### Claim 14 (depends on 12)

The system according to claim 12, wherein the data center is further operable to present a list of possible web search requests listed by confidence scores to a data center operator for selection as the web search request.

### Claim 15 (depends on 14)

The system according to claim 14, wherein the data center is further operable to allow the data center operator to vary an order of possible web search selections in the list.

### Claim 16 (depends on 9)

The system according to claim 9, wherein the data center is further operable to record the continuous voice stream spoken by the user as normalized audio wave fields for subsequent playback.
