# US 2013/0158994 A1 · Retrieval and presentation of network service results for mobile device using a multimodal browser

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2013/0158994 A1
- Document ID: US20130158994A1
- Status: Published application
- Kind: A1
- Application number: 13/756,073
- Filed: 2013-01-31
- Published: 2013-06-20
- Earliest claimed: 2005-09-12
- Assignees: Nuance Communications, Inc.
- Inventors: David Jaramillo; Marc White
- Web page: https://patentgrep.com/patent/US20130158994A1

## CPC

- H04M 3/493: Interactive information services, e.g. directory enquiries {; Arrangements therefor, e.g. interactive voice response [IVR] systems or voice portals}
- G06F 16/951: Indexing; Web crawling techniques
- G06F 16/9538: Presentation of query results
- G06F 16/957: Browsing optimisation, e.g. caching or content distillation
- G06F 16/9577: {Optimising the visualization of content, e.g. distillation of HTML documents}
- G10L 21/00: Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility (G10L19/00 takes precedence)
- H04M 3/4938: {comprising a voice browser which renders and interprets, e.g. VoiceXML}
- H04M 7/0036: {where the data service is an information service}
- G10L 15/197: Probabilistic grammars, e.g. word n-grams
- H04M 2201/39: using speech synthesis
- H04M 2201/40: using speech recognition
- H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

A method of obtaining information using a mobile device can include receiving a request including speech data from the mobile device, and querying a network service using query information extracted from the speech data, whereby search results are received from the network service. The search results can be formatted for presentation on a display of the mobile device. The search results further can be sent, along with a voice grammar generated from the search results, to the mobile device. The mobile device then can render the search results.

## Claims

### Claim at position 1

1-20. (canceled)

### Claim 21

A method comprising acts of:
sending from a device, via at least one communication medium, a request to obtain information;
receiving at the device, via the at least one communication medium, a response to the request to obtain information, the response comprising one or more search results and a voice grammar dynamically generated based on the one or more search results;
presenting via the device at least some of the one or more search results to a user of the device; and
using the voice grammar dynamically generated based on the one or more search results to process user speech spoken by the user subsequent to the at least some of the one or more search results being presented to the user.

### Claim 22 (depends on 21)

The method of claim 21, wherein the request to obtain information is a first request, and the act of using the voice grammar dynamically generated based on the one or more search results to process the user speech comprises determining that the user speech comprises an indication that the user desires to select at least one search result of the one or more search results, and wherein the method further comprises an act of:
in response to determining that the user speech comprises an indication that the user desires to select the at least one search result, sending a second request via the at least one communication medium, the second request requesting information relating to the at least one search result.

### Claim 23 (depends on 22)

The method of claim 22, wherein the response to the first request is a first response and the voice grammar dynamically generated based on the one or more search results is a first voice grammar, and wherein the method further comprises acts of:
receiving at the device, via the at least one communication medium, a second response in response to the second request, the second response comprising one or more pieces of information relating to the at least one search result and a second voice grammar dynamically generated based on the one or more pieces of information;
presenting via the device at least some of the one or more pieces of information to the user; and
using the second voice grammar dynamically generated based on the one or more pieces of information to process user speech spoken by the user subsequent to the at least some of the one or more pieces of information being presented to the user.

### Claim 24 (depends on 21)

The method of claim 21, wherein the act of presenting the at least some of the one or more search results to the user comprises:
providing an indication to the user that the user is allowed to select at least one search result of the one or more search results by speaking one or more words associated with the at least one search result.

### Claim 25 (depends on 24)

The method of claim 24, wherein providing an indication to the user comprises providing a visual indication that distinguishes the one or more words associated with the at least one search result from other words presented to the user.

### Claim 26 (depends on 21)

The method of claim 21, wherein the request to obtain information is a subsequent request and the voice grammar dynamically generated based on the one or more search results is a subsequent voice grammar, and wherein the method further comprises acts of:
sending from the device an initial request via the at least one communication medium;
receiving at the device, via the at least one communication medium, an initial response to the initial request, the initial response comprising an initial voice grammar; and
using the initial voice grammar to process user speech spoken by the user.

### Claim 27 (depends on 26)

The method of claim 26, further comprising an act of:
generating the subsequent request as a result of using the initial voice grammar to process user speech.

### Claim 28

A system comprising at least one processor configured to:
send, via at least one communication medium, a request to obtain information;
receive, via the at least one communication medium, a response to the request to obtain information, the response comprising one or more search results and a voice grammar dynamically generated based on the one or more search results;
present via the device at least some of the one or more search results to a user of the device; and
use the voice grammar dynamically generated based on the one or more search results to process user speech spoken by the user subsequent to the at least some of the one or more search results being presented to the user.

### Claim 29 (depends on 28)

The system of claim 28, wherein the request to obtain information is a first request, and using the voice grammar dynamically generated based on the one or more search results to process the user speech comprises determining that the user speech comprises an indication that the user desires to select at least one search result of the one or more search results, and wherein the at least one processor is further configured to:
in response to determining that the user speech comprises an indication that the user desires to select the at least one search result, send a second request via the at least one communication medium, the second request requesting information relating to the at least one search result.

### Claim 30 (depends on 29)

The system of claim 29, wherein the response to the first request is a first response and the voice grammar dynamically generated based on the one or more search results is a first voice grammar, and wherein the at least one processor is further configured to:
receive, via the at least one communication medium, a second response in response to the second request, the second response comprising one or more pieces of information relating to the at least one search result and a second voice grammar dynamically generated based on the one or more pieces of information;
present at least some of the one or more pieces of information to the user; and
use the second voice grammar dynamically generated based on the one or more pieces of information to process user speech spoken by the user subsequent to the at least some of the one or more pieces of information being presented to the user.

### Claim 31 (depends on 28)

The system of claim 28, wherein the at least one processor is further configured to present the at least some of the one or more search results to the user at least in part by:
providing an indication to the user that the user is allowed to select at least one search result of the one or more search results by speaking one or more words associated with the at least one search result.

### Claim 32 (depends on 31)

The system of claim 31, wherein providing an indication to the user comprises providing a visual indication that distinguishes the one or more words associated with the at least one search result from other words presented to the user.

### Claim 33 (depends on 28)

The system of claim 28, wherein the request to obtain information is a subsequent request and the voice grammar dynamically generated based on the one or more search results is a subsequent voice grammar, and wherein the at least one processor is further configured to:
send an initial request via the at least one communication medium;
receive, via the at least one communication medium, an initial response to the initial request, the initial response comprising an initial voice grammar; and
use the initial voice grammar to process user speech spoken by the user.

### Claim 34 (depends on 33)

The system of claim 33, wherein the at least one processor is further configured to:
generate the subsequent request as a result of using the initial voice grammar to process user speech.

### Claim 35

At least one computer-readable storage having encoded thereon instructions that, when executed by at least one processor of a device, perform a method comprising acts of:
sending from the device, via at least one communication medium, a request to obtain information;
receiving at the device, via the at least one communication medium, a response to the request to obtain information, the response comprising one or more search results and a voice grammar dynamically generated based on the one or more search results;
presenting via the device at least some of the one or more search results to a user of the device; and
using the voice grammar dynamically generated based on the one or more search results to process user speech spoken by the user subsequent to the at least some of the one or more search results being presented to the user.

### Claim 36 (depends on 35)

The at least one computer-readable storage of claim 35, wherein the request to obtain information is a first request, and the act of using the voice grammar dynamically generated based on the one or more search results to process the user speech comprises determining that the user speech comprises an indication that the user desires to select at least one search result of the one or more search results, and wherein the method further comprises an act of:
in response to determining that the user speech comprises an indication that the user desires to select the at least one search result, sending a second request via the at least one communication medium, the second request requesting information relating to the at least one search result.

### Claim 37 (depends on 36)

The at least one computer-readable storage of claim 36, wherein the response to the first request is a first response and the voice grammar dynamically generated based on the one or more search results is a first voice grammar, and wherein the method further comprises acts of:
receiving at the device, via the at least one communication medium, a second response in response to the second request, the second response comprising one or more pieces of information relating to the at least one search result and a second voice grammar dynamically generated based on the one or more pieces of information;
presenting via the device at least some of the one or more pieces of information to the user; and
using the second voice grammar dynamically generated based on the one or more pieces of information to process user speech spoken by the user subsequent to the at least some of the one or more pieces of information being presented to the user.

### Claim 38 (depends on 35)

The at least one computer-readable storage of claim 35, wherein the act of presenting the at least some of the one or more search results to the user comprises:
providing an indication to the user that the user is allowed to select at least one search result of the one or more search results by speaking one or more words associated with the at least one search result.

### Claim 39 (depends on 38)

The at least one computer-readable storage of claim 38, wherein providing an indication to the user comprises providing a visual indication that distinguishes the one or more words associated with the at least one search result from other words presented to the user.

### Claim 40 (depends on 35)

The at least one computer-readable storage of claim 35, wherein the request to obtain information is a subsequent request and the voice grammar dynamically generated based on the one or more search results is a subsequent voice grammar, and wherein the method further comprises acts of:
sending from the device an initial request via the at least one communication medium;
receiving at the device, via the at least one communication medium, an initial response to the initial request, the initial response comprising an initial voice grammar; and
using the initial voice grammar to process user speech spoken by the user.
