# US 2014/0208210 A1 · Displaying speech command input state information in a multimodal browser

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2014/0208210 A1
- Document ID: US20140208210A1
- Status: Published application
- Kind: A1
- Application number: 14/220,281
- Filed: 2014-03-20
- Published: 2014-07-24
- Earliest claimed: 2005-09-13
- Assignees: Nuance Communications, Inc.
- Applicants: Nuance Communications, Inc.
- Inventors: Charles W. Cross, JR.; Michael C. Hollinger; Igor R. Jablokov; Benjamin D. Lewis; Hilary A. Pike; Daniel M. Smith; David W. Wintermute; Michael A. Zaitzeff
- Web page: https://patentgrep.com/patent/US20140208210A1

## CPC

- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G06F 3/04817: using icons (graphical or visual programming using iconic symbols G06F8/34)
- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L 2015/228: {of application context}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

Methods, systems, and products are disclosed for displaying speech command input state information in a multimodal browser including displaying an icon representing a speech command type and displaying an icon representing the input state of the speech command. In typical embodiments, the icon representing a speech command type and the icon representing the input state of the speech command also includes attributes of a single icon. Typical embodiments include accepting from a user a speech command of the speech command type, changing the input state of the speech command, and displaying another icon representing the changed input state of the speech command. Typical embodiments also include displaying the text of the speech command in association with the icon representing the speech command type.

## Claims

### Claim 1

A method for displaying speech command input state information in a multimodal browser, the method comprising:
displaying an icon representing a speech command type; and
displaying an icon representing an input state of the speech command.

### Claim 2 (depends on 1)

The method of claim 1 wherein the icon representing a speech command type and the icon representing the input state of the speech command further comprise attributes of a single icon.

### Claim 3 (depends on 1)

The method of claim 1 further comprising:
accepting from a user a speech command of the speech command type;
changing the input state of the speech command; and
displaying another icon representing the changed input state of the speech command.

### Claim 4 (depends on 3)

The method of claim 3 further comprising displaying text describing the speech command in association with the icon representing the speech command type.

### Claim 5 (depends on 3)

The method of claim 3 wherein accepting from a user a speech command of the speech command type further comprises:
identifying the speech command type in dependence upon the input state of the speech command of the speech command type.

### Claim 6 (depends on 3)

The method of claim 3 wherein accepting from a user a speech command of the speech command type further comprises:
receiving from the user a speech command; and
determining the speech command type of the speech command.

### Claim 7 (depends on 6)

The method of claim 6 wherein determining the speech command type of the speech command further comprises:
determining whether the speech command matches an entry in one of a plurality of grammars for one of a plurality of speech command types; and
if the speech command matches an entry in one of a plurality of grammars, identifying the speech command type in dependence upon a grammar type.

### Claim 8

A system for displaying speech command input state information in a multimodal browser, the system comprising:
a computer processor;
a computer memory coupled for data transfer to the processor, the computer memory having disposed within it computer program instructions capable of:
displaying an icon representing a speech command type; and
displaying an icon representing an input state of the speech command.

### Claim 9 (depends on 8)

The system of claim 8 wherein the icon representing a speech command type and the icon representing the input state of the speech command further comprise attributes of a single icon.

### Claim 10 (depends on 8)

The system of claim 8 further comprising a speech command information module, where the speech command information module comprises computer program instructions capable of:
accepting from a user a speech command of the speech command type;
changing the input state of the speech command; and
displaying another icon representing a changed input state of the speech command.

### Claim 11 (depends on 10)

The system of claim 10 wherein the speech command information module further comprises computer program instructions capable of:
identifying the speech command type in dependence upon the input state of the speech command of the speech command type.

### Claim 12 (depends on 10)

The system of claim 10 wherein the speech command information module further comprises computer program instructions capable of:
receiving from the user a speech command; and
determining the speech command type of the speech command.

### Claim 13 (depends on 12)

The system of claim 12 wherein the speech command information module further comprises computer program instructions capable of:
determining whether the speech command matches an entry in one of a plurality of grammars for one of a plurality of speech command types; and
if the speech command matches an entry in one of a plurality of grammars, identifying the speech command type in dependence upon a grammar type.

### Claim 14

A computer program product for displaying speech command input state information in a multimodal browser, the computer program product disposed upon a recording medium, the computer program product comprising:
computer program instructions that display an icon representing a speech command type; and
computer program instructions that display an icon representing an input state of the speech command.

### Claim 15 (depends on 14)

The computer program product of claim 14 wherein the icon representing a speech command type and the icon representing the input state of the speech command further comprise attributes of a single icon.

### Claim 16 (depends on 14)

The computer program product of claim 14 further comprising:
computer program instructions that accept from a user a speech command of the speech command type;
computer program instructions that change the input state of the speech command; and
computer program instructions that display another icon representing a changed input state of the speech command.

### Claim 17 (depends on 16)

The computer program product of claim 16 further comprising computer program instructions that display text describing the speech command in association with the icon representing the speech command type.

### Claim 18 (depends on 16)

The computer program product of claim 16 wherein computer program instructions that accept from a user a speech command of the speech command type further comprise:
computer program instructions that identify the speech command type in dependence upon the input state of the speech command of the speech command type.

### Claim 19 (depends on 16)

The computer program product of claim 16 wherein computer program instructions that accept from a user a speech command of the speech command type further comprise:
computer program instructions that receive from the user a speech command; and
computer program instructions that determine the speech command type of the speech command.

### Claim 20 (depends on 19)

The computer program product of claim 19 wherein computer program instructions that determine the speech command type of the speech command further comprise:
computer program instructions that determine whether the speech command matches an entry in one of a plurality of grammars for one of a plurality of speech command types; and
computer program instructions that identifying the speech command type in dependence upon a grammar type if the speech command matches an entry in one of a plurality of grammars.
