# US 2015/0106836 A1 · Global speech user interface

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2015/0106836 A1
- Document ID: US20150106836A1
- Status: Published application
- Kind: A1
- Application number: 14/572,596
- Filed: 2014-12-16
- Published: 2015-04-16
- Earliest claimed: 2001-10-03
- Assignees: Promptu Systems Corporation
- Applicants: Promptu Systems Corporation
- Inventors: Adam JORDAN; Scott Lynn MADDUX; Tim PLOWMAN; Victoria STANBACH; Jody WILLIAMS
- Web page: https://patentgrep.com/patent/US20150106836A1

## CPC

- H04N 21/47: End-user applications
- G06F 3/16: Sound input; Sound output (speech processing G10L)
- G06Q 30/0271: {Personalized advertisement}
- G06Q 30/0631: {Recommending goods or services}
- G10L 13/00: Speech synthesis; Text to speech systems
- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L 21/06: Transformation of speech into a non-audible representation, e.g. speech visualisation or speech processing for tactile aids (G10L15/26 takes precedence)
- H04N 21/42203: {sound input device, e.g. microphone}
- H04N 21/4221: {Dedicated function buttons, e.g. for the control of an EPG, subtitles, aspect ratio, picture-in-picture or teletext}
- H04N 21/4316: {for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window}
- H04N 21/4622: {Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet (web site content organization and management for information retrieval from the Internet G06F16/958; transmission by internet of broadcast information H04H60/82; stock exchange data over packet-switching network H04L12/1804; push services including data channel over packet-switching network H04L12/1859)}
- H04N 21/472: End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content {(end-user interfaces for retrieving video data from a database G06F16/739; network services for supporting unicast streaming H04L65/612)}
- H04N 21/47202: {for requesting content on demand, e.g. video on demand}
- H04N 21/47211: {for requesting pay-per-view content (payment schemes payment architectures or payment protocols G06Q20/00, G07F)}
- H04N 21/47214: {for content reservation or setting reminders; for requesting event notification, e.g. of sport results or stock market (stock exchange data over packet-switching network H04L12/1804; push services over packet-switching network H04L12/1859; notification of incoming messages in packet switching networks H04L51/224)}
- H04N 21/475: End-user interface for inputting end-user data, e.g. personal identification number [PIN], preference data
- H04N 21/478: Supplemental services, e.g. displaying phone caller identification, shopping application
- H04N 21/4781: {Games}
- H04N 21/4782: Web browsing {, e.g. WebTV}
- H04N 21/4788: communicating with other users, e.g. chatting {(arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104)}
- H04N 21/482: End-user interface for programme selection
- H04N 21/4826: {using recommendation lists, e.g. of programmes or channels sorted out according to their score}
- H04N 21/4828: {for searching programme descriptors (retrieval of video data G06F16/739)}
- H04N 21/4852: {for modifying audio parameters, e.g. switching between mono and stereo}
- H04N 21/812: {involving advertisement data (advertising per se G06Q30/02)}
- H04N 21/8173: {End-user applications, e.g. Web browser, game}
- G10L 2015/221: {Announcement of recognition results}
- G10L 2015/223: {Execution procedure of a spoken command}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

A global speech user interface (GSUI) comprises an input system to receive a user's spoken command, a feedback system along with a set of feedback overlays to give the user information on the progress of his spoken requests, a set of visual cues on the television screen to help the user understand what he can say, a help system, and a model for navigation among applications. The interface is extensible to make it easy to add new applications.

## Claims

### Claim 1

A global speech user interface (GSUI), comprising:
a processor configured for performing speech recognition to transcribe spoken commands for use in navigating among one or more applications hosted on a communications system; and
said processor configured for displaying a set of visual cues to guide a user in issuing spoken commands, said visual cues comprising an overlay that shows a list of services available to the user, each of said services being accessible by spoken command;
wherein said overlay comprises:
a first sub-menu overlay specifically for access to an interactive program guide system;
a second sub-menu overlay specifically for access to a content on demand system; and
a third sub-menu overlay specifically for access to a browser-based service;
wherein each of said sub-menus provides a set of speech-activated virtual buttons.

### Claim 2 (depends on 1)

The interface of claim 1, further comprising:
a speaker personalization and identification mechanism for training said communications system to identify respective users by voice;
wherein said speaker personalization and identification mechanism presents any of different custom interfaces and personalized content for different respective speakers.

### Claim 3 (depends on 1)

The interface of claim 1, further comprising:
said processor configured for initiating, via spoken command, an automatic scan search for content comprising one or more programs pursuant to a search category.

### Claim 4 (depends on 3)

The interface of claim 3, wherein each matching program remains on screen for a predetermined period of time before advancing to next matching program.

### Claim 5 (depends on 1)

The interface of claim 1, further comprising:
said processor configured for, via spoken command, performing any of:
adding content to categories;
editing content in categories; and
deleting content from categories.

### Claim 6 (depends on 1)

The interface of claim 1, further comprising:
said processor configured for, via spoken command, filtering groups of content by specific attributes.

### Claim 7 (depends on 1)

The interface of claim 1, said interactive program guide comprising any of:
responsive to a spoken command, sorting content by category;
responsive to a spoken command, setting parental controls, wherein children are blocked from accessing controlled channels or content;
responsive to a spoken command, setting reminders for content to play in the future;
responsive to a spoken command, searching content based on a specific criteria;
processing pay per view purchases; and
responsive to a spoken command, any of accessing and upgrading premium content services.

### Claim 8 (depends on 1)

The interface of claim 1, further comprising, based upon voice identification, any of:
targeting one or more advertisements contained in an application screen to the user;
targeting content recommendations to the user;
delivering personalized information to the user; and
automatically configuring the user's interface preferences.

### Claim 9 (depends on 1)

The interface of claim 1, further comprising:
varying display of content comprising any of:
displaying advertisements personalized to the specific speaker;
displaying programming recommendations personalized to the specific speaker;
displaying video-on-demand purchase recommendations personalized to the specific speaker;
expediting an on-screen purchase transaction based upon recognition of the specific speaker;
displaying an interface and content personalized to the specific speaker;
automatically configuring the display or user interface according to preferences of the specific speaker; and
implementing a designated scheme for parental control of content by automatically blocking or allowing content according to identity of the specific speaker.

### Claim 10 (depends on 1)

The interface of claim 1, further comprising:
responsive to using the transcribed spoken commands to navigate among one or more applications, initiating instant messaging communication.

### Claim 11 (depends on 1)

The interface of claim 1, further comprising:
analyzing utterances of different speakers to facilitate voiceprint identification of the different speakers; and
responsive to voiceprint recognition of a specific speaker, initiating instant messaging communication.

### Claim 12 (depends on 1)

The interface of claim 1, further comprising:
responsive to using the transcribed spoken commands to navigate among one or more applications, accessing one or more games and allowing said specific speaker to engage in game play.

### Claim 13 (depends on 1)

The interface of claim 1, further comprising:
analyzing utterances of different speakers to facilitate voiceprint identification of the different speakers; and
responsive to voiceprint recognition of a specific speaker, accessing one or more games and allowing said specific speaker to engage in said game play

### Claim 14 (depends on 1)

The interface of claim 1, further comprising:
using the transcribed spoken commands to navigate among predetermined applications concerning operation of a content presentation device; and
responsive thereto, varying display of the content presentation device according to identity of the specific speaker.

### Claim 15 (depends on 1)

The interface of claim 1, further comprising:
analyzing utterances of different speakers to facilitate voiceprint identification of the different speakers; and
responsive to voiceprint recognition of a specific speaker, varying display of the content presentation device according to identity of the specific speaker.

### Claim 16

A global speech user interface (GSUI), comprising:
a processor configured for performing speech recognition to transcribe spoken commands for use in navigating among one or more applications hosted on a communications system; and
said processor configured for displaying a set of visual cues to guide a user in issuing spoken commands, said visual cues comprising:
a set of immediate speech feedback overlays, each of which provides non-textual feedback information;
a set of help overlays, each of which provides a context-sensitive list of frequently used speech-activated commands;
a set of feedback overlays, each of which provides information about a problem that said communications system is experiencing; and
a main menu overlay that shows a list of services available to the user, each of said services being accessible by spoken command.

### Claim 17 (depends on 16)

The interface of claim 16, further comprising:
a speaker personalization and identification mechanism for training said communications system to identify respective users by voice;
wherein said speaker personalization and identification mechanism presents any of different custom interfaces and personalized content for different respective speakers.

### Claim 18 (depends on 16)

The interface of claim 16, further comprising:
said processor initiating, via spoken command, an automatic scan search for content comprising one or more programs pursuant to a search category.

### Claim 19 (depends on 18)

The interface of claim 18, wherein each matching program remains on screen for a predetermined period of time before advancing to next matching program.

### Claim 20 (depends on 16)

The interface of claim 16, further comprising:
said processor configured for, via spoken command, performing any of:
adding content to categories;
editing content in categories; and
deleting content from categories.

### Claim 21 (depends on 16)

The interface of claim 16, further comprising:
said processor configured for, via spoken command, filtering groups of content by specific attributes.

### Claim 22 (depends on 16)

The interface of claim 16, said interactive program guide comprising any of:
responsive to a spoken command, sorting content by category;
responsive to a spoken command, setting parental controls, wherein which children are blocked from accessing controlled channels or content;
responsive to a spoken command, setting reminders for content to play in the future;
responsive to a spoken command, searching content based on a specific criteria;
processing pay per view purchases; and
responsive to a spoken command, any of accessing and upgrading premium content services.

### Claim 23 (depends on 16)

The interface of claim 16, further comprising, based upon voice identification, any of:
targeting one or more advertisements contained in an application screen to the user;
targeting content recommendations to the user;
delivering personalized information to the user; and
automatically configuring the user's interface preferences.

### Claim 24 (depends on 16)

The interface of claim 16, further comprising:
varying display of content comprising any of:
displaying advertisements personalized to the specific speaker;
displaying programming recommendations personalized to the specific speaker;
displaying video-on-demand purchase recommendations personalized to the specific speaker;
expediting an on-screen purchase transaction based upon recognition of the specific speaker;
displaying an interface and content personalized to the specific speaker;
automatically configuring the display or user interface according to preferences of the specific speaker; and
implementing a designated scheme for parental control of content by automatically blocking or allowing content according to identity of the specific speaker.

### Claim 25 (depends on 16)

The interface of claim 16, further comprising:
responsive to using the transcribed spoken commands to navigate among one or more applications, initiating instant messaging communication.

### Claim 26 (depends on 16)

The interface of claim 16, further comprising:
analyzing utterances of different speakers to facilitate voiceprint identification of the different speakers; and
responsive to voiceprint recognition of a specific speaker, initiating instant messaging communication.

### Claim 27 (depends on 16)

The interface of claim 16, further comprising:
responsive to using the transcribed spoken commands to navigate among one or more applications, accessing one or more games and allowing said specific speaker to engage in game play.

### Claim 28 (depends on 16)

The interface of claim 16, further comprising:
analyzing utterances of different speakers to facilitate voiceprint identification of the different speakers; and
responsive to voiceprint recognition of a specific speaker, accessing one or more games and allowing said specific speaker to engage in said game play

### Claim 29 (depends on 16)

The interface of claim 16, further comprising:
using the transcribed spoken commands to navigate among predetermined applications concerning operation of a content presentation device; and
responsive thereto, varying display of the content presentation device according to identity of the specific speaker.

### Claim 30 (depends on 16)

The interface of claim 16, further comprising:
analyzing utterances of different speakers to facilitate voiceprint identification of the different speakers; and
responsive to voiceprint recognition of a specific speaker, varying display of the content presentation device according to identity of the specific speaker.

### Claim 31

A global speech user interface (GSUI), comprising:
a processor configured for performing speech recognition to transcribe spoken commands for use in navigating via speech control to:
navigate, search, filter, and select programs by spoken command;
initiate an automatic scan-type search for programs within categories or genres, wherein each program remains on screen for a brief interval before advancing to a next program in the category or genre until a user selection is made;
add programs or channels to categories, edit programs or channels in the categories, and delete programs or channels from the categories;
search for particular programs based on specific attributes; and
filter groups of programs by specific attributes.

### Claim 32

A global speech user interface (GSUI), comprising:
a processor configured for performing speech recognition to transcribe spoken commands for use in navigating a speech-enabled interactive program guide (IPG) to:
access detailed program information;
sort programs by category;
access and set parental controls to restrict children's access to controlled video information;
search programs based on specific criteria;
complete pay-per-view purchases; and
upgrade or access premium services.

### Claim 33

A global speech user interface (GSUI), comprising:
a processor configured for performing speech recognition to transcribe spoken commands for use in navigating a Video on Demand (VOD) system to:
access detailed movie information.
sort by genre
set parental controls to restrict children's access to controlled video information;
search by movie title, actor, awards, and recommendations;
get an automatic recommendation based on voiceprint identification; and
navigate the Internet.

### Claim 34

A global speech user interface (GSUI), comprising:
a processor configured for performing speech recognition to transcribe spoken commands for use in:
initiating instant messaging communication;
accessing and playing games;
controlling settings including but not limited to volume control, channel up/down, color, brightness, picture-in-picture activation, and position;
controlling personal preferences and setting up options;
linking to detailed product information based on an advertisement or banner advertisement contained within an application screen;
receiving advertisements or banners based on voiceprint identification;
receiving programming recommendations based on voiceprint identification;
receive personalized information based on voiceprint identification;
getting automatic configuration of preferences based on voiceprint identification;
completing all aspects of a purchase transaction based on voiceprint identification;
initiating a product purchase integrated with broadcast programming; and
controlling home services and home devices.
