# US 2020/0351324 A1 · Contextual Remote Control User Interface

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0351324 A1
- Document ID: US20200351324A1
- Status: Published application
- Kind: A1
- Application number: 16/877,130
- Filed: 2020-05-18
- Published: 2020-11-05
- Earliest claimed: 2012-07-03
- Assignees: Google Inc.
- Applicants: Google LLC
- Inventors: Jeff Ting Yann Lu
- Web page: https://patentgrep.com/patent/US20200351324A1

## CPC

- G08C 17/02: using a radio link
- G06F 3/00: Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G08C 23/04: using light waves, e.g. infrared
- H04L 67/02: based on web technology, e.g. hypertext transfer protocol [HTTP]
- H04L 67/025: for remote control or remote monitoring of applications
- H04N 5/44: Receiver circuitry {for the reception of television signals according to analogue transmission standards} (H04N5/14 takes precedence)
- H04N 21/4143: {embedded in a} Personal Computer [PC]
- H04N 21/42204: {User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor (constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205)}
- H04N 21/4222: {Remote control device emulator integrated into a non-television apparatus, e.g. a PDA, media center or smart toy (remote control device for a television receiver integrated into a mobile phone H04M1/72415)}
- H04N 21/42224: {Touch pad or touch panel provided on the remote control}
- H04N 21/43615: {Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals (home Audio Video Interoperability [HAVI] data switching networks H04L12/2805)}
- G08C: TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS (fluid pressure transmitting systems F15B; mechanical means for transferring the output of a sensing member into a different variable G01D5/00; mechanical control systems G05G)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A mobile device is coupled to a computer system configured to access media content sources and play media content items provided thereby on a media device. The mobile device receives a first control specification that includes a plurality of first information items each associated with one of the media content sources and a first action definition. The first information items are concurrently displayed on a remote control user interface of the mobile device. In accordance with a selection of one of the first information items corresponding to a first content source, the mobile device transmits a command of a first action definition corresponding to the selected first information item to the computer system, and receives a second control specification that includes a plurality of second information items. Each second information item is associated with a respective content item provided by the first content source and a second action definition.

## Claims

### Claim 1

(canceled)

### Claim 2

A computer-implemented method, comprising:
at a computer system that is coupled to a media device and facilitates the media device to output media content provided by a plurality of media content sources:
executing an application that accesses the plurality of media content sources and outputs media content provided thereby, wherein the application operates interactively with a remote control application executed on a client device that is distinct and remote from the computer system;
obtaining an information item corresponding to one or more media content items that are provided by the media content sources accessible via the computer system, wherein the information item is configured to be displayed by the remote control application on the client device;
associating the information item with a command;
transmitting the information item from the computer system to the client device; and
in response to a user input received at the client device and related to the information item, executing the command in relation to the one or more media content items corresponding to the media content sources, wherein the one or more media content items include an audio track, and the media content sources include an Internet-based audio channel with which the audio track is associated.

### Claim 3 (depends on 2)

The method of claim 2, further comprising:
incorporating by the computer system the information item and the command are incorporated in an HTML file; and
transmitting the command associated with the information item to the client device.

### Claim 4 (depends on 2)

The method of claim 2, further comprising:
in response to the user input, receiving by the computer system the command from the client device to perform a specified action with respect to the one or more media content items corresponding to the information item.

### Claim 5 (depends on 2)

The method of claim 2, wherein executing the command further comprises:
in response to the user input, controlling, by the computer system, the media device to play the one or more media content items.

### Claim 6 (depends on 2)

The method of claim 2, further comprising:
retrieving, by the client device, display rules, wherein the display rules provide instructions for displaying the information item in a user interface of the client device; and
displaying the information item in the user interface of the client device according to the display rules.

### Claim 7 (depends on 2)

The method of claim 2, wherein the media device is a speaker device.

### Claim 8 (depends on 7)

The method of claim 7, wherein executing the command includes altering playback of the audio track on the media device.

### Claim 9 (depends on 7)

The method of claim 7, wherein the command associated with the information item comprises at least one of:
a Play command;
a Stop command; and
a Pause command.

### Claim 10 (depends on 2)

The method of claim 2, wherein the information item includes information describing the one or more media content items, and the information describing the one or more media content items further comprises:
a title of the media content items; and
an image associated with the media content items.

### Claim 11 (depends on 10)

The method of claim 10, wherein the information item further includes information describing the Internet-based audio channel with which the audio track is associated.

### Claim 12

A computer system, coupled to a media device and facilitates the media device to output media content provided by a plurality of media content sources, comprising:
one or more processors;
memory storing one or more programs, wherein the one or more programs are configured to be executed by the one or more processors and include instructions for:
executing an application that accesses the plurality of media content sources and outputs media content provided thereby, wherein the application operates interactively with a remote control application executed on a client device that is distinct and remote from the computer system;
obtaining an information item corresponding to one or more media content items that are provided by the media content sources accessible via the computer system, wherein the information item is configured to be displayed by the remote control application on the client device;
associating the information item with a command;
transmitting the information item from the computer system to the client device; and
in response to a user input received at the client device and related to the information item, executing the command in relation to the one or more media content items corresponding to the media content sources, wherein the one or more media content items include an audio track, and the media content sources include an Internet-based audio channel with which the audio track is associated.

### Claim 13 (depends on 12)

The computer system of claim 12, wherein the one or more programs further comprise instructions for:
retrieving, by the client device, display rules, wherein the display rules provide instructions for displaying the information item in a user interface of the client device; and
displaying the information item in the user interface of the client device according to the display rules.

### Claim 14 (depends on 12)

The computer system of claim 12, wherein the one or more programs further comprise instructions for:
sending a display instruction associated with the information item, wherein the display instruction indicates that the one or more media content items are to be displayed in a list format, a tree format, a gallery format, or a hierarchical folder format.

### Claim 15 (depends on 12)

The computer system of claim 12, wherein the information item corresponds to a single media content item provided by the media content sources or a folder containing multiple media content items provided by the media content sources.

### Claim 16 (depends on 12)

The computer system of claim 12, wherein the information item includes information describing the one or more media content items, which is configured to be displayed by the remote control application on the client device.

### Claim 17 (depends on 16)

The computer system of claim 16, wherein the information describing one or more media content items is selected from a group consisting of a title, a file name, a thumbnail, and description of the one or more media content items.

### Claim 18

A non-transitory computer-readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by a processor of a computer system, cause the computer system to perform operations for:
at the computer system that is coupled to a media device and facilitates the media device to output media content provided by a plurality of media content sources:
executing an application that accesses the plurality of media content sources and outputs media content provided thereby, wherein the application operates interactively with a remote control application executed on a client device that is distinct and remote from the computer system;
obtaining an information item corresponding to one or more media content items that are provided by the media content sources accessible via the computer system, wherein the information item is configured to be displayed by the remote control application on the client device;
associating the information item with a command;
transmitting the information item from the computer system to the client device; and
in response to a user input received at the client device and related to the information item, executing the command in relation to the one or more media content items corresponding to the media content sources, wherein the one or more media content items include an audio track, and the media content sources include an Internet-based audio channel with which the audio track is associated.

### Claim 19 (depends on 18)

The non-transitory computer-readable storage medium of claim 18, the one or more programs further comprising instructions for concurrently:
displaying the information item in a user interface of the client device, wherein the user interface includes a content region and a control region that are distinct from each other; and
displaying one or more predefined playback controls in the control region, independently of the plurality of media content sources, when information describing the one or more media content items is displayed in the content region.

### Claim 20 (depends on 19)

The non-transitory computer-readable storage medium of claim 19, wherein the one or more predefined playback controls are represented by a subset of a plurality of icons for rewinding, stopping, playing, pausing, and fast-forwarding media content.

### Claim 21 (depends on 19)

The non-transitory computer-readable storage medium of claim 19, wherein the control region is fixed on the user interface of the client device, and configured to display the one or more predefined playback controls according to a template, and the content region of the user interface is customized dynamically based on the plurality of media content sources.
