# US 2016/0366208 A1 · Contextual, Two Way Remote Control > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2016/0366208 A1 - Document ID: US20160366208A1 - Status: Published application - Kind: A1 - Application number: 15/249,264 - Filed: 2016-08-26 - Published: 2016-12-15 - Earliest claimed: 2012-07-03 - Assignees: Google Inc. - Applicants: Google Inc. - Inventors: Jeff Ting Yann Lu - Web page: https://patentgrep.com/patent/US20160366208A1 ## CPC - G08C 17/02: using a radio link - G06F 3/00: Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements - G08C 23/04: using light waves, e.g. infrared - H04L 67/02: based on web technology, e.g. hypertext transfer protocol [HTTP] - H04L 67/025: for remote control or remote monitoring of applications - H04N 5/44: Receiver circuitry {for the reception of television signals according to analogue transmission standards} (H04N5/14 takes precedence) - H04N 21/4143: {embedded in a} Personal Computer [PC] - H04N 21/42204: {User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor (constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205)} - H04N 21/4222: {Remote control device emulator integrated into a non-television apparatus, e.g. a PDA, media center or smart toy (remote control device for a television receiver integrated into a mobile phone H04M1/72415)} - H04N 21/42224: {Touch pad or touch panel provided on the remote control} - H04N 21/43615: {Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals (home Audio Video Interoperability [HAVI] data switching networks H04L12/2805)} - G08C: TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS (fluid pressure transmitting systems F15B; mechanical means for transferring the output of a sensing member into a different variable G01D5/00; mechanical control systems G05G) - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract This application is directed to enabling interaction between computer devices. An application is executed at a first computer device to access Internet-based media content sources and display media items provided thereby on a display device coupled to the first computer device. The first computer device transmits an information item, a plurality of display instructions and a command to a second computer device. The information item includes a selectable display element corresponding to one of the Internet-based media content sources, and the second computer device is configured to select and implement one of the display instructions for displaying the selectable display element of the information item. In response to a user selection of the selectable display item at the second computer device, the first computer device receives the command from the second computer device, and executes the command in relation to the Internet-based media content sources. ## Claims ### Claim 1 A computer-implemented method for allowing interaction between computer devices, the method comprising: at a first computer device that is coupled to a display device and facilitates the display device to display media content provided by a plurality of media content sources including one or more Internet-based media content sources: executing an application that accesses the one or more Internet-based media content sources and displays media items provided thereby, wherein the application operates interactively with a remote control application executed on a second computer device; transmitting to the second computer device an information item, a plurality of display instructions and a command associated with the information item, wherein the information item includes a selectable display element corresponding to one of the one or more Internet-based media content sources accessible via the first computer device, and the second computer device is configured to select and implement one of the plurality of display instructions for displaying the selectable display element of the information item; and in response to a user selection of the selectable display element at the second computer device, receiving from the second computer device the command associated with the information item; and executing the command in relation to the one of the one or more Internet-based media content sources. ### Claim 2 (depends on 1) The computer-implemented method of claim 1, further comprising: receiving the command from the second computer device in response to a selection of the information item by the user; and performing a predefined action in response to receiving the command. ### Claim 3 (depends on 2) The computer-implemented method of claim 2, wherein the predefined action is causing display of media content associated with the information item on the display device associated with the first computer device. ### Claim 4 (depends on 3) The computer-implemented method of claim 3, wherein the media content is one or more of: a video, a television station, an audio track, an audio station, and a picture. ### Claim 5 (depends on 2) The computer-implemented method of claim 2, wherein the predefined action is a media-device control action. ### Claim 6 (depends on 5) The computer-implemented method of claim 5, wherein the media-device control action is one or more of: changing a channel, changing volume level, changing a device setting, initiating a record function, adjusting a playback speed, and changing an operating state of a device. ### Claim 7 (depends on 1) The computer-implemented method of claim 1, wherein the information item is a label that includes at least one of a graphic and text. ### Claim 8 (depends on 1) The computer-implemented method of claim 1, wherein the one of the plurality of display instructions is tailored for the second computer device based on form factors of the second computer device. ### Claim 9 (depends on 1) The computer-implemented method of claim 1, further comprising: transmitting, to the second computer device, a collection of information items, and transmitting, to the second computer device, a collection display instruction associated with the collection of information items. ### Claim 10 (depends on 9) The computer-implemented method of claim 9, wherein the collection display instruction indicates that the collection of information items is to be displayed in a list format, a tree format, a gallery format, or a hierarchical folder format. ### Claim 11 An electronic device, wherein the electronic device includes a first computer device that is coupled to a display device and facilitates the display device to display media content provided by a plurality of media content sources including one or more Internet-based media content sources, comprising: one or more processors; memory; and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for: executing an application that accesses the one or more Internet-based media content sources and displays media items provided thereby, wherein the application operates interactively with a remote control application executed on a second computer device; transmitting to the second computer device an information item, a plurality of display instructions and a command associated with the information item, wherein the information item includes a selectable display element corresponding to one of the one or more Internet-based media content sources accessible via the first computer device, and the second computer device is configured to select and implement one of the plurality of display instructions for displaying the selectable display element of the information item; and in response to a user selection of the selectable display element at the second computer device, receiving from the second computer device the command associated with the information item; and executing the command in relation to the one of the one or more Internet-based media content sources. ### Claim 12 (depends on 11) The electronic device of claim 11, wherein the command is part of an action definition, and the information item and the action definition are incorporated in an HTML file. ### Claim 13 (depends on 12) The electronic device of claim 12, wherein the information item is one of a plurality of information items, the action definition is one of a plurality of action definitions, and the plurality of information items and the plurality of action definitions are incorporated in the HTML file. ### Claim 14 (depends on 13) The electronic device of claim 13, wherein the HTML file specifies a graphical layout for the plurality of information items and the plurality of action definitions. ### Claim 15 (depends on 11) The electronic device of claim 11, wherein each of the plurality of display instructions is tailored for a respective computer device based on one or more of a type, form factors and functionality of the respective computer device. ### Claim 16 A non-transitory computer-readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by a processor of a first computer device, cause the first computer device to: execute an application that accesses the one or more Internet-based media content sources and displays media items provided thereby, wherein the application operates interactively with a remote control application executed on a second computer device; transmit to the second computer device an information item, a plurality of display instructions and a command associated with the information item, wherein the information item includes a selectable display element corresponding to one of the one or more Internet-based media content sources accessible via the first computer device, and the second computer device is configured to select and implement one of the plurality of display instructions for displaying the selectable display element of the information item; and in response to a user selection of the selectable display element at the second computer device, receive from the second computer device the command associated with the information item; and execute the command in relation to the one of the one or more Internet-based media content sources. ### Claim 17 (depends on 16) The non-transitory computer-readable storage medium of claim 16, wherein the one or more programs further comprising instructions for: transmitting, to the second computer device, a group of collections; and transmitting, to the second computer device, a collection display instruction associated with the group of collections. ### Claim 18 (depends on 17) The non-transitory computer-readable storage medium of claim 17, wherein the collection display instruction indicates that a respective collection of the group of collections is to be displayed in a separate tab of a user interface on the second computer device. ### Claim 19 (depends on 17) The non-transitory computer-readable storage medium of claim 17, wherein the collection display instruction indicates that a respective collection of the group of collections is to be displayed in a separate folder of a user interface of the second computer device. ### Claim 20 (depends on 16) The non-transitory computer-readable storage medium of claim 16, wherein the first computer device is configured to execute one or more applications, and the one or more applications are one or more of a web browser, a media browser, and a media player.