# US 2002/0154161 A1 · Method and system for providing universal remote control of computing devices

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2002/0154161 A1
- Document ID: US20020154161A1
- Status: Published application
- Kind: A1
- Application number: 09/775,033
- Filed: 2001-02-01
- Published: 2002-10-24
- Earliest claimed: 2001-02-01
- Inventors: Michael A. Friedman; Timothy D. Lacy; Brendan McKeon
- Web page: https://patentgrep.com/patent/US20020154161A1

## CPC

- G08C 17/00: Arrangements for transmitting signals characterised by the use of a wireless electrical link
- G08C 19/28: using pulse code
- G08C 2201/92: Universal remote control
- G08C: TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS (fluid pressure transmitting systems F15B; mechanical means for transferring the output of a sensing member into a different variable G01D5/00; mechanical control systems G05G)

## Abstract

A universal console (UC) platform for a UC device is provided. The user sets up or initializes the UC by describing his or her preferences and disabilities. The UC digests and stores this user information. Later, as the user encounters various devices and applications to be controlled, and indicates a desire to control a particular device, the device to be controlled or other source sends a canonical user interface (UI) description of the device's UI to the UC. The canonical UI description adheres to an abstract format to describe in high-level terms the functionality of the device's UI. From the canonical UI representation, the UC device is capable of recognizing (1) the action-commands to which the device responds including parameters and (2) the decisions, selections, and input the user needs to provide for the console to determine which action-commands to send and the values of the action-command parameters. Generally, this implicates group hierarchy, from which the user is able to choose what he or she wants the device to perform, and the UC is able to gather the parameter values associated with the action-commands to carry out the user's wishes. Additionally, the UC device is capable of receiving status, state changes and other notifications from a device within its control.

## Claims

### Claim 1

A method for controlling at least one computing element with a universal console (UC), comprising:
storing a user's preferences for the universal console;
selecting a computing element to control with the UC;
receiving by the UC a canonical user interface (UI) representation of the computing element's UI;
instantiating a concrete UI by the UC taking into account the stored user preferences;
selecting at least one action-command to be carried out by the computing element;
transmitting to the computing element said data associated with said at least one action-command using a remote procedure call mechanism.

### Claim 2 (depends on 1)

A method according to claim 1, wherein said selecting at least one action-command includes requesting information about the state of said at least one computing element.

### Claim 3 (depends on 1)

A method according to claim 1, further comprising interacting with at least one group hierarchy to obtain data in connection with said selected at least one action-command to be carried out by the computing element.

### Claim 4 (depends on 1)

A method according to claim 1, wherein said storing includes storing data indicating at least one disability of the user.

### Claim 5 (depends on 1)

A method according to claim 1, further including carrying out said action-command by said computing element.

### Claim 6 (depends on 1)

A method according to claim 1, further including receiving by the UC notifications from the computing element.

### Claim 7 (depends on 6)

A method according to claim 6, wherein said notifications include at least one of an error message, warning message, status update message and state change.

### Claim 8 (depends on 1)

A method according to claim 1, wherein said canonical UI representation is formatted according to an XML stream.

### Claim 9 (depends on 1)

A method according to claim 1, further including requesting a list of available devices that may be controlled by UC.

### Claim 10 (depends on 1)

A method according to claim 1, wherein communications between said UC and said computing element are made via Hypertext Transfer Protocol (HTTP).

### Claim 11 (depends on 1)

A method according to claim 1, wherein said computing element is one from the group of a computing device and an application.

### Claim 12 (depends on 1)

A method according to claim 1, wherein said remote procedure call mechanism makes calls according to SOAP (Simple Object Activation Protocol).

### Claim 13 (depends on 1)

A method according to claim 1, wherein said canonical UI representation includes a representation associated with a parameter for choosing one element a from a set A.

### Claim 14 (depends on 1)

A method according to claim 1, wherein said canonical UI representation includes a representation associated with a parameter for selecting a subset A′ from a set A.

### Claim 15 (depends on 1)

A method according to claim 1, wherein said canonical UI representation includes a representation associated with a parameter for selecting one from the group of True/False, Off/On, OK/Cancel and Yes/No.

### Claim 16 (depends on 1)

A method according to claim 1, wherein said canonical UI representation includes a representation associated with a parameter for selecting an integer n in the range n1 through n2, with increment δ.

### Claim 17 (depends on 1)

A method according to claim 1, wherein said canonical UI representation includes a representation associated with a parameter for selecting a real number x in the range x1 through x2, with increment δ.

### Claim 18 (depends on 1)

A method according to claim 1, wherein said canonical UI representation includes a representation associated with a parameter type for an arbitrary string s.

### Claim 19 (depends on 18)

A method according to claim 18, wherein said arbitrary string s is to be selected from a suggestion set of strings S.

### Claim 20 (depends on 1)

A method according to claim 1, wherein said canonical UI representation includes a representation associated with a parameter type for the modification of a given first string s, resulting in a second string s′.

### Claim 21 (depends on 1)

A method according to claim 1, wherein said canonical UI representation includes a representation associated with a parameter type for ordering the elements of set A into A′.

### Claim 22 (depends on 1)

A method according to claim 1, wherein said canonical UI representation includes a representation associated with a parameter type for pairing set A elements with set B elements.

### Claim 23 (depends on 1)

A method according to claim 1, wherein said canonical UI representation includes a representation associated with a group construct that contains at least one of commands and subgroups.

### Claim 24 (depends on 1)

A method according to claim 1, wherein said canonical UI representation includes a representation associated with a command construct that specifies at least one action to send to the controlled element that will carry out the action-command.

### Claim 25 (depends on 24)

A method according to claim 24, wherein said canonical UI representation includes a description of the parameters associated with the at least one action.

### Claim 26 (depends on 1)

A computer readable medium bearing computer executable instructions for carrying out the method of claim 1.

### Claim 27 (depends on 1)

A modulated data signal carrying computer executable instructions for use in implementing the method of claim 1.

### Claim 28

A data structure formatted according to extensible markup language (XML) including data representative of a canonical UI description of a device to be controlled for use by a universal console.

### Claim 29 (depends on 28)

A data structure according to claim 28, wherein said canonical UI description includes a representation associated with a parameter for choosing one element a from a set A.

### Claim 30 (depends on 29)

A data structure according to claim 29, wherein said canonical UI description includes a representation associated with a parameter for selecting a subset A′ from a set A.

### Claim 31 (depends on 28)

A data structure according to claim 28, wherein said canonical UI description includes a representation associated with a parameter for selecting one from the group of True/False, Off/On, OK/Cancel and Yes/No.

### Claim 32 (depends on 28)

A data structure according to claim 28, wherein said canonical UI description includes a representation associated with a parameter for selecting an integer n in the range n1 through n2, with increment δ.

### Claim 33 (depends on 28)

A data structure according to claim 28, wherein said canonical UI description includes a representation associated with a parameter for selecting a real number x in the range x1 through x2, with increment δ.

### Claim 34 (depends on 28)

A data structure according to claim 28, wherein said canonical UI description includes a representation associated with a parameter type for an arbitrary string s.

### Claim 35 (depends on 34)

A data structure according to claim 34, wherein said arbitrary string s is to be selected from a suggestion set of strings S.

### Claim 36 (depends on 28)

A data structure according to claim 28, wherein said canonical UI description includes a representation associated with a parameter type for the modification of a given first string s, resulting in a second string s′.

### Claim 37 (depends on 28)

A data structure according to claim 28, wherein said canonical UI description includes a representation associated with a parameter type for ordering the elements of set A into A′.

### Claim 38 (depends on 28)

A data structure according to claim 28, wherein said canonical UI description includes a representation associated with a parameter type for pairing set A elements with set B elements.

### Claim 39 (depends on 28)

A data structure according to claim 28, wherein said canonical UI description includes a representation associated with a group construct that contains at least one of commands and subgroups.

### Claim 40 (depends on 28)

A data structure according to claim 28, wherein said canonical UI description includes a representation associated with a command construct that specifies at least one action to send to the controlled element that will carry out the action-command.

### Claim 41 (depends on 40)

A data structure according to claim 40, wherein said canonical UI description includes a description of the parameters associated with the at least one action.

### Claim 42

A computer system wherein a user controls at least one computing element, said system comprising:
at least one computing element each having a canonical user interface (UI) description associated therewith; and
a universal console (UC) for controlling said at least one computing element and storing user preferences therein;
wherein a computing element of said at least one computing element communicates its associated canonical UI to said UC,
wherein said UC generates a concrete UI description from said canonical UI and said stored user preferences, and
wherein a user thereafter utilizes said UC to control said computing element via said concrete UI by selecting at least one action-command.

### Claim 43 (depends on 42)

A computer system according to claim 42, wherein said selecting at least one action-command includes requesting information about the state of said at least one computing element.

### Claim at position 44 (depends on 42)

44 A computer system according to claim 42, wherein a user of said UC interacts with at least one group hierarchy to obtain data in connection with said selected at least one action-command to be carried out by the computing element.

### Claim 45 (depends on 42)

A computer system according to claim 42, wherein said storage of user preferences includes the storage of data indicating at least one disability of the user.

### Claim 46 (depends on 42)

A computer system according to claim 42, wherein said at least one computing element carries out said at least one action-command.

### Claim 47 (depends on 42)

A computer system according to claim 42, wherein said UC receives notifications from the at least one computing element.

### Claim 48 (depends on 47)

A computer system according to claim 47, wherein said notifications include at least one of an error message, warning message, status update message and state change.

### Claim 49 (depends on 42)

A computer system according to claim 42, wherein said canonical UI description is formatted according to an XML stream.

### Claim 50 (depends on 42)

A computer system according to claim 42, wherein said selecting at least one action-command includes requesting a list of available devices that may be controlled by UC.

### Claim 51 (depends on 42)

A computer system according to claim 42, wherein communications between said UC and said computing element are made via Hypertext Transfer Protocol (HTTP).

### Claim 52 (depends on 42)

A computer system according to claim 42, wherein said computing element is one from the group of a computing device and an application.

### Claim 53 (depends on 42)

A computer system according to claim 42, wherein said remote procedure call mechanism makes calls according to SOAP (Simple Object Activation Protocol).

### Claim 54 (depends on 42)

A computer system according to claim 42, wherein said canonical UI description includes a description associated with a parameter for choosing one element a from a set A.

### Claim 55 (depends on 42)

A computer system according to claim 42, wherein said canonical UI description includes a description associated with a parameter for selecting a subset A′ from a set A.

### Claim 56 (depends on 42)

A computer system according to claim 42, wherein said canonical UI description includes a description associated with a parameter for selecting one from the group of True/False, Off/On, OK/Cancel and Yes/No.

### Claim 57 (depends on 42)

A computer system according to claim 42, wherein said canonical UI description includes a description associated with a parameter for selecting an integer n in the range n1 through n2, with increment δ.

### Claim 58 (depends on 42)

A computer system according to claim 42, wherein said canonical UI description includes a description associated with a parameter for selecting a real number x in the range x1 through x2, with increment δ.

### Claim 59 (depends on 42)

A computer system according to claim 42, wherein said canonical UI description includes a description associated with a parameter type for an arbitrary string s.

### Claim 60 (depends on 59)

A computer system according to claim 59, wherein said arbitrary string s is to be selected from a suggestion set of strings S.

### Claim 61 (depends on 42)

A computer system according to claim 42, wherein said canonical UI description includes a description associated with a parameter type for the modification of a given first string s, resulting in a second string s′.

### Claim 62 (depends on 42)

A computer system according to claim 42, wherein said canonical UI description includes a description associated with a parameter type for ordering the elements of set A into A′.

### Claim 63 (depends on 42)

A computer system according to claim 42, wherein said canonical UI description includes a description associated with a parameter type for pairing set A elements with set B elements.

### Claim 64 (depends on 42)

A computer system according to claim 42, wherein said canonical UI description includes a description associated with a group construct that contains at least one of commands and subgroups.

### Claim 65 (depends on 42)

A computer system according to claim 42, wherein said canonical UI description includes a description associated with a command construct that specifies at least one action to send to the controlled element that will carry out the action-command.

### Claim 66 (depends on 65)

A computer system according to claim 65, wherein said canonical UI description includes a description of the parameters associated with the at least one action.
