# US 8,542,323 B2 · Touch sensitive wireless navigation device for remote control > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 8,542,323 B2 - Document ID: US8542323B2 - Status: Granted - Kind: B2 - Application number: 12/256,863 - Filed: 2008-10-23 - Published: 2009-06-25 - Granted: 2013-09-24 - Earliest claimed: 2007-12-21 - Assignees: Sony Corporation; Sony Electronics Inc. - Applicants: Robert Hardacker; Steven Richman - Inventors: Robert Hardacker; Steven Richman - Web page: https://patentgrep.com/patent/US8542323B2 ## CPC - G08C 17/02: using a radio link - H04N 21/42204: {User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor (constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205)} - H04N 21/42224: {Touch pad or touch panel provided on the remote control} - H04N 21/472: End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content {(end-user interfaces for retrieving video data from a database G06F16/739; network services for supporting unicast streaming H04L65/612)} - H04N 21/8146: {involving graphical data, e.g. 3D object, 2D graphics} - G08C 2201/30: User interface - H04N 21/42226: {Reprogrammable remote control devices} - H04N 21/42228: {the reprogrammable keys being displayed on a display screen in order to reduce the number of keys on the remote control device itself} - H04N 21/485: End-user interface for client configuration - G08C: TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS (fluid pressure transmitting systems F15B; mechanical means for transferring the output of a sensing member into a different variable G01D5/00; mechanical control systems G05G) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract Remote control of an electronic device is achieved by retrieving a description of a control surface associated with the electronic device, rendering a graphical representation of at least portion of the control surface on a screen in accordance with the description and navigating the graphical representation using a navigation device that is remote from the first electronic device. The graphical representation may include multiple controls. The electronic device is operated in accordance with controls selected using the navigation device. The graphical representation may be displayed on the navigation device or on a remote screen. The controls to be displayed may be selected automatically dependent upon a selected operating mode. ## Claims ### Claim 1 A method for remote control of a plurality of electronic devices, the method comprising: retrieving a description of a control surface associated with the plurality of electronic devices; rendering a graphical representation of a portion of the control surface on a screen in accordance with the description, the graphical representation comprising a plurality of controls, wherein rendering a graphical representation of the portion of the control surface comprises rendering a graphical representation of a subset of the plurality of controls, wherein the subset of the plurality of controls is selected based on a selected mode of operation operable to control a predefined set of the plurality of electronic devices; receiving a selection of a control of the subset of the plurality of controls on a navigation device; and operating one or more of the predefined set of the plurality of electronic devices associated with the selected mode of operation in accordance with the selected control. ### Claim 2 (depends on 1) A method in accordance with claim 1, wherein the screen is located on one of the navigational device or one of the plurality of electronic devices remote from the navigation device. ### Claim 3 (depends on 2) A method in accordance with claim 2, wherein the screen comprises a touch-screen and wherein selecting a control of the plurality of controls comprises touching the touch screen at an appropriate position. ### Claim 4 (depends on 1) A method in accordance with claim 1, wherein the navigation device comprises a touch sensitive pad. ### Claim 5 (depends on 1) A method in accordance with claim 1, further comprising: selecting the mode of operation involving a first electronic device and at least one second electronic device, wherein the plurality of controls comprises a subset of the controls of the first electronic device and the at least one second electronic device, the subset of controls being appropriate for the selected mode of operation. ### Claim 6 (depends on 5) A method in accordance with claim 5, wherein selecting a control of the plurality of controls affects operation of at least one of the first electronic device and the at least one second electronic device. ### Claim 7 (depends on 1) A method in accordance with claim 1, wherein the control surface comprises a remote control handset. ### Claim 8 (depends on 1) A method in accordance with claim 1, wherein the control surface comprises a control panel. ### Claim 9 A method for remote control of a plurality of electronic devices, the method comprising: retrieving descriptions of a plurality of control surfaces associated with the plurality of electronic devices; rendering a graphical representation of a portion of the control surfaces associated with the plurality of electronic devices on a screen in accordance with the retrieved descriptions, the graphical representation comprising a plurality of controls, wherein rendering the graphical representation of a portion of the control surfaces comprises rendering a graphical representation of a subset of the plurality of controls, wherein the subset of the plurality of controls is selected based on a selected mode of operation, and wherein the selected mode of operation is operable to control a predefined set of the plurality of electronic devices; receiving a selection of a control of the plurality of controls on a navigation device; and operating one or more of the predefined set of the plurality of electronic devices in accordance with the selected control. ### Claim 10 A method for remote control of a plurality of electronic devices, the method comprising: retrieving a description of a control surface associated with the plurality of electronic devices; rendering a graphical representation of a portion of the control surface on a screen in accordance with the description, the graphical representation comprising a plurality of controls; receiving a selection of a control of the plurality of controls on a navigation device, wherein the plurality of controls comprises a subset of the controls associated with the plurality of electronic devices, wherein the subset of controls is selected based on a selected mode of operation, and wherein the selected mode of operation is operable to control a predefined set of the plurality of electronic devices; and operating the the predefined set of the plurality of electronic devices in accordance with the selected control, wherein rendering a graphical representation of a portion of the control surface comprises rendering a graphical representation of a windowed view of the control surface displayed on a remote screen. ### Claim 11 (depends on 10) A method in accordance with claim 10, further comprising controlling at least one of the size and position of the window shown in windowed view of the control surface. ### Claim 12 A wireless navigation device comprising: a display screen; a memory operable to store a description of a control surface for a plurality of electronic devices to be controlled; a graphics processor operable to render an image of a portion of the control surface based on a selected mode of operation, and wherein the selected mode of operation is operable to control a predefined set of the plurality of electronic devices, the image of the portion of the control surface corresponding to a windowed portion of the control surface displayed on a remote screen; a navigation interface operable to enable a user to interact with the rendered image to control operation of the predefined set of the plurality of electronic devices; and a wireless interface operable to enable communication between the navigation device and the predefined set of the plurality of electronic devices to be controlled. ### Claim 13 (depends on 12) A wireless navigation device in accordance with claim 12, wherein the navigation interface comprises a touch sensitive pad. ### Claim 14 (depends on 12) A wireless navigation device in accordance with claim 12, wherein the wireless interface is operable to receive the description of the control surface from each of the plurality of electronic devices to be controlled. ### Claim 15 A wireless navigation device comprising: a navigation interface operable to present a graphical representation of a plurality of controls of a physical control surface displayed on a remote screen for controlling operation of a plurality of electronic devices; and a wireless interface operable to establish communication between the wireless navigation device and the plurality of electronic devices, wherein a subset of the plurality of controls are selected based on a selected mode of operation, and wherein the selected mode of operation is operable to control a predefined set of the plurality of electronic devices. ### Claim 16 (depends on 15) A wireless navigation device in accordance with claim 15, wherein the navigation interface comprises a touch sensitive pad. ### Claim 17 (depends on 15) A wireless navigation device in accordance with claim 15, wherein the physical control surface comprises a remote control handset. ### Claim 18 (depends on 15) A wireless navigation device in accordance with claim 15, wherein the physical control surface comprises a control panel. ### Claim 19 (depends on 15) A wireless navigation device in accordance with claim 15, wherein activation of a graphically represented control causes a plurality of commands to be sent, at least one command being sent to each of the plurality of electronic devices, the commands being selected automatically dependent upon the selected mode of operation.