# US 8,542,320 B2 · Method and system to control a non-gesture controlled device using gesture interactions with a gesture controlled device > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 8,542,320 B2 - Document ID: US8542320B2 - Status: Granted - Kind: B2 - Application number: 12/817,528 - Filed: 2010-06-17 - Published: 2011-12-22 - Granted: 2013-09-24 - Earliest claimed: 2010-06-17 - Assignees: Sony Corporation - Applicants: Alexander Berestov; Hans Masli - Inventors: Alexander Berestov; Hans Masli - Web page: https://patentgrep.com/patent/US8542320B2 ## CPC - H04N 21/4223: Cameras (H04N23/00 takes precedence) - H04N 21/4112: {having fewer capabilities than the client, e.g. thin client having less processing power or no tuning capabilities} - H04N 21/4312: {involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations} - H04N 21/43635: {HDMI} - H04N 21/44218: {Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV programme (methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45)} - H04N 21/482: End-user interface for programme selection - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract A television set. The television set includes a display, a gesture detector, a transceiver, a processor, and a memory component. The display is operable to render images. The gesture detector is operable to detect gesture interactions, e.g., initiation of gesture control operation. The transceiver is operable to communicate with an electronic device that is separate from the television set. The processor is operable to cause the transceiver to send a request message to the electronic device. The request message is a request to receive a graphical user interface (GUI) of the electronic device for rendering on the display. The transceiver receives the GUI of the electronic device responsive to the request message. The processor generates a command message responsive to gesture interaction with the GUI of the electronic device. The command message is operable to control an operation of the electronic device and is transmitted to the electronic device. ## Claims ### Claim 1 A television set comprising: a display for rendering images; a gesture detector operable to detect a user performed gesture control operations; a transceiver operable to communicate with an electronic device separate from said television set; and a processor operable to render a graphical user interface (GUI) specific to said electronic device on said display and operable to allow gesture controlled interaction of said GUI responsive to said gesture detector, and wherein said processor is further operable to generate a command message responsive to gesture interactions with said GUI, wherein said command message is operable to be communicated by said transceiver to said electronic device to control an operation of said electronic device, wherein said processor is further operable to, responsive to a determination by the processor based on signals from the gesture detector that a person has input a predetermined gesture, cause said transceiver to send a request message to said electronic device, wherein said request message is a request to receive a graphical user interface (GUI) of said electronic device. ### Claim 2 (depends on 1) The television set as described in claim 1 further comprising: a memory component operable to store said GUI of said electronic device. ### Claim 3 (depends on 1) The television set as described in claim 1, wherein said transceiver receives said GUI of said electronic device responsive to said request message. ### Claim 4 (depends on 1) The television set as described in claim 1, wherein said processor is operable to cause said transceiver to send said command message to said electronic device. ### Claim 5 (depends on 4) The television set as described in claim 4, wherein said transceiver is operable to receive a response message from said electronic device responsive to said command message. ### Claim 6 (depends on 1) The television set as described in claim 1, wherein said transceiver comprises a wireless radio frequency component. ### Claim 7 (depends on 1) The television set as described in claim 1, wherein said gesture detector comprises: a camera for accepting said gesture interactions; and gesture recognition logic operable to process said gesture interactions. ### Claim 8 A method of controlling a non-gesture controlled device via gesture interaction with a gesture controlled device, said method comprising: said gesture controlled device detecting user performed gestures; the gesture controlled device receiving a first gesture and determining whether the first gesture matches a first predetermined gesture indicating a desire to control a specific device; the gesture controlled device, responsive to a determination that the first gesture matches the first predetermined gesture and that the specific device indicated by the first gesture is the non gesture control device, sending a request to the non gesture control device for a graphical user interface (GUI); said gesture controlled device rendering graphical user interface (GUI) of the non-gesture controlled device for gesture interactions thereof responsive to said user performed gestures; and said gesture controlled device generating a command signal responsive to gesture interactions with said GUI, wherein said command signal is operable to be communicated to said non-gesture controlled device to control an operation of said non-gesture controlled device. ### Claim 9 (depends on 8) The method as described in claim 8 further comprising: said gesture controlled device sending said command signal to said non-gesture controlled device. ### Claim 10 (depends on 8) The method as described in claim 8 further comprising: said gesture controlled device storing said GUI of said non-gesture controlled device. ### Claim 11 (depends on 8) The method as described in claim 8 further comprising: said gesture controlled device receiving a response message from said non-gesture controlled device responsive to said command signal. ### Claim 12 (depends on 8) The method as described in claim 8, wherein said gesture controlled device is a television set. ### Claim 13 (depends on 8) The method as described in claim 8, wherein said non-gesture controlled device is a set-top-box. ### Claim 14 An electronic device comprising: a gesture recognition system comprising a camera and a gesture recognition logic unit, said gesture recognition system operable to detect recognized gestures based on user performed gesture actions; a display; a memory device; a processor operable to receive said recognized gestures from said gesture recognition system, said processor operable to recognize a gesture indicating a desired to control using gestures an external device and responsive to recognizing the gesture indicating a desire to control the external device, sending a request to the external device to provide a graphical user interface (GUI), the processor being further operable to display the graphical user interface pertinent from the external device and operable to allow gesture-controlled interactions with said graphical user interface based on said recognized gestures; and a transmitter, responsive to said processor, for transmitting a command for controlling said external device based on said gesture-controlled interactions. ### Claim 15 (depends on 14) An electronic device as described in claim 14 wherein said external device is an audio/video source device and wherein said transmitter is a wireless transmitter. ### Claim 16 (depends on 15) An electronic device as described in claim 15 wherein said audio/video source is a set-top-box and wherein said wireless transmitter is a radio frequency transmitter. ### Claim 17 (depends on 15) An electronic device as described in claim 15 further comprising a receiver operable for receiving said graphical user interface from said external device responsive to a first recognized gesture. ### Claim 18 (depends on 17) An electronic device as described in claim 17 wherein said receiver is further operable to receive a response indicating from said external device indicating that said external device received said command.