# US 2017/0257593 A1 · Running touch screen applications on display device not having touch capability using remote controller having at least a touch sensitive surface > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2017/0257593 A1 - Document ID: US20170257593A1 - Status: Published application - Kind: A1 - Application number: 15/063,075 - Filed: 2016-03-07 - Published: 2017-09-07 - Earliest claimed: 2016-03-07 - Assignees: Sony Corporation - Applicants: Sony Corporation - Inventors: Brant Candelore; Graham Clift - Web page: https://patentgrep.com/patent/US20170257593A1 ## CPC - H04N 21/42224: {Touch pad or touch panel provided on the remote control} - G06F 3/03547: {Touch pads, in which fingers can move on a surface} - G06F 3/038: Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry - G06F 3/0416: {Control or interface arrangements specially adapted for digitisers} - G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures - H04N 21/42204: {User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor (constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205)} - G06F 2203/0384: Wireless input, i.e. hardware and software details of wireless interface arrangements for pointing devices - H04N 21/42206: {characterized by hardware details} - H04N 21/42208: {Display device provided on the remote control} - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract A TV without a touch screen can nonetheless execute applications designed for mobile devices that assume a touch screen user interface (UI) by a “dumb” remote control with up/down, left/right, select buttons, or by a remote control with a touch pad, or by a remote control application running on a mobile device with a touch-screen that communicates with the TV. In all three scenarios, the TV recognizes that it is running in a special remote control mode and with a corresponding remote control application running on the TV that is able to intercept key presses and finger swipes and translate them to touch screen commands that are input to a touch screen-enabled software application running on the TV. ## Claims ### Claim 1 Apparatus comprising: at least one computer memory that is not a transitory signal and that comprises instructions executable by at least one processor to: receive non-touch screen signals from a remote control (RC) that does not have a touch screen display and that has a touch sensitive input surface, the non-touch screen signals being received from the touch sensitive input surface; translate the non-touch screen signals to corresponding touch screen signals; and execute the touch screen signals according to a user interface (UI) enabled for touch screen input the UI executing on an audio video display device (AVDD). ### Claim 2 (depends on 1) The apparatus of claim 1, wherein the display of the AVDD is not touch sensitive. ### Claim 3 (depends on 1) The apparatus of claim 1, comprising at least one processor. ### Claim 4 (depends on 1) The apparatus of claim 1, wherein the non-touch screen signals include a first signal generated by a first gesture on the touch sensitive input surface, and the instructions are executable to translate the first signal to a select signal on the UI at a location on the UI defined by at least a second signal generated by manipulation of a directional key on the RC. ### Claim 5 (depends on 1) The apparatus of claim 1, wherein the non-touch screen signals include a first signal generated by a first gesture on the touch sensitive input surface, and the instructions are executable to translate the first signal to a double tap touch screen signal on the UI at a location on the UI defined by at least a second signal generated by manipulation of a directional key on the RC. ### Claim 6 (depends on 1) The apparatus of claim 1, wherein the non-touch screen signals include a first signal generated by first gesture on the touch sensitive input surface, and the instructions are executable to translate the first signal to a swipe touch screen signal on the UI at a location on the UI defined by at least a second signal generated by manipulation of a directional key on the RC. ### Claim 7 (depends on 1) The apparatus of claim 1, wherein the non-touch screen signals include a first signal generated by a first gesture on the touch sensitive input surface and a second signal generated by manipulation of a directional key on the RC, and the instructions are executable to translate the first and second signals to a long press and drag touch screen signal on the UI at a location on the UI defined by at least a third signal generated by manipulation of a directional key on the RC. ### Claim 8 (depends on 1) The apparatus of claim 1, wherein the non-touch screen signals include a first signal generated by a first gesture on the touch sensitive input surface, and the instructions are executable to translate the first signal to a pinch open touch screen signal on the UI. ### Claim 9 (depends on 8) The apparatus of claim 8, wherein the non-touch screen signals include a second signal generated by a second gesture on the touch sensitive input surface different from the first gesture, and the instructions are executable to translate the second signal to a pinch closed touch screen signal on the UI. ### Claim 10 (depends on 1) The apparatus of claim 1, wherein the non-touch screen signals include a first signal generated by a first single finger gesture on the touch sensitive input surface, and the instructions are executable to translate the first signal to a two finger touch screen signal on the UI. ### Claim 11 (depends on 1) The apparatus of claim 1, wherein the non-touch screen signals include a first signal generated by a first gesture on the touch sensitive input surface, and the instructions are executable to translate the first signal to a rotate touch screen signal on the UI. ### Claim 12 An apparatus comprising: at least one computer memory that is not a transitory signal and that comprises instructions executable by at least one processor for: executing an application on an audio video display device (AVDD) including a user interface (UI) enabled for touch commands, the AVDD not having a touch sensitive display; identifying that the AVDD is in a touch screen mode at least in part by identifying a requirement associated with the application and indicating touch screen input; presenting on the AVDD a cursor; receiving, from a mobile computing device (MCD), touch screen signals; moving the cursor according to the touch screen signals from the MCD; and executing at least one function of the application on the AVDD according to the touch screen signals from the MCD. ### Claim 13 (depends on 12) The apparatus of claim 12, wherein the UI is not sent to the MCD. ### Claim 14 (depends on 12) The apparatus of claim 12, wherein the UI is sent to the MCD for presentation of the UI on a touch sensitive display of the MCD. ### Claim 15 (depends on 12) The apparatus of claim 12, comprising the at least one processor. ### Claim 16 (depends on 12) The apparatus of claim 12, comprising a non-touch sensitive display for presenting the UI on the AVDD. ### Claim 17 An audio video display device (AVDD) comprising: at least one video display that is not touch sensitive; at least one processor configured for executing at least one application for presenting on the video display at least one user interface (UI) of the application enabled for touch input; and at least one computer memory accessible to the at least one processor and including instructions executable for: receiving, from a mobile computing device (MCD), touch screen signals; identifying that the AVDD requires touch screen input responsive to identifying that the AVDD downloaded the application from a mobile device software section of an application provider website; responsive to identifying that the AVDD requires touch screen input, executing at least one function of the application on the AVDD according to the touch screen signals from the MCD. ### Claim 18 (depends on 17) The AVDD of claim 17, wherein the instructions are executable for sending the UI to the MCD for presenting the UI on the MCD. ### Claim 19 (depends on 17) The AVDD of claim 17, wherein the instructions are not executable for sending the UI to the MCD such that the UI is not sent to the MCD and is not presented on the MCD. ### Claim 20 (depends on 1) The apparatus of claim 1, wherein the instructions are executable to: enable translation of the non-touch screen signals to corresponding touch screen signals responsive to a command to enter touch screen mode from the RC.