# US 2019/0171407 A1 · Methods, systems, and media for providing a remote control interface > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2019/0171407 A1 - Document ID: US20190171407A1 - Status: Published application - Kind: A1 - Application number: 16/266,632 - Filed: 2019-02-04 - Published: 2019-06-06 - Earliest claimed: 2013-03-13 - Assignees: Google Inc. - Applicants: Google LLC - Inventors: Ant Oztaskent - Web page: https://patentgrep.com/patent/US20190171407A1 ## CPC - G06F 3/1454: {involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay} - G06F 3/033: Pointing devices displaced or positioned by the user {, e.g. mice, trackballs, pens or joysticks}; Accessories therefor (digitisers characterised by the transducing means G06F3/041) - G06F 3/0482: Interaction with lists of selectable items, e.g. menus - G06F 3/04847: Interaction techniques to control parameter settings, e.g. interaction with sliders or dials - G06V 30/224: of printed characters having additional code marks or containing code marks - G08C 23/04: using light waves, e.g. infrared - G08C 2201/21: Programming remote control devices via third means - G08C 2201/40: Remote control systems using repeaters, converters, gateways - G08C 2201/93: Remote control using other portable devices, e.g. mobile phone, PDA, laptop - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - G08C: TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS (fluid pressure transmitting systems F15B; mechanical means for transferring the output of a sensing member into a different variable G01D5/00; mechanical control systems G05G) ## Abstract In accordance with some implementations of the disclosed subject matter, mechanisms for providing a remote control interface are provided. In some implementations, a method for providing a remote control interface is provided, the method comprising: receiving an image of a user input interface associated with a media playback device; identifying the user input interface from a plurality of user input interfaces based on image recognition; determining a code library associated with the identified user input interface; and transmitting the code library to a mobile device that provided the image of the user input interface, wherein the code library allows a mobile device to control the media playback device. ## Claims ### Claim 1 A method for providing remote control interfaces, the method comprising: identifying, using a hardware processor, a user input interface from a plurality of user input interfaces based on a received image of a user input interface associated with a media playback device from a mobile device, wherein the user input interface is configured to transmit first wireless signals to the media playback device; transmitting, using the hardware processor, a representation of the identified user input interface to the mobile device; determining, using the hardware processor, network connection information indicating that the mobile device is configured to transmit second wireless signals to the media playback device; and in response to determining that the mobile device is connected to the media playback device via a wireless communications network and in response to determining that the mobile device is configured to transmit the second wireless signals to the media playback device over the wireless communications network that are different than the first wireless signals, transmitting, using the hardware processor, a code library to the media playback device for use with commands inputted into the representation of the identified user input interface and received as the second wireless signals. ### Claim 2 (depends on 1) The method of claim 1, further comprising determining the code library associated with the identified user input interface, wherein portions of the code library are mapped to input interfaces in the representation of the identified user input interface. ### Claim 3 (depends on 1) The method of claim 1, further comprising determining whether to transmit the code library to the mobile device or an additional mobile device based on the network connection information indicating that the mobile device is configured to transmit second wireless signals to the media playback device. ### Claim 4 (depends on 1) The method of claim 1, wherein the code library is an infrared code library. ### Claim 5 (depends on 1) The method of claim 1, further comprising: in response to receiving the image of the user input interface, identifying a plurality of user input interfaces based on the received image; and causing a plurality of user input interface representations corresponding to the plurality of user input interfaces to be presented on the mobile device for selecting a user input interface representation from the plurality of user input interface representations. ### Claim 6 (depends on 5) The method of claim 5, wherein the plurality of user input interface representations includes a first user input interface representation that is generated based on the received image of the user input interface and a second user input interface representation that is generated based on a predetermined user input interface layout. ### Claim 7 (depends on 6) The method of claim 6, further comprising generating the first user input interface representation by modifying the received image of the user input interface and mapping the portions of the code library to portions of the modified image. ### Claim 8 (depends on 1) The method of claim 1, further comprising using optical character recognition to identify text portions of the received image of the user input interface, wherein the identified text portions of the received image are used to identify the user input interface. ### Claim 9 A method for providing remote control interfaces, the method comprising: identifying, using a mobile device that includes a hardware processor, a user input interface from a plurality of user input interfaces based on a captured image of the user input interface associated with a media playback device, wherein the user input interface is configured to transmit first wireless signals to the media playback device over a wireless communications network; causing, using the mobile device, a representation of the user input interface to be presented on the mobile device, wherein a code library associated with the identified user input interface is mapped to a plurality of interface elements in the representation of the user input interface; receiving, using the mobile device, an input to one or more of the plurality of interface elements in the representation of the user input interface; and in response to determining that the mobile device is configured to transmit second wireless signals to the media playback device over the wireless communications network that are different than the first wireless signals and in response to receiving the input to the one or more of the plurality of interface elements in the representation of the user input interface, transmitting, using the mobile device, instructions to the media playback device over the wireless communications network in the second wireless signals, wherein the instructions include the input to the one or more of the plurality of interface elements and corresponding information from the code library. ### Claim 10 (depends on 9) The method of claim 9, further comprising: associating with the media playback device over the wireless communications network; capturing the image of the user input interface associated with the media playback device; and mapping the code library associated with the identified user input interface to the plurality of interface elements in the representation of the user input interface in response to identifying the user input interface. ### Claim 11 (depends on 9) The method of claim 9, further comprising transmitting the instructions to an external media device that is configured to transmit the first wireless signals, thereby causing the mobile device to control the media playback device via the external media device. ### Claim 12 (depends on 9) The method of claim 9, wherein the code library is an infrared code library. ### Claim 13 (depends on 9) The method of claim 9, further comprising: in response to capturing the image of the user input interface, receiving the plurality of user input interfaces that correspond to the captured image; and causing a plurality of user input interface representations corresponding to the plurality of user input interfaces to be presented for selecting a user input interface representation from the plurality of user input interface representations. ### Claim 14 (depends on 13) The method of claim 13, wherein the plurality of user input interface representations includes a first user input interface representation that is generated based on the captured image of the user input interface and a second user input interface representation that is generated based on a predetermined user input interface layout. ### Claim 15 (depends on 9) The method of claim 9, further comprising using optical character recognition to identify text portions of the captured image of the user input interface, wherein the identified text portions of the captured image are used to identify the user input interface. ### Claim 16 A system for providing remote control interfaces, the system comprising: a hardware processor that is configured to: identify a user input interface from a plurality of user input interfaces based on a received image of a user input interface associated with a media playback device from a mobile device, wherein the user input interface is configured to transmit first wireless signals to the media playback device; transmit a representation of the identified user input interface to the mobile device; determine network connection information indicating that the mobile device is configured to transmit second wireless signals to the media playback device; and in response to determining that the mobile device is connected to the media playback device via a wireless communications network and in response to determining that the mobile device is configured to transmit the second wireless signals to the media playback device over the wireless communications network that are different than the first wireless signals, transmit a code library to the media playback device for use with commands inputted into the representation of the identified user input interface and received as the second wireless signals. ### Claim 17 (depends on 16) The system of claim 16, wherein the hardware processor is further configured to determine the code library associated with the identified user input interface, wherein portions of the code library are mapped to input interfaces in the representation of the identified user input interface. ### Claim 18 (depends on 16) The system of claim 16, wherein the hardware processor is further configured to determine whether to transmit the code library to the mobile device or an additional mobile device based on the network connection information indicating that the mobile device is configured to transmit second wireless signals to the media playback device. ### Claim 19 (depends on 16) The system of claim 16, wherein the code library is an infrared code library. ### Claim 20 (depends on 16) The system of claim 16, wherein the hardware processor is further configured to: in response to receiving the image of the user input interface, identify a plurality of user input interfaces based on the received image; and cause a plurality of user input interface representations corresponding to the plurality of user input interfaces to be presented on the mobile device for selecting a user input interface representation from the plurality of user input interface representations. ### Claim 21 (depends on 20) The system of claim 20, wherein the plurality of user input interface representations includes a first user input interface representation that is generated based on the received image of the user input interface and a second user input interface representation that is generated based on a predetermined user input interface layout. ### Claim 22 (depends on 21) The system of claim 21, wherein the hardware processor is further configured to generate the first user input interface representation by modifying the received image of the user input interface and mapping the portions of the code library to portions of the modified image. ### Claim 23 (depends on 16) The system of claim 16, wherein the hardware processor is further configured to use optical character recognition to identify text portions of the received image of the user input interface, wherein the identified text portions of the received image are used to identify the user input interface.