# US 12,216,880 B2 · Mobile terminal, image display device and user interface provision method using the same > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,216,880 B2 - Document ID: US12216880B2 - Status: Granted - Kind: B2 - Application number: 18/516,383 - Filed: 2023-11-21 - Published: 2024-03-14 - Granted: 2025-02-04 - Earliest claimed: 2012-07-06 - Assignees: LG Electronics Inc. - Applicants: LG Electronics Inc. - Inventors: Kwontae Lee; Youngkeun Kim - Web page: https://patentgrep.com/patent/US12216880B2 ## CPC - G06F 3/048: Interaction techniques based on graphical user interfaces [GUI] - G06F 1/1694: {the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer} - G06F 3/038: Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry - G06F 3/04817: using icons (graphical or visual programming using iconic symbols G06F8/34) - G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence) - G06F 3/1454: {involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay} - G09G 5/14: Display of multiple viewports - H04N 5/2624: {for obtaining an image which is composed of whole input images, e.g. splitscreen} - H04N 21/4122: {additional display device, e.g. video projector (digital output for controlling a plurality of local displays G06F3/1423)} - H04N 21/41265: {having a remote control device for bidirectional communication between the remote control device and client device (unidirectional remote control device H04N21/42204)} - H04N 21/41407: {embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop (constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57)} - H04N 21/42204: {User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor (constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205)} - H04N 21/42222: {Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device} - H04N 21/4312: {involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations} - G06F 2200/1637: Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer - G06F 2203/0384: Wireless input, i.e. hardware and software details of wireless interface arrangements for pointing devices - G06F 2203/04803: Split screen, i.e. subdividing the display area or the window area into separate subareas - G09G 2340/0442: Handling or displaying different aspect ratios, or changing the aspect ratio - G09G 2340/0464: Positioning - G09G 2340/0492: Change of orientation of the displayed image, e.g. upside-down, mirrored - G09G 2354/00: Aspects of interface with display user - G09G 2356/00: Detection of the display position w.r.t. other display screens - G09G 2370/16: Use of wireless transmission of display information - G09G 2370/20: Details of the management of multiple sources of image data - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract A digital television includes: a display; a tuner; a wireless network interface to transmit data to a mobile terminal and receive audio information and screen; and a controller. The controller is configured to control a signal processor to decode the video signal and the screen information, control the display to display first image corresponding to the decoded video signal with second image corresponding to the decoded screen information, the second image corresponding to an image displayed on the mobile terminal, and receive a command from a remote controller. The controller is also configured to control the signal processor to process the audio signal and the audio information and to output the processed audio signal or the processed audio information to an audio output unit, and to control the signal processor to change the second image's size or position depending on the at least one command received from the remote controller. ## Claims ### Claim 1 A method of a display device, the method comprising: displaying, on a display, a first mirroring image based on a received image data if a mobile terminal is in a landscape mode and the display device is in a landscape mode, the received image data corresponding to a screen being displayed on the mobile terminal; displaying, on the display, a second mirroring image with right and left margins based on the received image data if the mobile terminal is in a portrait mode and the display device is in the landscape mode; and displaying, on the display, a third mirroring image with upper and lower margins based on the received image data if the display device is in a portrait mode and the mobile terminal is the landscape mode. ### Claim 2 (depends on 1) The method of claim 1, the method further comprising: obtaining information on a screen posture direction of the display device; and transmitting information on the screen posture direction of the display device to the mobile terminal. ### Claim 3 (depends on 2) The method of claim 2, wherein the received image data is based on the information on the screen posture direction of the display device and information on a screen posture direction of the mobile terminal. ### Claim 4 (depends on 1) The method of claim 1, wherein the method further comprises outputting audio data received wirelessly from the mobile terminal. ### Claim 5 (depends on 1) The method of claim 1, wherein the display device corresponds to a source device and the mobile terminal corresponds to a sink device, and wherein the method further comprises: receiving information for a decoding method supported by the mobile terminal from the mobile terminal wirelessly; generating another image data being different than the received image data based on an encoding method corresponding to the decoding method supported by the mobile terminal; and transmitting the another image data to the mobile terminal. ### Claim 6 (depends on 1) The method of claim 1, wherein the display device includes a television having a tuner configured to receive a broadcast signal from a broadcast station and a user interface configured to receive a command from a remote controller. ### Claim 7 (depends on 1) The method of claim 1, wherein each of the first mirroring image, the second mirroring image, and the third mirroring image corresponds to the screen and is being displayed on the mobile terminal. ### Claim 8 A mobile terminal capable of connecting to a display device, the mobile terminal comprising: a display unit configured to display an image; and a controller coupled with a short range communication module and the display unit, wherein the controller is configured to: transmit, to the display device, image data corresponding to the image being displayed on the display unit through the short range communication module, wherein the controller is further configured to: transmit, to the display device, a first image data if the mobile terminal is in a landscape mode and the display device is in a landscape mode, transmit, to the display device, a second image data with right and left margins if the mobile terminal is in a portrait mode and the display device is in the landscape mode, and transmit, to the display device, a third image data with upper and lower margins if the display device is in a portrait mode and the mobile terminal is the landscape mode. ### Claim 9 (depends on 8) The mobile terminal of claim 8, wherein the controller is further configured to receive information on a screen posture direction of the display device from the display device. ### Claim 10 (depends on 9) The mobile terminal of claim 9, wherein the image data is based on the information on the screen posture direction of the display device and information on a screen posture direction of the mobile terminal. ### Claim 11 (depends on 10) The mobile terminal of claim 10, further comprising: a sensing unit configured to sense the screen posture direction of the mobile terminal, wherein the controller is further configured to compare the sensed screen posture direction of the mobile terminal with the information on the screen posture direction of the display device. ### Claim 12 (depends on 8) The mobile terminal of claim 8, further comprising: the short range communication module configured to perform a data communication with the display device wirelessly, wherein the short range communication module is configured to transmit audio data corresponding to the image data to the display device wirelessly. ### Claim 13 A display device capable of connecting to a mobile terminal, the display device comprising: a display; and a controller is configured to: receive, from the mobile terminal, image data corresponding to a screen being displayed on the mobile terminal, display, on the display, a first mirroring image based on the image data if the mobile terminal is in a landscape mode and the display device is in a landscape mode, display, on the display, a second mirroring image with right and left margins based on the image data if the mobile terminal is in a portrait mode and the display device is in the landscape mode, and display, on the display, a third mirroring image with upper and lower margins based on the image data if the display device is in a portrait mode and the mobile terminal is the landscape mode. ### Claim 14 (depends on 13) The display device of claim 13, wherein the controller is further configured to: obtain information on a screen posture direction of the display device, and transmit information on the screen posture direction of the display device to the mobile terminal. ### Claim 15 (depends on 14) The display device of claim 14, wherein the image data is based on the information on the screen posture direction of the display device and information on a screen posture direction of the mobile terminal. ### Claim 16 (depends on 13) The display device of claim 13, further comprising an audio output unit configured to output audio data received from the mobile terminal. ### Claim 17 (depends on 13) The display device of claim 13, further comprising a wireless signal input unit configured to perform a data communication with the mobile terminal wirelessly. ### Claim 18 (depends on 17) The display device of claim 17, wherein the wireless signal input unit configured to perform the data communication based on Near-Field Communication (NFC). ### Claim 19 (depends on 13) The display device of claim 13, wherein the display device corresponds to a source device and the mobile terminal corresponds to a sink device, and wherein the controller is further configured to: receive information for a decoding method supported by the mobile terminal from the mobile terminal; generate another image data being different than the image data based on an encoding method corresponding to the decoding method supported by the mobile terminal; and transmit the another image data to the mobile terminal. ### Claim 20 (depends on 13) The display device of claim 13, wherein the display device includes a television having a tuner configured to receive a broadcast signal from a broadcast station and a user interface configured to receive a command from a remote controller.