# US 2020/0401257 A1 · Mobile terminal, image display device and user interface provision method using the same

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0401257 A1
- Document ID: US20200401257A1
- Status: Published application
- Kind: A1
- Application number: 17/014,596
- Filed: 2020-09-08
- Published: 2020-12-24
- Earliest claimed: 2012-07-06
- Assignees: LG Electronics Inc.
- Applicants: LG Electronics Inc.
- Inventors: Kwontae LEE; Youngkeun KIM
- Web page: https://patentgrep.com/patent/US20200401257A1

## CPC

- G06F 3/048: Interaction techniques based on graphical user interfaces [GUI]
- G06F 1/1694: {the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer}
- G06F 3/038: Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
- G06F 3/04817: using icons (graphical or visual programming using iconic symbols G06F8/34)
- G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence)
- G06F 3/1454: {involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay}
- G09G 5/14: Display of multiple viewports
- H04N 5/2624: {for obtaining an image which is composed of whole input images, e.g. splitscreen}
- H04N 21/4122: {additional display device, e.g. video projector (digital output for controlling a plurality of local displays G06F3/1423)}
- H04N 21/41265: {having a remote control device for bidirectional communication between the remote control device and client device (unidirectional remote control device H04N21/42204)}
- H04N 21/41407: {embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop (constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57)}
- H04N 21/42204: {User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor (constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205)}
- H04N 21/42222: {Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device}
- H04N 21/4312: {involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations}
- G06F 2200/1637: Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
- G06F 2203/0384: Wireless input, i.e. hardware and software details of wireless interface arrangements for pointing devices
- G06F 2203/04803: Split screen, i.e. subdividing the display area or the window area into separate subareas
- G09G 2340/0442: Handling or displaying different aspect ratios, or changing the aspect ratio
- G09G 2340/0464: Positioning
- G09G 2340/0492: Change of orientation of the displayed image, e.g. upside-down, mirrored
- G09G 2354/00: Aspects of interface with display user
- G09G 2356/00: Detection of the display position w.r.t. other display screens
- G09G 2370/16: Use of wireless transmission of display information
- G09G 2370/20: Details of the management of multiple sources of image data
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A digital television includes: a display; a tuner; a wireless network interface to transmit data to a mobile terminal and receive audio information and screen; and a controller. The controller is configured to control a signal processor to decode the video signal and the screen information, control the display to display first image corresponding to the decoded video signal with second image corresponding to the decoded screen information, the second image corresponding to an image displayed on the mobile terminal, and receive a command from a remote controller. The controller is also configured to control the signal processor to process the audio signal and the audio information and to output the processed audio signal or the processed audio information to an audio output unit, and to control the signal processor to change the second image's size or position depending on the at least one command received from the remote controller.

## Claims

### Claim 1

(canceled)

### Claim 2

A digital television for sharing multiple data with a mobile terminal, the digital television comprising:
a display;
a tuner configured to receive a broadcast signal including video signal and audio signal;
a wireless network interface configured to transmit data to the mobile terminal and to receive audio information and screen information from the mobile terminal wirelessly connected to the digital television; and
a controller configured to:
control a signal processor to decode the video signal and the screen information,
control the display to display first image corresponding to the decoded video signal with second image corresponding to the decoded screen information, wherein the second image corresponds to an image displayed on the mobile terminal, and
receive at least one command from a remote controller,
wherein the controller is further configured to control the signal processor to process the audio signal and the audio information and to output the processed audio signal or the processed audio information to an audio output unit, and
wherein the controller is further configured to control the signal processor to change the second image's size or position depending on the at least one command received from the remote controller.

### Claim 3 (depends on 2)

The digital television of claim 2, wherein the controller is further configured to control the wireless network interface to transmit the at least one command received from the remote controller to the mobile terminal depending on a cursor's coordinate information.

### Claim 4 (depends on 2)

The digital television of claim 2, wherein the second image is displayed with the first image in PIP (Picture-In-Picture) or POP (Picture-Out-Picture) form.

### Claim 5 (depends on 2)

The digital television of claim 2, wherein the wireless network interface is further configured to transmit a decoding method supported by the digital television in response to receiving a request from the mobile terminal.

### Claim 6 (depends on 2)

The digital television of claim 2, wherein the audio information and the screen information are separately received from the mobile terminal or multiplexed information including the audio information and the screen information are received from the mobile terminal.

### Claim 7 (depends on 2)

The digital television of claim 2, wherein the wireless network interface performs based on Wi-Fi, Bluetooth or Zigbee.

### Claim 8 (depends on 2)

The digital television of claim 2, wherein a first wireless path between the digital television and the remote controller is different from a second wireless path between the mobile terminal and the digital television.

### Claim 9 (depends on 2)

The digital television of claim 2, wherein the controller is further configured to control the signal processor to change the first image's size according to a change of the second image' size, and change the first image's position according to a change of the second image' position.

### Claim 10 (depends on 2)

The digital television of claim 2, wherein the data includes information on a screen posture direction of the display.

### Claim 11 (depends on 2)

The digital television of claim 2, wherein the second image is an image representing an execution screen of an application installed in the mobile terminal.

### Claim 12

A method for sharing multiple data with a mobile terminal in a digital television, the method comprising:
receiving a broadcast signal including video data and first audio data;
transmitting data to the mobile terminal;
receiving second audio data and screen information from the mobile terminal wirelessly connected to the digital television;
decoding the screen information and the video data;
displaying, a display of the digital television, a first image based on the screen information with a second image based on the video data, wherein the first image corresponds to an image displayed on the mobile terminal;
outputting the first audio data included in the broadcast signal or the second audio data received from the mobile terminal to an audio output unit;
receiving at least one command from a remote controller; and
changing the first image's size or position depending on the at least one command received from the remote controller.

### Claim 13 (depends on 12)

The method of claim 12, further comprising:
transmitting the at least one command received from the wireless remote controller to the mobile terminal depending on a cursor's coordinate information.

### Claim 14 (depends on 12)

The method of claim 12, wherein the first image and the second image are displayed based on PIP (Picture-In-Picture).

### Claim 15 (depends on 12)

The method of claim 12, further comprising:
transmitting a decoding method supported by the digital television in response to receiving a request from the mobile terminal.

### Claim 16 (depends on 12)

The method of claim 12, wherein the second audio data and the screen information are separately received from the mobile terminal or multiplexed information including the second audio data and the screen information are received from the mobile terminal.

### Claim 17 (depends on 12)

The method of claim 12, wherein the wireless network interface performs based on Wi-Fi, Bluetooth or Zigbee.

### Claim 18 (depends on 12)

The method of claim 12, wherein a first wireless path between the television and the wireless remote controller is different from a second wireless path between the mobile terminal and the television.

### Claim 19 (depends on 12)

The method of claim of claim 12, wherein the method further comprises:
changing the first image's size according to a change of the second image' size, and
changing the first image's position according to a change of the second image' position.

### Claim 20 (depends on 12)

The method of claim 12, wherein the data includes information on a screen posture direction of the display.

### Claim 21 (depends on 12)

The method of claim 12, wherein the second image is an image representing an execution screen of an application installed in the mobile terminal.