# US 2017/0255304 A1 · Mobile terminal, image display device and user interface provision method using the same

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0255304 A1
- Document ID: US20170255304A1
- Status: Published application
- Kind: A1
- Application number: 15/463,914
- Filed: 2017-03-20
- Published: 2017-09-07
- Earliest claimed: 2012-07-06
- Assignees: LG Electronics Inc.
- Applicants: LG Electronics Inc.
- Inventors: Kwontae LEE; Youngkeun KIM
- Web page: https://patentgrep.com/patent/US20170255304A1

## CPC

- G06F 3/048: Interaction techniques based on graphical user interfaces [GUI]
- G06F 1/1694: {the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer}
- G06F 3/038: Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
- G06F 3/04817: using icons (graphical or visual programming using iconic symbols G06F8/34)
- G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence)
- G06F 3/1454: {involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay}
- G09G 5/14: Display of multiple viewports
- H04N 5/2624: {for obtaining an image which is composed of whole input images, e.g. splitscreen}
- H04N 21/4122: {additional display device, e.g. video projector (digital output for controlling a plurality of local displays G06F3/1423)}
- H04N 21/41265: {having a remote control device for bidirectional communication between the remote control device and client device (unidirectional remote control device H04N21/42204)}
- H04N 21/41407: {embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop (constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57)}
- H04N 21/42204: {User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor (constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205)}
- H04N 21/42222: {Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device}
- H04N 21/4312: {involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations}
- G06F 2200/1637: Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
- G06F 2203/0384: Wireless input, i.e. hardware and software details of wireless interface arrangements for pointing devices
- G06F 2203/04803: Split screen, i.e. subdividing the display area or the window area into separate subareas
- G09G 2340/0442: Handling or displaying different aspect ratios, or changing the aspect ratio
- G09G 2340/0464: Positioning
- G09G 2340/0492: Change of orientation of the displayed image, e.g. upside-down, mirrored
- G09G 2354/00: Aspects of interface with display user
- G09G 2356/00: Detection of the display position w.r.t. other display screens
- G09G 2370/16: Use of wireless transmission of display information
- G09G 2370/20: Details of the management of multiple sources of image data
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A method of sharing data, in a system having both an image display device and an external device, can include connecting the image display device to the external device; capturing, by the external device, a current screen on the external device; generating, by the external device, first screen information based on the captured current screen, which includes the captured current screen and margin information when the external device is in a portrait mode; encoding, by the external device, the generated first screen information; transmitting, by the external device, the encoded first screen information to the image display device; decoding, by the image display device, the encoded first screen information; and outputting, by the image display device, a first mirroring image based on the decoded first screen information, in which the first mirroring image corresponds to the current screen on the external device and includes right and left margins.

## Claims

### Claim 1

A method of sharing data in a system comprising both an image display device and an external device, the method comprising:
connecting the image display device to the external device via an wireless network;
capturing, by the external device, a current screen displayed on the external device;
generating, by the external device, first screen information based on the captured current screen, wherein the generated first screen information comprises the captured current screen and margin information when the external device is in a portrait mode;
encoding, by the external device, the generated first screen information;
transmitting, by the external device, the encoded first screen information to the image display device via the wireless network;
decoding, by the image display device, the encoded first screen information; and
outputting, by the image display device, a first mirroring image based on the decoded first screen information, wherein the first mirroring image corresponds to the current screen displayed on the external device and wherein the first mirroring image includes right and left margins.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
generating, by the external device, second screen information based on the captured current screen, wherein the generated second screen information comprises the captured current screen without margin information when the external device is in a landscape mode;
encoding, by the external device, the generated second screen information;
transmitting, by the external device, the encoded second screen information to the image display device via the wireless network;
decoding, by the image display device, the encoded second screen information; and
outputting, by the image display device, a second mirroring image based on the decoded second screen information, wherein the second mirroring image corresponds to the current screen displayed on the external device and wherein the second mirroring image has no right and left margins.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
processing, by the external device, the right and left margins in black based on the margin information such that the current screen of the portrait mode suits a screen of the image display device.

### Claim 4 (depends on 1)

The method of claim 1, further comprising:
storing, by the image display device, width and length information of a screen of the image display device.

### Claim 5 (depends on 1)

The method of claim 1, further comprising:
outputting, by the image display device, a cursor which is a guide image at a point pointed to by a wireless remote controller; and
generating, by the image display device, coordinate information of the cursor output at the point pointed to by the wireless remote controller.

### Claim 6 (depends on 1)

The method of claim 1, wherein a screen posture direction of the external device is determined by using a gyroscope sensor.

### Claim 7 (depends on 2)

The method of claim 2, further comprising:
generating, by the external device, third screen information based on the captured current screen, wherein the generated third screen information comprises the captured current screen and margin information when the external device is in the landscape mode and the image display device is in a portrait mode;
encoding, by the external device, the generated third screen information;
transmitting, by the external device, the encoded third screen information to the image display device via the wireless network;
decoding, by the image display device, the encoded third screen information; and
outputting, by the image display device, a third mirroring image based on the decoded third screen information, wherein the third mirroring image corresponds to the current screen displayed on the external device and wherein the third mirroring image includes upper and lower margins.

### Claim 8

A mobile terminal for sharing data with an image display device, the mobile terminal comprising:
an wireless network interface configured to connect the image display device;
a display; and
a controller coupled to the wireless network interface and the display,
wherein the controller is configured to:
capture a current screen on the display,
generate first screen information based on the captured current screen, wherein the generated first screen information comprises the captured current screen and margin information when the mobile terminal is in a portrait mode,
encode the generated first screen information, and
control the wireless network interface to transmit the encoded first screen information to the image display device.

### Claim 9 (depends on 8)

The mobile terminal of claim 8, wherein the controller is further configured to:
generate second screen information based on the captured current screen, wherein the generated second screen information comprises the captured current screen without margin information when the mobile terminal is in a landscape mode,
encode the generated second screen information, and
control the wireless network interface to transmit the encoded second screen information to the image display device.

### Claim 10 (depends on 8)

The mobile terminal of claim 8, wherein the controller is further configured to process the right and left margins in black based on the margin information such that the current screen of the portrait mode suits a screen of the image display device.

### Claim 11 (depends on 8)

The mobile terminal of claim 8, wherein a screen posture direction of the mobile terminal is determined by using a gyroscope sensor.

### Claim 12 (depends on 9)

The mobile terminal of claim 9, wherein the controller is further configured to:
generate third screen information based on the captured current screen, wherein the generated third screen information comprises the captured current screen and margin information when the mobile terminal is in the landscape mode and the image display device is in a portrait mode,
encode the generated third screen information, and
control the wireless network interface to transmit the encoded third screen information to the image display device.

### Claim 13 (depends on 8)

The mobile terminal of claim 8, wherein the mobile terminal corresponds to a mobile phone, smartphone, a personal digital assistant (PDA) or a portable multimedia player (PMP).

### Claim 14

An image display device for sharing data with a mobile terminal, the image display device comprising:
an wireless network interface configured to connect the mobile terminal;
a display; and
a controller coupled to the wireless network interface and the display,
wherein the controller is configured to:
control the wireless network interface to receive first screen information from the mobile terminal, wherein the first screen information further comprises margin information when the mobile terminal is in a portrait mode,
control the display to output a first mirroring image based on the first screen information, wherein the first mirroring image corresponds to a current screen displayed on the mobile terminal and wherein the first mirroring image includes right and left margins,
control the wireless network interface to receive second screen information from the mobile terminal, wherein the second screen information has no margin information when the mobile terminal is in a landscape mode, and
control the display to output a second mirroring image based on the second screen information, wherein the second mirroring image corresponds to a current screen displayed on the mobile terminal and wherein the second mirroring image has no right and left margins.

### Claim 15 (depends on 14)

The image display device of claim 14, wherein the controller is further configured to:
control the wireless network interface to receive third screen information from the mobile terminal, wherein the third screen information further comprises margin information when the mobile terminal is in the landscape mode and the image display device is in a portrait mode, and
control the display to output a third mirroring image based on the third screen information, wherein the third mirroring image corresponds to a current screen displayed on the mobile terminal and wherein the third mirroring image includes upper and lower margins.

### Claim 16 (depends on 14)

The image display device of claim 14, further comprising:
a memory configured to store width and length information of a screen of the image display device.

### Claim 17 (depends on 14)

The image display device of claim 14, wherein the controller is further configured to control the display to output a cursor which is a guide image at a point pointed to by a wireless remote controller.

### Claim 18 (depends on 17)

The image display device of claim 17, wherein the controller is further configured to generate coordinate information of the cursor output at the point pointed to by the wireless remote controller.

### Claim 19 (depends on 14)

The image display device of claim 14, wherein the image display device corresponds to a TV receiver, a laptop computer, a digital broadcast terminal, a navigation device, a mobile phone, a smartphone, a personal digital assistant (PDA) or a portable multimedia player (PMP).

### Claim 20 (depends on 14)

The image display device of claim 14, wherein the wireless network interface performs based on Wi-Fi, Bluetooth or ZigBee.
