# US 9,436,650 B2 · Mobile device, display device and method for controlling the same

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 9,436,650 B2
- Document ID: US9436650B2
- Status: Granted
- Kind: B2
- Application number: 13/684,403
- Filed: 2012-11-23
- Published: 2013-05-30
- Granted: 2016-09-06
- Earliest claimed: 2011-11-25
- Assignees: LG Electronics Inc.
- Applicants: LG Electronics Inc.
- Inventors: Jungwoo Kim; Mingoo Kim; Kyunggeun Kim
- Web page: https://patentgrep.com/patent/US9436650B2

## CPC

- G06F 15/16: Combinations of two or more digital computers each having at least an arithmetic unit, a program unit and a register, e.g. for a simultaneous processing of several programs {(coordinating program control therefor G06F9/52; in regulating and control system G05B)}
- H04L 12/2812: {describing content present in a home automation network, e.g. audio video content (retrieval from the Internet G06F16/95)}
- H04L 12/282: {based on user interaction within the home (receiver circuitry for displaying additional information being controlled by a remote control apparatus H04N21/42204)}
- H04L 67/51: Discovery or management thereof, e.g. service location protocol [SLP] or web services
- H04L 2012/2841: {Wireless}
- H04L 2012/2849: {Audio/video appliances}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

A mobile device, a display device and a method for controlling the same are disclosed. The mobile device for performing data communication with a display device includes a display module configured to display a current screen including at least one object, a transmission module configured to transmit an image corresponding to the current screen to the display device if mirroring connection with the display device is established, a reception module configured to receive at least one command for controlling a specific object from the display device, and a controller configured to execute the specific object based on the received at least one command.

## Claims

### Claim 1

A display device for performing data communication with a mobile device, the display device comprising:
a transmitter/receiver configured to establish a mirroring connection with the mobile device, wherein the display device displays a current screen of the mobile device based on the mirroring connection;
a user interface configured to receive a command by a sensing unit for selecting a first location value based on an input to the sensing unit, the first location value being selected through the user interface of the display device; and
a controller configured to transmit at least one command via the transmitter/receiver to control a specific object corresponding to the first location value to the mobile device,
wherein the at least one command includes first information for requesting a content format supported by the mobile device, second information for providing the mobile device with a content format that can be used for connection between the mobile device and the display device, and third information for requesting metadata of the specific object, and
wherein the controller controls the display device to output at least one of video data and audio data associated with execution of the specific object.

### Claim 2 (depends on 1)

The display device according to claim 1, wherein the at least one command further includes:
third information to request metadata of the specific object, and
fourth information to control the execution of the specific object.

### Claim 3 (depends on 2)

The display device according to claim 2, wherein, if the second information is null, the display device does not process the specific object.

### Claim 4 (depends on 1)

The display device according to claim 1, wherein:
after the mirroring connection is established, a virtual network computing (VNC) stream is set up for communication, and
after the specific object is selected using VNC, a real-time transport protocol (RTP) or hypertext transfer protocol (HTTP) stream is set up for communication.

### Claim 5 (depends on 4)

The display device according to claim 4, wherein:
the mobile device and the display device are physically connected through a universal serial bus (USB), and
the display device is mounted in a car.

### Claim 6

A mobile device for performing data communication with a display device, the mobile device comprising:
a display configured to display a current screen including at least one object;
a transmitter configured to transmit an image corresponding to the current screen to the display device when a mirroring connection with the display device is established;
a receiver configured to receive at least one command through a user interface module being associated with the transmitted image to control a specific object from the display device,
wherein the at least one command includes first information for requesting a content format supported by the mobile device, second information for providing the mobile device with a content format that can be used for connection between the mobile device and the display device, and third information for requesting metadata of the specific object; and
a controller configured to execute the specific object based on the received at least one command.

### Claim 7 (depends on 6)

The mobile device according to claim 6, wherein the controller controls the specific object based on the at least one command received through the user interface module of the display device using a coordinate value received from the display device.

### Claim 8 (depends on 6)

The mobile device according to claim 6, wherein the at least one command further includes:
third information to request metadata of the specific object, and
fourth information to control the execution of the specific object.

### Claim 9 (depends on 8)

The mobile device according to claim 8, wherein, if the second information is null, the display device does not process the specific object.

### Claim 10 (depends on 6)

The mobile device according to claim 6, wherein:
after the mirroring connection is established, a virtual network computing (VNC) stream is set up for communication, and
after the specific object is selected using VNC, a real-time transport protocol (RTP) or a hypertext transfer protocol (HTTP) stream is set up for communication.

### Claim 11

A method for controlling a display device for performing data communication with a mobile device, the method comprising:
establishing, via a transmitter/receiver, a mirroring connection with the mobile device;
displaying, on the display device, a current screen of the mobile device;
receiving a command for selecting a first location value associated with the displayed screen through a user interface of the display device, the first location value being selected via the user interface;
in response to the command, transmitting a signal for requesting metadata corresponding to the first location value to the mobile device, wherein the signal includes first information for requesting a content format supported by the mobile device, second information for providing the mobile device with a content format that can be used for connection between the mobile device and the display device, and third information for requesting metadata corresponding to the first location value;
receiving a signal including metadata of a specific object from the mobile device, in response to the transmitted signal; and
outputting at least one of video data and audio data associated with execution of the specific object.

### Claim 12 (depends on 11)

The method according to claim 11, wherein the received signal includes at least one piece of protocol identification information supported by the mobile device.

### Claim 13 (depends on 12)

The method according to claim 12, wherein the received signal is added as a state variable (statevariable) of a content directory service defined in universal plug and play (UPnP).

### Claim 14 (depends on 11)

The method according to claim 11, wherein the specific object defines data returned by a content directory service from a browsing action or a searching action.

### Claim 15 (depends on 11)

The method according to claim 11, wherein the transmitting the signal includes transmitting a signal for requesting the metadata and a coordinate value of the first location value.

### Claim 16

A method for controlling a mobile device for performing data communication with a display device, the method comprising:
outputting, via a display, a current screen including at least one object;
transmitting, by the mobile device, an image corresponding to the current screen to the display device when a mirroring connection with the display device is established;
transmitting a signal including metadata of a specific object to the display device, in response to a request signal from the display device, wherein the signal includes first information for requesting a content format supported by the mobile device, second information for providing the mobile device with a content format that can be used for connection between the mobile device and the display device, and third information for requesting metadata of the specific object; and
executing, by the mobile device, the specific object.

### Claim 17 (depends on 16)

The method according to claim 16, further comprising controlling the specific object based on at least one command received through a user interface module of the display device using a coordinate value received from the display device.

### Claim 18 (depends on 16)

The method according to claim 16, wherein the transmitted signal includes at least one piece of protocol identification information supported by the mobile device.

### Claim 19 (depends on 18)

The method according to claim 18, wherein the transmitted signal is added as a state variable (statevariable) of a content directory service defined in universal plug and play (UPnP).

### Claim 20 (depends on 16)

The method according to claim 16, wherein the specific object defines data returned by a content directory service from a browsing action or a searching action.
