# US 2020/0267250 A1 · Mobile terminal and method for controlling the same

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0267250 A1
- Document ID: US20200267250A1
- Status: Published application
- Kind: A1
- Application number: 16/761,796
- Filed: 2018-09-05
- Published: 2020-08-20
- Earliest claimed: 2018-09-05
- Assignees: LG Electronics Inc.
- Applicants: LG Electronics Inc.
- Inventors: Jumin CHI; Jina KIM; Jinyung PARK; Seongmin HWANG
- Web page: https://patentgrep.com/patent/US20200267250A1

## CPC

- G06F 3/0482: Interaction with lists of selectable items, e.g. menus
- G06F 1/1626: {with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]}
- G06F 1/1643: {the display being associated to a digitizer, e.g. laptops that can be used as penpads (details related to the relative motion of the display enclosure with respect to the body enclosure, e.g. to move between laptop and tablet PC configuration G06F1/1615)}
- G06F 1/1686: {the I/O peripheral being an integrated camera}
- G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
- G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence)
- G06F 3/04847: Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
- G06F 3/04883: for inputting data by handwriting, e.g. gesture or text
- G06F 3/04886: by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
- H04M 1/72409: by interfacing with external accessories (hands-free H04M1/60)
- H04M 1/72415: for remote control of appliances
- H04M 1/72466: with selection means, e.g. keys, having functions defined by the mode or the status of the device
- H04N 23/632: {for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters}
- G06F 2203/04804: Transparency, e.g. transparent or translucent windows
- H04M 1/724094: {Interfacing with a device worn on the user's body to provide access to telephonic functionalities, e.g. accepting a call, reading or composing a message}
- H04M 1/72412: using two-way short-range wireless interfaces
- H04M 2250/22: including a touch pad, a touch sensor or a touch detector
- H04M 2250/52: including functional features of a camera
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A mobile terminal is disclosed to solve a problem of a control method of the related art for controlling an external device, which is not intuitive and inconvenient. The mobile terminal comprises a camera configured to receive a preview image including at least one external device; a display unit configured to display the preview image; and a controller operably coupled with the camera and the display unit, and configured to control the display unit to display a control menu for the external device included in the preview image, and generate a control signal corresponding to a user input signal for the control menu in response to the user input signal.

## Claims

### Claim 1

A mobile terminal comprising:
a camera configured to receive a preview image including at least one external device;
a display unit configured to display the preview image; and
a controller operably coupled with the camera and the display unit, and configured to:
control the display unit to display a control menu for the external device included in the preview image, and
generate a control signal corresponding to a user input signal for the control menu in response to the user input signal.

### Claim 2 (depends on 1)

The mobile terminal of claim 1, wherein the control signal includes a driving signal for the external device.

### Claim 3 (depends on 1)

The mobile terminal of claim 1, further comprising a wireless communication module, and wherein the controller is further configured to transmit the generated control signal to the external device or a network to which the external device is connected.

### Claim 4 (depends on 1)

The mobile terminal of claim 1, further comprising a wireless communication module pairing with the external device, and wherein the controller is further configured to control the wireless communication module to perform pairing with the external device when the external device is located in the preview image in a state that the mobile terminal and the external device are not paired with each other.

### Claim 5 (depends on 1)

The mobile terminal of claim 1, wherein the display unit includes a touch screen, and wherein when a user input of the user input signal corresponds to a double-tap touch input for the control menu, the control signal corresponds to an on/off function for an operation of the external device.

### Claim 6 (depends on 1)

The mobile terminal of claim 1, wherein the external device included in the preview image includes an external device displayed on the preview image or an external device located in a viewing angle of the preview image.

### Claim 7 (depends on 1)

The mobile terminal of claim 1, wherein the external device included in the preview image corresponds to a plurality of external devices, and wherein the controller is further configured to display each of a plurality of indicators corresponding to the plurality of external devices on the display unit.

### Claim 8 (depends on 7)

The mobile terminal of claim 7, wherein each of the plurality of indicators is output from the mobile terminal by being aligned in the order near the plurality of external devices.

### Claim 9 (depends on 1)

The mobile terminal of claim 1, wherein the controller is further configured to:
control the display unit to display an always-on screen when the mobile terminal is in a sleep state, wherein the always-on screen includes a non-display area, a first information display area displaying information on the mobile terminal, and a second information display area displaying information on an external device connected with the mobile terminal or capable of being connected with the mobile terminal, and
generate a control signal for controlling the external device in response to a preset user input signal for the second information output area.

### Claim 10 (depends on 9)

The mobile terminal of claim 9, wherein the display unit includes a touch screen, and wherein the controller is further configured to:
switch the always-on screen to a home screen of the mobile terminal in response to a knock-on touch input for the non-display area or the first information display area, and
generate the control signal for controlling the external device in response to a knock-on touch input for the second information display area.

### Claim 11 (depends on 9)

The mobile terminal of claim 9, wherein the external device includes is at least one external device which is within a preset range from the mobile terminal.

### Claim 12 (depends on 9)

The mobile terminal of claim 9, wherein the external device includes an external device existing within a camera viewing angle of the mobile terminal.

### Claim 13 (depends on 9)

The mobile terminal of claim 9, wherein the external device includes at least one external device registered in a specific network.

### Claim 14

A method for controlling a mobile terminal, the method comprising:
receiving, via a camera, a preview image including at least one external device;
displaying, on a display unit, the preview image;
displaying, on the display unit, a control menu for the external device included in the preview image; and
generating a control signal corresponding to a user input signal for the control menu in response to the user input signal.

### Claim 15 (depends on 14)

The method of claim 14, further comprising the steps of performing, via a wireless communication unit, pairing with the external device when the external device is located in the preview image in a state that the mobile terminal and the external device are not paired with each other.

### Claim 16 (depends on 14)

The method of claim 14, wherein the display unit includes a touch screen, and wherein when a user input of the user input signal corresponds to a double-tap touch input for the control menu, the control signal corresponds to an on/off function for an operation of the external device.

### Claim 17 (depends on 14)

The method of claim 14, wherein the external device included in the preview image corresponds to a plurality of external devices, wherein each of a plurality of indicators corresponding to the plurality of external devices is displayed on the display unit, and wherein each of the plurality of indicators is output from the mobile terminal by being aligned in the order near the plurality of external devices.

### Claim 18 (depends on 14)

The method of claim 14, further comprising the steps of:
displaying, on the display unit, an always-on screen when the mobile terminal is in a sleep state, wherein the always-on screen includes a non-display area, a first information display area displaying information on the mobile terminal, and a second information display area displaying information on an external device connected with the mobile terminal or capable of being connected with the mobile terminal; and
generating a control signal for controlling the external device in response to a preset user input signal for the second information output area.

### Claim 19 (depends on 18)

The method of claim 18, wherein the display unit includes a touch screen, and further comprising the steps of:
switching the always-on screen to a home screen of the mobile terminal in response to a knock-on touch input for the non-display area or the first information display area; and
generating the control signal for controlling the external device in response to a knock-on touch input for the second information display area.

### Claim 20 (depends on 18)

The mobile terminal of claim 18, wherein the external device includes at least one of at least one external device which is within a preset range from the mobile terminal, an external device existing within a camera viewing angle of the mobile terminal, or at least one external device registered in a specific network.
