# US 10,375,380 B2 · Mobile terminal and operating method thereof

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,375,380 B2
- Document ID: US10375380B2
- Status: Granted
- Kind: B2
- Application number: 15/433,205
- Filed: 2017-02-15
- Published: 2018-02-15
- Granted: 2019-08-06
- Earliest claimed: 2016-08-11
- Assignees: LG Electronics Inc.
- Applicants: LG Electronics Inc.
- Inventors: Jisun Lee; Suyoung Lee
- Web page: https://patentgrep.com/patent/US10375380B2

## CPC

- H04N 13/341: using temporal multiplexing
- G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F 3/04883: for inputting data by handwriting, e.g. gesture or text
- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- H04M 1/72412: using two-way short-range wireless interfaces
- H04N 1/00129: {with a display device, e.g. CRT or LCD monitor (with a television apparatus H04N1/00283; arrangements for control of display devices G09G)}
- H04N 7/183: {for receiving images from a single remote source}
- H04N 13/194: Transmission of image signals
- H04N 13/204: using stereoscopic image cameras (stereoscopic photography G03B35/00)
- H04N 23/62: Control of parameters via user interfaces
- H04N 23/63: by using electronic viewfinders
- H04N 23/698: for achieving an enlarged field of view, e.g. panoramic image capture
- G06F 1/163: {Wearable computers, e.g. on a belt}
- G06F 3/0485: Scrolling or panning
- G06F 2203/04806: Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
- H04M 1/2471: {Configurable and interactive telephone terminals with subscriber controlled features modifications, e.g. with ADSI capability [Analog Display Services Interface] (systems providing special services or facilities to subscribers H04M3/42; administration or customization of services H04M3/42136; by downloading data to substation equipment H04M3/42178)}
- H04M 2250/04: including near field communication means, e.g. RFID
- H04M 2250/22: including a touch pad, a touch sensor or a touch detector
- H04M 2250/52: including functional features of a camera
- H04N 23/66: Remote control of cameras or camera parts, e.g. by remote control devices
- H04N 2201/0055: By radio
- H04N 2201/006: Using near field communication, e.g. an inductive loop
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08)

## Abstract

A mobile terminal including a wireless communication processor configured to receive an omnidirectional image from a photographing device; a display; and a controller configured to display a first image on a main screen of the display corresponding to a first partial image of the omnidirectional image, and display a second image corresponding to a second partial image of the omnidirectional image on a sub-screen, the second image having an object with an attribute similar to an object included in the first image.

## Claims

### Claim 1

A mobile terminal comprising:
a wireless communication processor configured to receive an omnidirectional image from a photographing device;
a microphone configured to acquire a sound input;
a display; and
a controller configured to:
display a first image on a main screen of the display corresponding to a first partial image of the omnidirectional image, and
display a second image corresponding to a second partial image of the omnidirectional image on a sub-screen, the second image having an object with an attribute similar to an object included in the first image,
wherein the controller is further configured to:
display a third image corresponding to a third partial image of the omnidirectional image on the sub-screen, when an intensity of the acquired sound is equal to or greater than a first reference intensity,
wherein the third image corresponds to a point at which the sound is generated, and
wherein, when the intensity of the acquired sound is equal to or greater than a second reference intensity, the controller is further configured to increase the size of the sub-screen and decrease the size of the main screen.

### Claim 2 (depends on 1)

The mobile terminal of claim 1, wherein the controller is further configured to:
receive a change request of the first image displayed on the main screen,
change the first image to the third image corresponding to the third partial image of the omnidirectional image in response to the received change request of the first image, and
change the second image to a fourth image corresponding to a fourth partial image of the omnidirectional image, the fourth image having an object with an attribute similar to an object included in the third image.

### Claim 3 (depends on 2)

The mobile terminal of claim 2, wherein the controller is further configured to:
receive a change request of the second image displayed on the sub-screen, and
change the second image to a fifth image corresponding to a fifth partial image of the omnidirectional image, in response to the received change request of the second image, the fifth image having an object with an attribute similar to the object in the first image.

### Claim 4 (depends on 3)

The mobile terminal of claim 3, wherein the controller is further configured to continue displaying the first image on the main screen when changing the second image displayed on the sub-screen to the fifth image.

### Claim 5 (depends on 1)

The mobile terminal of claim 1, wherein the object of the first image includes information at least one of a person and a thing included in the first image, and a pose of the person.

### Claim 6 (depends on 5)

The mobile terminal of claim 5, wherein the second image includes another person having a pose similar to that of the person included in the first image.

### Claim 7 (depends on 1)

The mobile terminal of claim 1, wherein, when a touch input signal having a preset intensity or less is received on the main screen, the controller is further configured to display the second image on the sub-screen.

### Claim 8 (depends on 1)

The mobile terminal of claim 1, further comprising:
a memory configured to store a state in which the first image and the second image are respectively displayed on the main screen and the sub-screen.

### Claim 9 (depends on 8)

The mobile terminal of claim 8, wherein the controller is further configured to store the state in which the first image and the second image are respectively displayed on the main screen and the sub-screen, at a point of time when a photographing button provided in the photographing device is selected.

### Claim 10 (depends on 1)

The mobile terminal of claim 1, wherein the controller is further configured to display the first image and the second image on a preview screen as a camera application is executed.

### Claim 11 (depends on 1)

The mobile terminal of claim 1, wherein a size of the main screen is equal to or greater than a half of a size of an entire screen of the display unit, and a size of the sub-screen is less than the half of the size of the entire screen of the display unit.

### Claim 12

A method of controlling a mobile terminal, the method comprising:
receiving, via a wireless communication processor, an omnidirectional image from a photographing device;
displaying, via a display of the mobile terminal, a first image on a main screen of the display corresponding to a first partial image of the omnidirectional image; and
displaying, via the display, a second image corresponding to a second partial image of the omnidirectional image on a sub-screen, the second image having an object with an attribute similar to an object included in the first image,
wherein the method further comprises:
acquiring, via a microphone of the mobile terminal, a sound input;
displaying, via a display of the mobile terminal, a third image corresponding to a third partial image of the omnidirectional image on the sub-screen, when an intensity of the acquired sound is equal to or greater than a first reference intensity, wherein the third image corresponds to a point at which the sound is generated; and
when the intensity of the acquired sound is equal to or greater than a second reference intensity, increasing the size of the sub-screen and decrease the size of the main screen.

### Claim 13 (depends on 12)

The method of claim 12, further comprising:
receiving, via a controller of the mobile terminal, a change request of the first image displayed on the main screen;
changing, via the controller, the first image to the third image corresponding to the third partial image of the omnidirectional image in response to the received change request of the first image; and
changing, via the controller, the second image to a fourth image corresponding to a fourth partial image of the omnidirectional image, the fourth image having an object with an attribute similar to an object included in the third image.

### Claim 14 (depends on 13)

The method of claim 13, further comprising:
receiving, via the controller, a change request of the second image displayed on the sub-screen; and
changing, via the controller, the second image to a fifth image corresponding to a fifth partial image of the omnidirectional image, in response to the received change request of the second image, the fifth image having an object with an attribute similar to the object in the first image.

### Claim 15 (depends on 14)

The method of claim 14, further comprising:
continue displaying the first image on the main screen when changing the second image displayed on the sub-screen to the fifth image.

### Claim 16 (depends on 12)

The method of claim 12, wherein the object of the first image includes information at least one of a person and a thing included in the first image, and a pose of the person.

### Claim 17 (depends on 16)

The method of claim 16, wherein the second image includes another person having a pose similar to that of the person included in the first image.

### Claim 18 (depends on 12)

The method of claim 12, wherein, when a touch input signal having a preset intensity or less is received on the main screen, the method further comprises displaying the second image on the sub-screen.