# US 10,321,090 B2 · Terminal device and controlling method thereof

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,321,090 B2
- Document ID: US10321090B2
- Status: Granted
- Kind: B2
- Application number: 15/170,144
- Filed: 2016-06-01
- Published: 2017-01-26
- Granted: 2019-06-11
- Earliest claimed: 2015-07-20
- Assignees: LG Electronics Inc.
- Applicants: LG Electronics Inc.
- Inventors: Yunmi Kwon; Kiseon Lee
- Web page: https://patentgrep.com/patent/US10321090B2

## CPC

- H04N 5/9202: {the additional signal being a sound signal (H04N5/9155 takes precedence)}
- G03B 31/06: in which sound track is associated with successively-shown still pictures
- G11B 27/10: Indexing; Addressing; Timing or synchronising; Measuring tape travel
- H04M 1/72403: with means for local support of applications that increase the functionality
- H04N 1/00: Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
- H04N 5/772: {the recording apparatus and the television camera being placed in the same enclosure}
- H04N 7/188: {Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position (signal generation from motion picture films H04N5/253)}
- H04N 9/8211: {the additional signal being a sound signal (H04N9/835 takes precedence)}
- H04N 23/632: {for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters}
- H04M 2250/52: including functional features of a camera
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G03B: APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR (optical parts of such apparatus G02B; photosensitive materials or processes for photographic purposes G03C; apparatus for processing exposed photographic materials G03D)
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)
- H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08)

## Abstract

A terminal device and controlling method thereof are disclosed, by which sound or video on taking a photo can be saved as background data. The present invention includes a camera unit configured to capture an image, a memory configured to store the captured image, an output unit configured to display the captured image, and a controller controlling the camera unit, the memory and the output unit, the controller, if a command of driving the camera unit is inputted, controlling the camera unit to run a preview, record a sound and/or shoot a video, the controller temporarily saving the sound or the video, the controller, if a 2nd image is captured, controlling the memory to store the sound or the video in a manner of linking the sound or the video to at least one of the image or the second image.

## Claims

### Claim 1

A mobile terminal comprising:
a camera unit configured to capture a first image;
a memory configured to store the captured first image;
an output unit configured to display the captured first image; and
a controller configured to control the camera unit, the memory and the output unit,
wherein the controller is further configured to:
in response to a command of driving the camera unit is being inputted, cause the camera unit to run a preview, record a sound and shoot a video, save temporarily the sound and the video,
in response to a second image is being captured, cause the memory to store the sound and the video in a manner of linking the sound and the video to at least one of the first image and the second image,
when an object appearing in a plurality of images, including the second image and a number of images captured thereafter, undergoes a change, selected from a group consisting of an object movement over a preset rate, an object addition and an object disappearance, cause the memory to store the plurality of images in a manner of linking the plurality of images to the video,
configure the plurality of images including the second image and at least one images captured thereafter into a single group,
in response to one of the plurality of images is being displayed and the displayed image is being maintained over a preset time, play the plurality of images as a slide show, and
in response to a last image in the single group is being displayed, cause the output unit to display a menu for selecting at least one different group of images from the plurality of images included in the single group,
wherein each of the images in the different group include a common object.

### Claim 2 (depends on 1)

The mobile terminal of claim 1, wherein when the object appearing in the plurality of images, including the second image and the number of images captured thereafter, does not undergo the change, the controller is further configured to cause the memory to store the plurality of images in a manner of linking the plurality of images to the sound.

### Claim 3 (depends on 1)

The mobile terminal of claim 1, wherein when an object in the captured first image changes relative to the object in a previously captured first image, the controller is further configured to:
stop the recording of the sound and the shooting of the video,
record a new sound and shoots a new video, and
temporarily store the new sound and the new video in the memory.

### Claim 4 (depends on 1)

The mobile terminal of claim 1, wherein the controller is further configured to remove noise from the sound.

### Claim 5 (depends on 1)

The mobile terminal of claim 1, wherein the controller is further configured to remove a voice from the sound when the voice fails to match call voice data of a user of a terminal device.

### Claim 6 (depends on 1)

The mobile terminal of claim 1, wherein when a video linked image is selected, the controller is further configured to cause the output unit to display a button for playing the video together with the video linked image.

### Claim 7 (depends on 1)

The mobile terminal of claim 1, wherein when a sound linked image is selected, the controller is further configured to:
display the sound linked image, and
play the sound.

### Claim 8 (depends on 7)

The mobile terminal of claim 7, wherein the controller is further configured to adjust a volume of the sound by recognizing a user's voice.

### Claim 9 (depends on 1)

The mobile terminal of claim 1, wherein if a sound linked image is selected in a vibration mode, the controller is further configured to display a text of voice contained in the sound without outputting the sound.

### Claim 10 (depends on 1)

The mobile terminal of claim 1, wherein the controller is further configured to adjust a play time interval of the slide show based on at least one selected from the group consisting of a presence or non-presence of the sound, a presence or non-presence of an object movement over a preset rate, and shot intervals among the plurality of the images.

### Claim 11 (depends on 1)

The mobile terminal of claim 1, wherein when a last image in the single group is displayed, the controller controls the output unit to display a menu for selecting at least one different group of images from the plurality of images included in the single group, and wherein each of the images in the different group include a common object.

### Claim 12 (depends on 1)

The mobile terminal of claim 1, wherein when the plurality of images of the single group are displayed as thumbnails and a start image and an end image are selected from the plurality of images, the controller is further configured to cause the output unit to display a slide show including the start image and the end image and any images there between.

### Claim 13 (depends on 1)

The mobile terminal of claim 1, wherein when the sound or video linked image is deleted, the controller is further configured to cause the output unit to display a menu for deleting the sound or video linked to the deleted image.

### Claim 14 (depends on 1)

The mobile terminal of claim 1, wherein the controller is further configured to cause the memory to store the sound in a manner of linking the sound to the first image captured thereafter by including the second image.

### Claim 15 (depends on 1)

The mobile terminal of claim 1, wherein the controller is further configured to cause the memory to store the video in a manner of linking the video to the first image captured thereafter by including the second image.

### Claim 16

A method of controlling a terminal device comprising the steps of:
when a command of capturing image inputted, running a preview, recording a sound and shooting a video and temporarily saving the sound and the video;
capturing a first image;
in response to a second image is being captured, saving the sound and the video in a manner of linking the sound and the video to at least one of the first image and the second image;
when an object appearing in a plurality of images, including the second image and a number of images captured thereafter, undergoes a change, selected from a group consisting of an object movement over a preset rate, an object addition and an object disappearance, causing the memory to store the plurality of images in a manner of linking the plurality of images to the video;
configuring the plurality of images including the second image and at least one images captured thereafter into a single group;
in response to one of the plurality of images is being displayed and the displayed image is being maintained over a preset time, playing the plurality of images as a slide show, and
in response to a last image in the single group is being displayed, causing an output unit to display a menu for selecting at least one different group of images from the plurality of images included in the single group,
wherein each of the images in the different group include a common object.