# US 10,120,992 B2 · Mobile terminal and method for controlling the same

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,120,992 B2
- Document ID: US10120992B2
- Status: Granted
- Kind: B2
- Application number: 15/837,723
- Filed: 2017-12-11
- Published: 2018-06-14
- Granted: 2018-11-06
- Earliest claimed: 2016-12-13
- Assignees: LG Electronics Inc.
- Applicants: LG Electronics Inc.
- Inventors: Hongjo Shim; Mihyun Park; Hyunok Lee
- Web page: https://patentgrep.com/patent/US10120992B2

## CPC

- G06F 21/32: using biometric data, e.g. fingerprints, iris scans or voiceprints
- G06T 7/20: Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51)
- G06T 7/73: using feature-based methods
- G06V 10/17: {using hand-held instruments}
- G06V 40/166: {using acquisition arrangements}
- G06V 40/19: Sensors therefor
- G06V 40/20: Movements or behaviour, e.g. gesture recognition (recognition of facial expressions G06V40/16)
- G06V 40/23: {Recognition of whole body movements, e.g. for sport training}
- H04M 1/02: Constructional features of telephone sets
- H04M 1/72454: according to context-related or environment-related conditions
- H04M 1/724631: {by limiting the access to the user interface, e.g. locking a touch-screen or a keypad}
- H04M 1/725: Cordless telephones (user interfaces specially adapted therefor H04M1/724)
- H04N 23/20: for generating image signals from infrared radiation only
- H04N 23/611: where the recognised objects include parts of the human body
- H04N 23/633: {for displaying additional information relating to control or operation of the camera}
- H04W 12/065: Continuous authentication
- H04W 12/068: {using credential vaults, e.g. password manager applications or one time password [OTP] applications}
- H04M 2250/52: including functional features of a camera
- H04N 23/632: {for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters}
- H04N 23/69: Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
- Y02D 30/70: in wireless communication networks
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)
- Y02D: CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE

## Abstract

A mobile terminal including a main body; a receiver disposed on the main body; an infrared unit disposed on the main body at a first distance from the receiver in a first direction and configured to output infrared rays; an iris recognition sensor disposed on the main body at a second distance from the receiver in a second direction opposite the first direction and configured to receive infrared rays reflected from a subject; and a low power image sensor disposed on the main body at a third distance from the receiver in the second direction and having a focal point matching a focal point of the iris recognition sensor, wherein the third distance is greater than the second distance.

## Claims

### Claim 1

A mobile terminal, comprising:
a main body;
a display disposed on the main body;
a receiver disposed on the main body and located adjacent to the display;
an infrared unit disposed on the main body at a first distance from the receiver in a first direction and configured to output infrared rays;
an iris recognition sensor disposed on the main body at a second distance from the receiver in a second direction opposite the first direction and configured to receive infrared rays reflected from a subject;
a low power image sensor disposed on the main body at a third distance from the receiver in the second direction and having a focal point matching a focal point of the iris recognition sensor, wherein the third distance is greater than the second distance; and
a controller configured to:
detect an occurrence of an event while the display is in an inactive state, wherein when the display is the inactive state, a backlight of the display is off such that visual information is not displayed,
determine whether or not a face image is detected through the low power image sensor in response to the detection of the occurrence of the event,
control one area of the display from the inactive state to an active state when the face image is detected, and
display specific information related to the event on the one area of the display in the active state,
wherein when the detected face image corresponds to the side face, the specific information is summary information related to the event, and
wherein when the detected face image corresponds to a front face, the specific information is detail information related to the event.

### Claim 2 (depends on 1)

The terminal of claim 1, wherein the low power image sensor is configured to capture the face image of the subject.

### Claim 3 (depends on 2)

The terminal of claim 2, wherein the controller is further configured to lower a volume of a ringtone based on the face image detected through the low power image sensor when the ringtone is output through the receiver in response to a reception of a call signal.

### Claim 4 (depends on 1)

The terminal of claim 1, wherein the first distance and the second distance are equal to each other.

### Claim 5 (depends on 1)

The terminal of claim 1, further comprising:
a front camera disposed on the main body at a fourth distance from the receiver in the first direction and configured to capture an image of the subject,
wherein the fourth distance is greater than the first distance.

### Claim 6 (depends on 5)

The terminal of claim 5, wherein the front camera has a same focal point as the focal point of the low power image sensor.

### Claim 7 (depends on 1)

The terminal of claim 1, wherein the controller is further configured to:
detect the face image through the low power image sensor, and
display guide information for guiding the subject so the face image of the subject is within a field of view of the iris recognition sensor when the detected face image is not present within the field of view of the iris recognition sensor.

### Claim 8 (depends on 1)

The terminal of claim 1, wherein the controller is further configured to:
display authentication screen information on the display,
detect a gaze directed to the authentication screen information through the low power image sensor, and
execute iris recognition through the iris recognition sensor when the gaze directed to the authentication screen information is detected.

### Claim 9 (depends on 1)

The terminal of claim 1, wherein the controller is further configured not to display the specific information related to the event when the face image is not detected through the low power image sensor.

### Claim 10 (depends on 1)

The terminal of claim 1, wherein the controller is further configured to:
detect gaze information based on the face image detected through the low power image sensor, and
determine whether or not to display the specific information based on the detected gaze information.

### Claim 11 (depends on 1)

The terminal of claim 1, wherein the controller is further configured to:
switch the display from the inactive state to the active state when the face image is continuously detected through the low power image sensor.

### Claim 12 (depends on 1)

The terminal of claim 1, further comprising:
a camera; and
a motion detecting sensor configured to detect a movement of the main body,
wherein the controller is further configured to control the camera to capture the subject when the subject existing at a surrounding area of the main body is detected using the infrared rays and the movement of the main body corresponds to a preset motion.

### Claim 13 (depends on 1)

The terminal of claim 1, further comprising:
a camera having a narrower field of view than the low power image sensor,
wherein the controller is further configured to:
control the camera to capture a face image for the face recognition based on the face image detected through the low power image sensor.

### Claim 14 (depends on 13)

The terminal of claim 13, wherein the controller is further configured to control the camera to capture the face image for the face recognition when a part of the face image detected through the lower power image sensor is present within the field of view of the camera.

### Claim 15 (depends on 13)

The terminal of claim 13, wherein the controller is further configured to display guide information to allow the face recognition when a part of the face image detected through the lower power image sensor is not present within the field of view of the camera.

### Claim 16 (depends on 13)

The terminal of claim 13, wherein the controller is further configured to:
control the camera to capture the face image for the face recognition when the face image detected through the low power image sensor corresponds to a front face, and
display guide information on the display to allow the face recognition when the face image detected through the low power image sensor does not correspond to the front face.

### Claim 17

A method for controlling a mobile terminal, the method comprising:
detecting an occurrence of an event while a display of the mobile terminal is in an inactive state, wherein when the display is the inactive state, a backlight of the display is off such that visual information is not displayed;
determining whether or not a face image is detected through a low power image sensor of the mobile terminal in response to the detection of the occurrence of the event;
controlling one area of the display from the inactive state to an active state when the face image is detected; and
displaying specific information related to the event on the one area of the display in the active state,
wherein when the detected face image corresponds to the side face, the specific information is summary information related to the event; and
wherein when the detected face image corresponds to a front face, the specific information is detail information related to the event.