# US 10,375,219 B2 · Mobile terminal releasing a locked state and method for controlling the same > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,375,219 B2 - Document ID: US10375219B2 - Status: Granted - Kind: B2 - Application number: 15/920,014 - Filed: 2018-03-13 - Published: 2018-12-20 - Granted: 2019-08-06 - Earliest claimed: 2017-06-15 - Assignees: LG Electronics Inc. - Applicants: LG Electronics Inc. - Inventors: Byoungeul Kim; Youngchang Kang; Yoonwoo Lee; Jungwhan Kim - Web page: https://patentgrep.com/patent/US10375219B2 ## CPC - H04M 1/67: by electronic means - G06F 21/32: using biometric data, e.g. fingerprints, iris scans or voiceprints - G06V 40/1365: {Matching; Classification} - G06V 40/161: {Detection; Localisation; Normalisation} - G06V 40/166: {using acquisition arrangements} - G06V 40/172: {Classification, e.g. identification} - G06V 40/174: {Facial expression recognition} - H04M 1/72454: according to context-related or environment-related conditions - H04M 2250/12: including a sensor for measuring a physical value, e.g. temperature or motion - H04M 2250/22: including a touch pad, a touch sensor or a touch detector - H04M 2250/52: including functional features of a camera - H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08) - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract Disclosed are a mobile terminal and a method for controlling the same. The mobile terminal includes: a terminal body; a camera; a sensor configured to sense a raising gesture of the terminal body; and a controller configured to: activate the camera in response to the raising gesture; detect a face within an image received via the camera; and release a locked state of the mobile terminal based on a face recognition of the detected face. ## Claims ### Claim 1 A mobile terminal, comprising: a terminal body; a camera; a sensor configured to sense a raising gesture of the terminal body; a touch screen; and a grip sensor provided on a side surface of the terminal body; a controller configured to: determine an occurrence of the raising gesture when a gripped state of the terminal body by a user's hand is sensed by the grip sensor and a degree of a touch input received via the touch screen exceeds a reference pressure; activate the camera in response to the determination of the raising gesture; detect a face within an image received via the camera; perform fingerprint recognition, via a fingerprint sensor of the mobile terminal, based on a second touch input to the touch screen while the face is being detected within the image received via the camera; and release a locked state of the mobile terminal based on successful fingerprint recognition in addition to successful face recognition of the detected face, wherein if the face detection is unsuccessful for at least a predetermined time, the controller is further configured to perform a command for updating a notification, control the touch screen to display information regarding the updated notification, and to convert the mobile terminal into a sleep mode after the predetermined time lapses. ### Claim 2 (depends on 1) The mobile terminal of claim 1, wherein: the raising gesture corresponds to a movement of the terminal body which exceeds a threshold angle change and exceeds a threshold distance change within a reference time; the controller is further configured to change the mobile terminal from a first mode to a second mode in response to the determination of the raising gesture; and the face recognition is performed while the mobile terminal is in the second mode. ### Claim 3 (depends on 1) The mobile terminal of claim 1, wherein the controller is further configured to control the touch screen to display a lock screen when the face is detected within the image received via the camera. ### Claim 4 (depends on 3) The mobile terminal of claim 3, wherein the controller is further configured to deactivate the camera when no face is detected within the image received via the camera within a preset time; and control the touch screen to display an updated notification related to an event at the mobile terminal. ### Claim 5 (depends on 3) The mobile terminal of claim 3, wherein: an indicator indicating that the face recognition is being performed is displayed on the lock screen; and the lock screen is changed to a lock release screen when the face recognition is successful. ### Claim 6 (depends on 5) The mobile terminal of claim 5, wherein: a notification indicating that the face recognition is successful is displayed on the lock release screen; and the controller is further configured to control the touch screen to display a lock release state setting menu in response to a touch input to the displayed notification. ### Claim 7 (depends on 5) The mobile terminal of claim 5, wherein the lock release screen is an execution screen of a preset application. ### Claim 8 (depends on 1) The mobile terminal of claim 1, wherein the controller is further configured to: recognize a facial expression of the detected face during the face recognition of the detected face; and control the touch screen to display an execution screen of a particular application mapped with the recognized facial expression when the locked state is released. ### Claim 9 (depends on 1) The mobile terminal of claim 1, wherein the controller is further configured to: recognize a facial expression of the detected face during the face recognition of the detected face; identify an emotion associated with a change in the recognized facial expression; and control the touch screen to display an image mapped with the identified emotion when the locked state is released. ### Claim 10 (depends on 1) The mobile terminal of claim 1, wherein the controller is further configured to: determine biometric information of a user based on the detected face; and store the biometric information and control the touch screen to display a lock release screen when the locked state is released, wherein information related to the biometric information is displayed on the lock release screen for a predetermined time. ### Claim 11 (depends on 1) The mobile terminal of claim 1, wherein the controller is further configured to control the touch screen to display: feedback information on a lock screen when the face recognition of the detected face is unsuccessful; and a screen related to another authentication method using the lock screen. ### Claim 12 (depends on 1) The mobile terminal of claim 1, wherein the raising gesture is sensed following an event at the mobile terminal, and the controller is further configured to: recognize a face gesture after the face recognition of the detected face is successful; and execute a particular action related to the event, wherein the particular action is mapped to the recognized face gesture. ### Claim 13 (depends on 1) The mobile terminal of claim 1, wherein the raising gesture is sensed following an event at the mobile terminal, and the controller is further configured to: cease output of notifications related to the event when a lowering gesture of the terminal body is sensed after the face recognition of the detected face is successful. ### Claim 14 A mobile terminal, comprising: a terminal body; a touch screen; a grip sensor provided on a side surface of the terminal body; a camera configured to maintain a constant activated state in a low-power mode; a sensor configured to sense a raising gesture of the terminal body, wherein the raising gesture corresponds to a movement of the mobile terminal which exceeds a threshold angle change and exceeds a threshold distance change within a reference time; and a controller configured to: determine an occurrence of the raising gesture when a gripped state of the terminal body by a user's hand is sensed by the grip sensor and a degree of a touch input received via the touch screen exceeds a reference pressure; detect a face within an image received via the camera in response to the determination of the raising gesture; control the touch screen to display a lock screen when the face is detected within the image received via the camera; perform fingerprint recognition, via a fingerprint sensor of the mobile terminal, based on a second touch input to the touch screen while the face is being detected within the image received via the camera: and release a locked state of the mobile terminal based on the fingerprint recognition in addition to face recognition of the detected face, wherein if the face recognition is unsuccessful for at least a predetermined time, the controller is further configured to perform a command for updating a notification, control the touch screen to display information regarding the updated notification, and to convert the mobile terminal into a sleep mode after the predetermined time lapses. ### Claim 15 (depends on 14) The mobile terminal of claim 14, wherein: an indicator indicating that the face recognition is being performed is displayed on the lock screen; and the lock screen is changed to a lock release screen when the face recognition is successful.