Mobile terminal and control method thereof
AssigneeLG Electronics Inc.
InventorsTaehoon Cho, Sanghyun Eim
Life of this patent
Estimating the term…
Abstract
A mobile terminal includes a wireless communication unit communicating with a point-of-sales (POS) terminal positioned nearby, and a controller performing, when a payment event regarding goods occurs, payment regarding the goods together with the POS terminal using an image received from the outside, wherein when a facial image corresponding to the image corresponds to a previously registered user, the controller approves payment regarding the goods and generates evaluation information regarding the goods using the facial image included in the received image.
Claims11
A mobile terminal comprising:
- a display;
- a camera capturing images;
- a database;
- a wireless communication unit communicating with a wireless communication module located in a store or a point-of-sale (POS) terminal in the store;
- and
- a controller configured to:
- receive a facial image of a user related to goods from the POS terminal when a payment is made between the mobile terminal and the POS terminal;
- receive a facial image of the user related to goods from the wireless communication module located in the store when the user of the mobile terminal leaves the store without purchasing the goods;
- analyze the facial image received from the POS terminal or the wireless communication module using a face analysis algorithm to obtain facial expression information corresponding to the facial image received from the POS terminal or the wireless communication module according to the analysis;
- generate goods information by associating the obtained facial expression information with other information related to the goods, and storing the goods information in the database;
- search for goods information stored in the database by analyzing a facial image of the user received via the camera based on the face analysis algorithm in order to extract facial expression information corresponding to the facial image of the user received via the camera and feeling information, the feeling information extracted based on the facial expression information corresponding to the facial image received via the camera;
- and
- cause the display to output the searched goods information stored in the database corresponding to at least the extracted facial expression information or feeling information,
- wherein the analyzing the facial image received via the camera comprises:
- causing the display to output an analysis result for the user to confirm whether the facial expression information corresponding to the facial image received via the camera corresponds to the analysis result when the analysis of the facial image received via the camera is complete;
- causing the display to output other feeling items according to the user's response with regard to confirmation;
- and
- matching a feeling corresponding to a feeling item selected by the user from the other feeling items to the facial expression information corresponding to the facial image received via the camera based on the facial image received via the camera.
A method for controlling a mobile terminal, the method comprising:
- receiving a facial image of a user related to goods, from a point-of-sale (POS) terminal when a payment is made between the mobile terminal and the POS terminal;
- receiving a facial image from a wireless communication module located in a store when the user of the mobile terminal leaves the store without purchasing the goods;
- analyzing the facial image received from the POS terminal or the wireless communication module using a face analysis algorithm to obtain facial expression information corresponding to the facial image received from the POS terminal or the wireless communication module according to the analysis;
- generating goods information by associating the obtained facial expression information with other information related to the goods and storing the goods information in the database;
- searching for goods information stored in the database by analyzing a facial image of the user received via a camera of the mobile terminal based on the face analysis algorithm in order to extract facial expression information corresponding to the facial image of the user received via the camera and feeling information, the feeling information extracted based on the facial expression information corresponding to the facial image received via the camera;
- and outputting, via a display of the mobile terminal, the searched goods information stored in the database corresponding to at least the extracted facial expression information or feeling information,
- wherein the analyzing the facial imago received via the camera comprises:
- outputting, via the display, an analysis result for the user to confirm whether the facial expression information corresponding to the facial image received via the camera corresponds to the analysis result when the analysis of the facial image received via the camera is complete;
- outputting, via the display, other feeling items according to the user's response with regard to confirmation;
- and
- matching a feeling corresponding to a feeling item selected by the user from the other feeling items to the facial expression information corresponding to the facial image received via the camera based on the facial image received via the camera.
Dependencies are inferred from the claim text.