# US 2014/0192229 A1 · Apparatus and method for providing user's emotional information in electronic device > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2014/0192229 A1 - Document ID: US20140192229A1 - Status: Published application - Kind: A1 - Application number: 14/147,842 - Filed: 2014-01-06 - Published: 2014-07-10 - Earliest claimed: 2013-01-04 - Assignees: Samsung Electronics Co., Ltd. - Applicants: Samsung Electronics Co., Ltd. - Inventors: Dae-Sung KIM; So-Ra KIM; Hyun-Kyoung KIM; Hang-Kyu PARK; Seung-Kyung LIM - Web page: https://patentgrep.com/patent/US20140192229A1 ## CPC - H04N 1/00339: {with an electronic or magnetic storage medium I/O device (RFID or the like H04N1/00342)} - H04N 23/611: where the recognised objects include parts of the human body - G06V 40/174: {Facial expression recognition} - H04N 1/32101: {Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title} - H04N 1/32128: {attached to the image data, e.g. file header, transmitted message header, information on the same page or in the same computer file as the image (for information embedded in the image H04N1/32144)} - H04N 23/45: for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images - H04N 2101/00: Still video cameras - H04N 2201/0084: Digital still camera - H04N 2201/3204: of data relating to a user, sender, addressee, machine or electronic recording medium (H04N2201/3256 and subgroups take precedence) - H04N 2201/3225: of data relating to an image, a page or a document - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract An apparatus and a method for providing emotional information in an electronic device are provided. At least one content is displayed. Emotional information is extracted from an image obtained via a camera. The emotional information is added to the content. ## Claims ### Claim 1 A method in an electronic device, the method comprising: displaying at least one content; extracting emotional information from an image obtained via a camera; and adding the emotional information to the content. ### Claim 2 (depends on 1) The method of claim 1, wherein the extracting of the emotional information comprises: in case of displaying a preview screen obtained via a first camera, extracting emotional information from an image obtained via a second camera at a point of capturing an image via the first camera, wherein the second camera captures a direction opposite to the first camera. ### Claim 3 (depends on 1) The method of claim 1, wherein the extracting of the emotional information comprises: in case of displaying a preview screen obtained via a first camera, extracting emotional information from an image obtained via a second camera while capturing a moving picture via the first camera, wherein the second camera captures a direction opposite to the first camera. ### Claim 4 (depends on 1) The method of claim 1, wherein the extracting of the emotional information comprises: in case of displaying a moving picture reproduction screen on a display unit, extracting emotional information from an image obtained via a camera positioned in the same direction as the display unit while reproducing a moving picture. ### Claim 5 (depends on 1) The method of claim 1, wherein the extracting of the emotional information comprises: in case of displaying electronic book content on a display unit, extracting emotional information from an image obtained via a camera positioned in the same direction as the display unit while displaying the electronic book content. ### Claim 6 (depends on 1) The method of claim 1, wherein the extracting of the emotional information comprises: in case of displaying shopping information on a display unit, extracting emotional information from an image obtained via a camera positioned in the same direction as the display unit while displaying the shopping information. ### Claim 7 (depends on 1) The method of claim 1, wherein the adding of the emotional information to the content comprises: adding a tag for the emotional information or metadata comprising the emotional information to the content. ### Claim 8 (depends on 1) The method of claim 1, further comprising: in the case in which a content list display event occurs, determining emotional information for at least one content; grouping the at least one content depending on the emotional information; and displaying the grouped at least one content on a display unit. ### Claim 9 (depends on 1) The method of claim 1, further comprising: in the case in which a moving picture reproduction event occurs, displaying at least one emotional information on a time search bar of moving picture content; and in the case in which selection of one of the at least one emotional information is detected, changing a reproduction point of the moving picture content depending on time information where the emotional information is positioned. ### Claim 10 (depends on 1) The method of claim 1, further comprising: in the case in which an electronic book content display event occurs, displaying a structure window comprising a position for at least one emotional information included in the electronic book content; and in the case in which selection of one of the at least one emotional information included in the structure window is detected, changing a display region of the electronic book content displayed on a display unit depending on position information of the emotional information. ### Claim 11 (depends on 10) The method of claim 10, wherein the structure window discriminates the position for the at least one emotional information included in the electronic book content for each emotional kind, and comprises the same. ### Claim 12 An electronic device comprising: at least one camera; a display unit; and at least one processor, wherein the at least one processor operatively displays at least one content on the display unit, extracts emotional information from an image obtained via at least one of the at least one camera, and adds the emotional information to the content. ### Claim 13 (depends on 12) The electronic device of claim 12, wherein in case of displaying a preview screen obtained using a first camera, of the at least one camera, that is on the display unit, the processor extracts emotional information from an image obtained via a second camera, of the at least one camera, at a point of capturing an image via the first camera, wherein the second camera shoots a direction opposite to the first camera. ### Claim 14 (depends on 12) The electronic device of claim 12, wherein in case of displaying a preview screen obtained using a first camera, of the at least one camera, that is on the display unit, the processor extracts emotional information from an image obtained via a second camera, of the at least one camera, while capturing a moving picture via the first camera, wherein the second camera shoots a direction opposite to the first camera. ### Claim 15 (depends on 12) The electronic device of claim 12, wherein in case of displaying a moving picture reproduction screen on the display unit, the processor extracts emotional information from an image obtained via at least one of the at least one camera positioned in the same direction as the display unit while reproducing a moving picture. ### Claim 16 (depends on 12) The electronic device of claim 12, wherein in case of displaying electronic book content on the display unit, the processor extracts emotional information from an image obtained via at least one of the at least one camera positioned in the same direction as the display unit while displaying the electronic book content. ### Claim 17 (depends on 12) The electronic device of claim 12, wherein in case of displaying shopping information on the display unit, the processor extracts emotional information from an image obtained via at least one of the at least one camera positioned in the same direction as the display unit while displaying the shopping information. ### Claim 18 (depends on 12) The electronic device of claim 12, further comprising: a memory for storing data, wherein the memory stores content to which a tag for emotional information or metadata comprising emotional information has been added. ### Claim 19 (depends on 12) The electronic device of claim 12, wherein in the case in which a content list display event occurs, the processor determines emotional information for at least one content, and groups the at least one content depending on the emotional information, and displays the grouped at least one content. ### Claim 20 (depends on 12) The electronic device of claim 12, wherein in the case in which a moving picture content reproduction event occurs, the processor displays at least one emotional information on a time search bar of moving picture content via the display unit, and in the case in which selection of one of the at least one emotional information is detected, the processor changes a reproduction point of the moving picture content depending on time information where the emotional information is positioned. ### Claim 21 (depends on 12) The electronic device of claim 12, wherein in the case in which an electronic book content display event occurs, the processor displays a structure window comprising a position for at least one emotional information included in electronic book content on the display unit, and in the case in which selection of at least one emotional information included in the structure window is detected, the processor changes a display region of the electronic book content displayed on the display unit depending on position information of the emotional information. ### Claim 22 (depends on 21) The electronic device of claim 21, wherein the structure window discriminates the position for the at least one emotional information included in the electronic book content for each emotional kind, and comprises the same. ### Claim 23 (depends on 1) A non-transitory computer-readable storage medium storing instructions that, when executed, cause at least one processor to perform the method of claim 1. ### Claim 24 A method in an electronic device, the method comprising: capturing an image of at least one user via a camera while the electronic device is providing a service; extracting emotional information of the at least one user; and associating the emotional information of the at least user with the service being provided when the image of the at least one user is captured. ### Claim 25 (depends on 24) The method of claim 24, wherein the service corresponds to at least one of a media playback service, a communication viewing service, a communication composition service, a Social Networking Service (SNS), a shopping service, and an on-line dating service. ### Claim 26 (depends on 24) A non-transitory computer-readable storage medium storing instructions that, when executed, cause at least one processor to perform the method of claim 24.