# US 9,883,018 B2 · Apparatus for recording conversation and method thereof > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 9,883,018 B2 - Document ID: US9883018B2 - Status: Granted - Kind: B2 - Application number: 14/221,863 - Filed: 2014-03-21 - Published: 2014-11-20 - Granted: 2018-01-30 - Earliest claimed: 2013-05-20 - Assignees: Samsung Electronics Co., Ltd. - Applicants: Samsung Electronics Co., Ltd. - Inventors: So-Ra Kim; Jin-Yong Kim; Hyun-Kyoung Kim; Hee-Woon Kim; Yu-Mi Ahn; Ji-Hyun Ahn - Web page: https://patentgrep.com/patent/US9883018B2 ## CPC - H04M 1/656: for recording conversations - G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback} - G10L 15/26: Speech to text systems (G10L15/08 takes precedence) - H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08) - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING ## Abstract A method for recording conversation is provided. The method includes capturing content, receiving at least one voice signal, distinguishing at least one person corresponding to the at least one voice signal by analyzing the at least one voice signal, converting the at least one voice signal into a text corresponding to the at least one voice signal, and displaying the text in the captured content to correspond to the distinguished at least one person. ## Claims ### Claim 1 A method for recording a conversation, the method comprising: capturing image content; receiving at least one voice signal; distinguishing at least one person corresponding to the at least one voice signal by analyzing the at least one voice signal; converting the at least one voice signal into text corresponding to the at least one voice signal; detecting a direction of the at least one voice signal using a plurality of directional microphones disposed within an apparatus; and displaying the text in the captured image content in the detected direction of the at least one voice signal based on a location of the distinguished at least one person determined according to the detected direction of the at least one voice signal. ### Claim 2 (depends on 1) The method of claim 1, wherein the distinguishing of the at least one person corresponding to the at least one voice signal comprises: extracting a name of the at least one person corresponding to the at least one voice signal by comparing the at least one voice signal with a pre-stored voice database. ### Claim 3 (depends on 2) The method of claim 2, wherein the pre-stored voice database comprises at least one voice signal that is stored in advance during a phone call, and at least one name stored in a contact list. ### Claim 4 (depends on 1) The method of claim 1, wherein the displaying of the text in the captured image content comprises: displaying the text in the captured image content together with a name of the at least one person based on the location of the distinguished at least one person. ### Claim 5 (depends on 1) The method of claim 1, further comprising: detecting a location at which lip movement for the at least one person appearing in the captured image content has occurred, wherein the displaying of the text in the captured image content comprises displaying the text at the detected location at which the lip movement has occurred in the captured image content, based on the location of the distinguished at least one person. ### Claim 6 (depends on 1) The method of claim 1, further comprising: distinguishing at least one person appearing in the captured image content by analyzing the captured image content. ### Claim 7 (depends on 6) The method of claim 6, wherein the distinguishing of the at least one person appearing in the captured image content comprises extracting a name of the at least one person corresponding to at least one face by comparing the at least one face with a pre-stored face database. ### Claim 8 (depends on 7) The method of claim 7, wherein the pre-stored face database comprises a face included in a photo that is stored in advance in a gallery, and a name stored in a contact list. ### Claim 9 (depends on 5) The method of claim 5, wherein the displaying of the text in the captured image content comprises displaying the text at the detected location at which lip movement for the at least one person appearing in the captured image content has occurred. ### Claim 10 (depends on 1) The method of claim 1, wherein the displaying of the text in the captured image content comprises displaying the text in the captured image content in the detected direction of the at least one voice signal that is generated from outside a field of view of the captured image content. ### Claim 11 (depends on 1) The method of claim 1, wherein, if the distinguished at least one person is determined to be in the captured image content, the text is displayed at the location in the captured image content based on the location of the distinguished at least one person to associate the text with the distinguished at least one person, and wherein, if the distinguished at least one person is not determined to be in the captured image content, the text is displayed in the captured image content and is not associated with a person appearing in the captured image content. ### Claim 12 (depends on 1) The method of claim 1, wherein the displaying of the text at the location in the captured image content based on the location of the distinguished at least one person is performed on the captured image content after capturing the image content. ### Claim 13 An apparatus for recording a conversation, the apparatus comprising: at least one processor configured to: capture image content, receive at least one voice signal, distinguish at least one person corresponding to the at least one voice signal by analyzing the at least one voice signal, convert the at least one voice signal into text corresponding to the at least one voice signal, detect a direction of the at least one voice signal using a plurality of directional microphones disposed within the apparatus, and display the text in the captured image content in the detected direction of the at least one voice signal based on a location of the distinguished at least one person determined according to the detected direction of the at least one voice signal; a camera configured to capture the image content; and a display configured to display the image content together with the text. ### Claim 14 (depends on 13) The apparatus of claim 13, wherein, when distinguishing the at least one person corresponding to the at least one voice signal by analyzing the at least one voice signal, the at least one processor is further configured to extract a name of the at least one person corresponding to the at least one voice signal by comparing the at least one voice signal with a pre-stored voice database. ### Claim 15 (depends on 14) The apparatus of claim 14, wherein the pre-stored voice database comprises a voice signal that is stored in advance during a phone call, and a name stored in a contact list. ### Claim 16 (depends on 13) The apparatus of claim 13, wherein, when displaying the text in the captured image content to correspond to the distinguished at least one person, the at least one processor is further configured to display the text in the captured image content together with a name of the at least one person to correspond to the distinguished at least one person. ### Claim 17 (depends on 13) The apparatus of claim 13, wherein the at least one processor is further configured to: detect a location at which lip movement for the at least one person appearing in the captured image content has occurred, and when displaying the text in the captured image content based on the location of the distinguished at least one person, display the text at the detected location at which the lip movement has occurred in the captured image content, based on the location of the distinguished at least one person. ### Claim 18 (depends on 13) The apparatus of claim 13, wherein the at least one processor is further configured to distinguish at least one person appearing in the captured image content by analyzing the captured image content. ### Claim 19 (depends on 18) The apparatus of claim 18, wherein, when distinguishing the at least one person appearing in the captured image content by analyzing the captured image content, the at least one processor is further configured to extract a name of the at least one person corresponding to at least one face by comparing the at least one face with a pre-stored face database. ### Claim 20 (depends on 19) The apparatus of claim 19, wherein the pre-stored face database comprises a face included in a photo that is stored in advance in a gallery, and a name stored in a contact list. ### Claim 21 (depends on 17) The apparatus of claim 17, wherein the at least one processor is further configured to: when displaying the text in the captured image content based on the location of the distinguished at least one person, display the text at the detected location at which lip movement for the at least one person appearing in the captured image content has occurred. ### Claim 22 (depends on 13) The apparatus of claim 13, wherein the at least one processor is further configured to: when displaying the text in the captured image content based on the location of the distinguished at least one person, display the text in the captured image content in the detected direction of the at least one voice signal that is generated from outside a field of view of the captured image content. ### Claim 23 (depends on 1) A non-transitory computer-readable storage medium storing instructions that, when executed, cause at least one processor to perform the method of claim 1.