# US 11,445,144 B2 · Electronic device for linking music to photography, and control method therefor > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,445,144 B2 - Document ID: US11445144B2 - Status: Granted - Kind: B2 - Application number: 16/766,547 - Filed: 2018-12-07 - Published: 2020-10-15 - Granted: 2022-09-13 - Earliest claimed: 2017-12-29 - Assignees: Samsung Electronics Co., Ltd. - Applicants: Samsung Electronics Co., Ltd. - Inventors: Kyuil Jeong; Benjamin Hubert - Web page: https://patentgrep.com/patent/US11445144B2 ## CPC - H04N 1/32128: {attached to the image data, e.g. file header, transmitted message header, information on the same page or in the same computer file as the image (for information embedded in the image H04N1/32144)} - H04N 5/92: Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback - G06V 40/172: {Classification, e.g. identification} - H04N 5/772: {the recording apparatus and the television camera being placed in the same enclosure} - H04N 9/8211: {the additional signal being a sound signal (H04N9/835 takes precedence)} - H04N 21/431: Generation of visual interfaces {for content selection or interaction}; Content or additional data rendering - H04N 21/4722: for requesting additional data associated with the content - H04N 21/858: Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot - H04N 23/633: {for displaying additional information relating to control or operation of the camera} - G06F 3/0482: Interaction with lists of selectable items, e.g. menus - H04N 2201/3264: of sound signals - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract The present invention relates to a content producing device and method for matching and storing music information when an electronic device captures an image and, particularly, to a content producing device and method for storing, together with a captured image, information on music played by an electronic device or around the electronic device when the image is captured. According to one embodiment of the present disclosure, a control method for an electronic device comprises the steps of: capturing an image when a photographing instruction is inputted by a user; acquiring, during capturing of the image, sound source information on music played in a space in which the electronic device is located; and matching the sound source information on music to the captured image and storing the same. ## Claims ### Claim 1 A control method of an electronic device, the method comprising: based on an image capturing command being received from a user, capturing an image; obtaining sound source information on music played in a space in which the electronic device is located while capturing the image; matching the sound source information on the music to the captured image and storing the captured image and the sound source information; and executing a music application and displaying a UI list including one or more images stored and matched to sound source information for first music based on a user command, the user command comprising at least one feature of sound source information corresponding to the first music for executing a music application being input. ### Claim 2 (depends on 1) The method according to claim 1, wherein the obtaining comprises, based on the music being music played by the electronic device, obtaining the sound source information on the music based on tag information of the music. ### Claim 3 (depends on 1) The method according to claim 1, wherein the obtaining comprises: based on the music being music played by an external device connected to the electronic device, requesting the external device for the sound source information on the music; and receiving the sound source information on the music from the external device. ### Claim 4 (depends on 1) The method according to claim 1, wherein the obtaining comprises: based on the music being music played by an external device not connected to the electronic device, recording the music played and transmitting the music to an external server; and based on the external server obtaining the sound source information on the music by a sound source recognition technology, receiving the sound source information on the music from the external server. ### Claim 5 (depends on 1) The method according to claim 1, further comprising: based on a user command for executing a gallery application being input, executing the gallery application and displaying a UI including an image stored and matched to the sound source information on the music. ### Claim 6 (depends on 5) The method according to claim 5, further comprising: displaying an indicator for guiding that the sound source information is matched and stored, in one area of the UI including the image stored and matched to the sound source information. ### Claim 7 (depends on 6) The method according to claim 6, further comprising: based on a user command for selecting the area displayed with the indicator being input while displaying the UI, displaying the image included in the UI and playing the music based on the sound source information on the music stored and matched to the image; and based on a user command for selecting an area, in which the indicator is not displayed, being input while displaying the UI, displaying the image included in the UI. ### Claim 8 (depends on 1) The method according to claim 1, further comprising: based on a user command for selecting a first UI including a first image stored and matched to sound source information for the first music from the UI list being input, playing the first music and displaying the first image; and reproducing a second image of a second UI including the second image stored and matched to the sound source information for the first music sequentially with the first image. ### Claim 9 (depends on 1) The method according to claim 1, further comprising: recognizing a face of a person included in the image; obtaining social media account information by using the recognized face; and transmitting an image stored and matched to the sound source information on the music to the social media account. ### Claim 10 (depends on 1) The method according to claim 1, wherein the UI list comprises two or more images matched to sound source information of the first music. ### Claim 11 An electronic device comprising: a camera; a memory; a display; and a processor configured to, based on an image capturing command being input from a user, control the camera to capture an image, obtain sound source information on music played in a space in which the electronic device is located while capturing the image, match the sound source information on the music to the captured image, and store the captured image and the sound source information in the memory, and execute a music application and control the display to display a UI list including one or more images stored and matched to sound source information for first music based on a user command, the user command comprising at least one feature of sound source information corresponding to the first music for executing a music application being input. ### Claim 12 (depends on 11) The device according to claim 11, wherein the processor is configured to, based on the music being music played by the electronic device, obtain the sound source information on the music based on tag information of music stored in the memory. ### Claim 13 (depends on 11) The device according to claim 11, further comprising: a communicator comprising circuitry, wherein the processor is configured to, based on the music being music played by an external device connected to the electronic device via the communicator, control the communicator to request the external device for the sound source information on the music and receive the sound source information on the music from the external device. ### Claim 14 (depends on 13) The device according to claim 13, further comprising: a microphone, wherein the processor is configured to, based on the music being music played by an external device not connected to the electronic device, control the microphone to record the music played and transmit the music to an external server, and based on the external server obtaining the sound source information on the music by a sound source recognition technology, control the communicator to receive the sound source information on the music from the external server. ### Claim 15 (depends on 11) The device according to claim 11, wherein the processor is configured to, based on a user command for executing a gallery application being input, execute the gallery application and control the display to display a UI including an image stored and matched to the sound source information on the music. ### Claim 16 (depends on 11) The device according to claim 11, wherein the processor is configured to: based on a user command for selecting a first UI including a first image stored and matched to sound source information for the first music from the UI list being input, play the first music and control the display to display the first image; and control the display to reproduce a second image of a second UI including the second image stored and matched to the sound source information for the first music sequentially with the first image. ### Claim 17 (depends on 10) The method of claim 10, wherein the user command comprises a voice command including the sound source information of the first music.