# US 12,764,081 B2 · Electronic device for identifying image combined with text in multimedia content and method thereof > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,764,081 B2 - Document ID: US12764081B2 - Status: Granted - Kind: B2 - Application number: 18/538,649 - Filed: 2023-12-13 - Published: 2024-04-11 - Granted: 2026-10-13 - Earliest claimed: 2022-10-07 - Assignees: Samsung Electronics Co., Ltd. - Applicants: Samsung Electronics Co., Ltd. - Inventors: Sangmin Park; Gajin Song - Web page: https://patentgrep.com/patent/US12764081B2 ## CPC - H04L 51/10: Multimedia information - G06F 40/30: Semantic analysis - H04L 51/04: Real-time or near real-time messaging, e.g. instant messaging [IM] - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract An electronic device includes a speaker; a display; a memory; and a processor operatively connected to the speaker, the display, and the memory. The processor is configured to: identify an input indicating to search a multimedia content stored in the memory, the multimedia content comprising a first text and a plurality of images, the input comprising a third text, generate a second text representing the plurality of images, identify, based on the first text and the second text, a portion of the multimedia content, which is matched to the third text, and output, via at least one of the speaker or the display, the portion of the multimedia content. ## Claims ### Claim 1 An electronic device comprising: a speaker; a display; memory including one or more storage media storing instructions; and at least one processor including processing circuitry, wherein the instructions, when executed by the at least one processor individually or collectively, cause the electronic device to: identify an input for searching a first set of contents stored in the memory, wherein the first set of contents include a first content including a first image and a second content including the first image; in response to the input, identify a second set of contents in which an image included in the first set of contents is replaced with at least one text, wherein the second set of contents include a third content corresponding to the first content in which the first image is replaced with a first text, and a fourth content corresponding to the second content in which the first image is replaced with a second text; identify at least portion of the second set of contents, which corresponds to a third text associated with the input; and output, via at least one of the speaker or the display, the at least portion of the second set of contents. ### Claim 2 (depends on 1) The electronic device of claim 1, wherein the instructions, when executed by the at least one processor individually or collectively, cause the electronic device to: output an audio signal through the speaker, wherein at least portion of the audio signal represents the first text or the second text. ### Claim 3 (depends on 1) The electronic device of claim 1, wherein the first text comprises a sequence of characters, and wherein the instructions, when executed by the at least one processor individually or collectively, cause the electronic device to: identify, in the sequence of characters of the first content, a position at which the first image is located; and obtain the second text based on at least one character positioned adjacent to the position. ### Claim 4 (depends on 3) The electronic device of claim 3, wherein the instructions, when executed by the at least one processor individually or collectively, cause the electronic device to: identify the at least portion of the second set of contents, based on the second text comprising a semantic expression of the first image included in the first content. ### Claim 5 (depends on 3) The electronic device of claim 3, wherein the instructions, when executed by the at least one processor individually or collectively, cause the electronic device to: combine the second text and the sequence of characters of the first content, based on the position; identify, based on the third content including the combined second text with respect to the sequence of characters, the at least portion of the second set of contents, which corresponds to the third text. ### Claim 6 (depends on 1) The electronic device of claim 1, further comprising a communication circuit configured to receive second multimedia content, wherein the instructions, when executed by the at least one processor individually or collectively, cause the electronic device to store the second set of contents in the memory. ### Claim 7 (depends on 1) The electronic device of claim 1, further comprising a microphone configured to receive an audio signal, wherein the instructions, when executed by the at least one processor individually or collectively, cause the electronic device to identify the input based on a speech of the audio signal. ### Claim 8 (depends on 1) The electronic device of claim 1, wherein the instructions, when executed by the at least one processor individually or collectively, cause the electronic device to display, in the display, a portion of the first set of contents. ### Claim 9 (depends on 1) The electronic device of claim 1, wherein the instructions, when executed by the at least one processor individually or collectively, cause the electronic device to identify, in the first set of contents, the first image included in the first content based on a plurality of codes representing the first image, and wherein the plurality of codes is based on a text format. ### Claim 10 (depends on 1) The electronic device of claim 1, wherein the instructions, when executed by the at least one processor individually or collectively, cause the electronic device to display, through the display, at least portion of the first set of contents corresponding to the at least portion of the second set of contents. ### Claim 11 A method of an electronic device including a speaker and a display, the method comprising: identifying an input for searching a first set of contents, wherein the first set of contents include a first content including a first image and a second content including the first image; in response to the input, identifying a second set of contents in which an image included in the first set of contents is replaced with at least one text, wherein the second set of contents include a third content corresponding to the first content in which the first image is replaced with a first text, and a fourth content corresponding to the second content in which the first image is replaced with a second text; identifying at least portion of the second set of contents which corresponds to a third text associated with the input; and outputting, via at least one of the speaker or the display, the at least portion of the second set of contents. ### Claim 12 (depends on 11) The method of claim 11, wherein the identifying the second set of contents comprising: identifying, in a sequence of characters of the first content, a position at which the first image is located; and obtaining the second text based on at least one character positioned adjacent to the position. ### Claim 13 (depends on 12) The method of claim 12, wherein the identifying the second set of contents comprising: identifying the at least portion of the second set of contents, based on the second text comprising a semantic expressions of the first image included in the first content. ### Claim 14 (depends on 11) The method of claim 11, wherein the identifying the input comprising identifying the input comprising the-one or more third characters based on an audio signal received via a microphone of the electronic device. ### Claim 15 (depends on 11) The method of claim 11, wherein the outputting the at least portion of the second set of contents comprising a speech representing the first text or the second text, via the speaker of the electronic device. ### Claim 16 (depends on 11) The method of claim 11, wherein the outputting the at least portion of the second set of contents comprising displaying, in a state outputting the at least portion of the second set of contents via the speaker of the electronic device, the first image on the display. ### Claim 17 A method of an electronic device including a memory, a speaker, and a display, the method comprising: identifying an input for searching a first set of contents stored in the memory of the electronic device, wherein the first set of contents include a first content including a first image and a second content including the first image; in response to the input, identifying a second set of contents in which an image included in the first set of contents is replaced with at least one text, wherein the second set of contents include a third content corresponding to the first content in which the first image is replaced with a first text, and a fourth content corresponding to the second content in which the first image is replaced with a second text; identifying at least a portion of the second set of contents, which corresponds to a third text associated with the input; and outputting, via at least one of the speaker or the display, at least portion of the first set of contents corresponding to the identified at least portion of the second set of contents. ### Claim 18 (depends on 17) The method of claim 17, wherein the outputting comprising: outputting, via the speaker, an audio signal comprising a speech representing the first image of the at least portion of the first set of contents based on the second text. ### Claim 19 (depends on 17) The method of claim 17, further comprising: identifying, in a sequence of characters of the first text, a position at which the first image is located; and obtaining the second text, based on the identified positions and based on at least one character respectively corresponding to the first image. ### Claim 20 (depends on 19) The method of claim 19, wherein the identifying the portion of the first set of contents comprising identifying the portion based on the second text comprising semantic expressions of the first image.