# US 12,216,701 B2 · Voice-based content providing method and electronic device thereof > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,216,701 B2 - Document ID: US12216701B2 - Status: Granted - Kind: B2 - Application number: 17/562,470 - Filed: 2021-12-27 - Published: 2022-06-23 - Granted: 2025-02-04 - Earliest claimed: 2020-12-23 - Assignees: Samsung Electronics Co., Ltd. - Applicants: Samsung Electronics Co., Ltd. - Inventors: Jinho Choi; Kyounghoon Lee; Suneung Park; Jaeyung Yeo - Web page: https://patentgrep.com/patent/US12216701B2 ## CPC - G06F 16/483: using metadata automatically derived from the content - G06F 16/90332: {Natural language query formulation or dialogue systems} - G06F 3/16: Sound input; Sound output (speech processing G10L) - G06Q 50/10: Services - G10L 15/02: Feature extraction for speech recognition; Selection of recognition unit - G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue - G10L 15/30: Distributed recognition, e.g. in client-server systems, for mobile phones or network applications - G11B 20/10: Digital recording or reproducing - H04L 67/10: in which an application is distributed across nodes in the network (software deployment G06F8/60; multiprogramming arrangements G06F9/46) - H04L 67/306: User profiles - G10L 15/00: Speech recognition (G10L17/00 takes precedence) - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR - G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING - G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R) - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) ## Abstract An electronic device including a microphone, a communication circuit, an output device including at least one of a speaker or a display, a processor operatively connected to the microphone, the communication circuit, and the output device, and a memory operatively connected to the processor are provided. The memory may store one or more instructions that, when executed, cause the processor to receive a voice input of a user through the microphone, to transmit the voice input and context information to an external server through the communication circuit, the context information including information about an application running on the electronic device, to receive a response for playing content corresponding to a category determined based on category priority information from among pieces of content matching a keyword included in the voice input, from the external server through the communication circuit, the category priority information being determined based on the context information, and to play the content through the output device. ## Claims ### Claim 1 An electronic device comprising: a microphone; a communication circuit; an output device comprising at least one of a speaker or a display; memory storing one or more computer programs; and one or more processors communicatively coupled to the microphone, the communication circuit, the output device and the memory, wherein the one or more computer programs include computer-executable instructions that, when executed by the one or more processors individually or collectively, cause the electronic device to: receive a voice input of a user through the microphone, transmit the voice input and context information to an external server through the communication circuit, wherein the context information comprises information about an application running on the electronic device, receive a response to play content corresponding to a category determined based on category priority information from among a plurality of content matching a keyword included in the voice input and a score value for each category by the external server, from the external server through the communication circuit, wherein the category priority information is determined based on the context information, and play the content through the output device, and wherein the score value for each category comprises: a first score value determined based on preference of a plurality of users for a plurality of categories respectively corresponding to the plurality of content, and a second score value determined based on user historical data of the user for the plurality of categories. ### Claim 2 (depends on 1) The electronic device of claim 1, wherein the plurality of content comprises: content of a first category supported by the running application, and content of a second category not supported by the running application, and wherein a priority of the first category is determined by the external server so as to be higher than a priority of the second category. ### Claim 3 (depends on 1) The electronic device of claim 1, wherein the determined category is determined based on internet of things (IoT) device information by the external server. ### Claim 4 (depends on 3) The electronic device of claim 3, wherein the plurality of content comprises: content of a first category supported by a first IoT device, which is turned on, and content of a second category supported by a second IoT device, which is turned off, and wherein a priority of the first category is determined by the external server so as to be higher than a priority of the second category. ### Claim 5 (depends on 1) The electronic device of claim 1, wherein the determined category is determined based on a weighted sum score value obtained by applying a weight for each score to the first score value and the second score value and by summing applied results. ### Claim 6 (depends on 1) The electronic device of claim 1, wherein the first score value increases as a time point according to time information associated with each content included in each of the plurality of categories is late. ### Claim 7 (depends on 1) The electronic device of claim 1, wherein the second score value comprises a score value obtained by calculating a number of times that the user selects each of the plurality of categories, as compared to a number of times that the user selects one of the plurality of categories within a specified section. ### Claim 8 (depends on 7) The electronic device of claim 7, wherein a weight for each score applied to the second score value increases as a length of the section decreases. ### Claim 9 An electronic device comprising: a microphone; an output device comprising at least one of a speaker or a display; memory storing one or more computer programs; and one or more processors communicatively coupled to the microphone, the output device and the memory, wherein the one or more computer programs include computer-executable instructions that, when executed by the one or more processors individually or collectively, cause the electronic device to: receive a voice input of a user through the microphone, determine a priority between a plurality of categories respectively corresponding to a plurality of content matching a keyword included in the voice input based on context information, wherein the context information comprises information about an application running on the electronic device, determine one category among the plurality of categories based on category priority information and a score value for each category, and play content corresponding to the determined category through the output device, and wherein the score value for each category comprises: a first score value determined based on preference of a plurality of users for the plurality of categories, and a second score value determined based on user historical data of the user for the plurality of categories. ### Claim 10 (depends on 9) The electronic device of claim 9, wherein the plurality of content comprises: content of a first category supported by the running application, and content of a second category not supported by the running application, and wherein the one or more computer programs further include computer-executable instructions that, when executed by the one or more processors individually or collectively, cause the electronic device to: assign a priority, which is higher than a priority of the second category, to the first category. ### Claim 11 (depends on 9) The electronic device of claim 9, further comprising: a communication circuit operatively connected to the one or more processors, wherein the one or more computer programs further include computer-executable instructions that, when executed by the one or more processors individually or collectively, cause the electronic device to: receive IoT device information from an IoT cloud through the communication circuit, and determine the priority between the plurality of categories based on the IoT device information. ### Claim 12 (depends on 11) The electronic device of claim 11, wherein the plurality of content comprises: content of a first category supported by a first IoT device, which is turned on, and content of a second category supported by a second IoT device, which is turned off, and wherein the one or more computer programs further include computer-executable instructions that, when executed by the one or more processors individually or collectively, cause the electronic device to: assign a priority, which is higher than a priority of the second category, to the first category. ### Claim 13 (depends on 9) The electronic device of claim 9, wherein the one or more computer programs further include computer-executable instructions that, when executed by the one or more processors individually or collectively, cause the electronic device to: determine the one category based on a weighted sum score value obtained by applying a weight for each score to the first score value and the second score value and by summing applied results. ### Claim 14 A voice-based content providing method performed by an electronic device, the method comprising: receiving, by the electronic device, a voice input of a user through a microphone; transmitting, by the electronic device, the voice input and context information comprising information about an application running on the electronic device, to an external server through a communication circuit; receiving, by the electronic device, a response to play content corresponding to a category determined based on category priority information from among a plurality of content matching a keyword included in the voice input through the communication circuit; and playing, by the electronic device, the content through an output device comprising at least one of a speaker or a display, wherein the determined category is determined based on a score value for each category by the external server, and wherein the score value for each category comprises: a first score value determined based on preference of a plurality of users for a plurality of categories respectively corresponding to the plurality of content, and a second score value determined based on user historical data of the user for the plurality of categories. ### Claim 15 (depends on 14) The method of claim 14, wherein the plurality of content comprises: content of a first category supported by the running application, and content of a second category not supported by the running application, and wherein a priority of the first category is determined by the external server so as to be higher than a priority of the second category. ### Claim 16 (depends on 14) The method of claim 14, wherein the determined category is determined based on IoT device information by the external server, wherein the plurality of content comprises: content of a first category supported by a first IoT device, which is turned on, and content of a second category supported by a second IoT device, which is turned off, and wherein a priority of the first category is determined by the external server so as to be higher than a priority of the second category. ### Claim 17 (depends on 14) The method of claim 14, wherein the determined category is determined based on a weighted sum score value obtained by applying a weight for each score to the first score value and the second score value and by summing applied results.