# US 12,183,336 B2 · Electronic device for identifying electronic device to perform speech recognition and method of operating same > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,183,336 B2 - Document ID: US12183336B2 - Status: Granted - Kind: B2 - Application number: 17/298,355 - Filed: 2021-05-14 - Published: 2022-10-06 - Granted: 2024-12-31 - Earliest claimed: 2020-09-18 - Assignees: Samsung Electronics Co., Ltd. - Applicants: Samsung Electronics Co., Ltd. - Inventors: Rami Jung; Kyusung Sim; Junsik Jeong; Woojei Choi; Hyukjoong Kim; Daedong Park; Jaehong Jo; Jaehyun Cho - Web page: https://patentgrep.com/patent/US12183336B2 ## CPC - G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue - G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback} - G10L 15/063: {Training} - G10L 15/08: Speech classification or search - G10L 15/30: Distributed recognition, e.g. in client-server systems, for mobile phones or network applications - G10L 25/84: for discriminating voice from noise - H04W 52/0229: {where the received signal is a wanted signal} - H04W 52/028: {switching on or off only a part of the equipment circuit blocks} - H04W 76/10: Connection setup - G10L 2015/088: {Word spotting} - G10L 2015/223: {Execution procedure of a spoken command} - H04W 84/18: Self-organising networks, e.g. ad-hoc networks or sensor networks - G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72) ## Abstract An electronic device is provided. The electronic device includes a communication circuit, a memory, and at least one processor, wherein, when instructions stored in the memory are executed, the instructions cause the at least one processor to establish communication connections with a plurality of external electronic devices for providing an intelligent speech service, receive at least one piece of information related to a user utterance including a specific word for wake-up from at least some of the plurality of external electronic devices, identify a device to be woken up among the at least some of the plurality of external electronic devices, based on at least one piece of information received during a time interval for identifying the device to be woken up, and change the time interval to a first time interval longer than the time interval, based on a reception time point of at least one piece of second information when the at least one piece of second information is received after the time interval. ## Claims ### Claim 1 An electronic device comprising: communication circuitry; memory storing one or more computer programs; and one or more processors communicatively coupled to the communication circuitry and the memory, wherein the one or more computer programs include computer-executable instructions that, when executed by the one or more processors individually or collectively, cause the electronic device to: establish communication connections with a plurality of external electronic devices for providing an intelligent speech service, receive at least one piece of information related to a user utterance including a specific word for wake-up from at least some of the plurality of external electronic devices, identify a device to be woken up among the at least some of the plurality of external electronic devices, based on at least one piece of first information received from a first external electronic device of the plurality of external electronic devices during a time interval for identifying the device to be woken up, identify a first time interval longer than the time interval, based on a reception time point of at least one piece of second information when the at least one piece of second information is received from a second external electronic device of the plurality of external electronic devices after the time interval, identify a second time interval shorter than the time interval, based on a reception time point of third information received from a third external electronic device of the plurality of external electronic devices last among the at least one piece of first information received during the time interval, and change the time interval based on the first time interval and the second time interval and further based on a quality of a communication state between the first external electronic device of the plurality of external electronic devices and the electronic device and a quality of a communication state between the second external electronic device of the plurality of external electronic devices and the electronic device. ### Claim 2 (depends on 1) The electronic device of claim 1, wherein the electronic device is configured as a main device, wherein the plurality of external electronic devices are configured as sub devices, and wherein the main device is configured to identify the device to be woken up among the sub devices. ### Claim 3 (depends on 2) The electronic device of claim 2, wherein the identified device to be woken up is the first external electronic device of the plurality of external electronic devices, and wherein the one or more computer programs further include computer-executable instructions that, when executed by the one or more processors individually or collectively, cause the electronic device to: control the first external electronic device of the plurality of external electronic devices to be woken up such that the first external electronic device of the plurality of external electronic devices is capable of receiving a first user utterance for controlling the first external electronic device of the plurality of external electronic devices and processing the first user utterance. ### Claim 4 (depends on 1) The electronic device of claim 1, wherein the identified device to be woken up is the first external electronic device of the plurality of external electronic devices, and wherein the one or more computer programs further include computer-executable instructions that, when executed by the one or more processors individually or collectively, cause the electronic device to: when the device to be woken up is re-identified based on the at least one piece of first information and the at least one piece of second information, identify at least one of the second external electronic device or the third external electronic device, which is different from the first external electronic device of the plurality of external electronic devices, corresponding to the at least one piece of second information as the device to be woken up, and change the time interval to the first time interval, based on the identification of the at least one of the second external electronic device or the third external electronic device as the device to be woken up. ### Claim 5 (depends on 4) The electronic device of claim 4, wherein the one or more computer programs further include computer-executable instructions that, when executed by the one or more processors individually or collectively, cause the electronic device to: when a number of the at least one piece of second information is plural, change the time interval to the first time interval, based on a latest reception time point among at least one reception time point of the at least one piece of second information. ### Claim 6 (depends on 1) The electronic device of claim 1, wherein the one or more computer programs further include computer-executable instructions that, when executed by the one or more processors individually or collectively, cause the electronic device to: when the at least one piece of second information is not received after the time interval, identify the third information received last among the at least one piece of first information received during the time interval, and change the time interval to the second time interval shorter than the time interval, based on the reception time point of the identified third information. ### Claim 7 (depends on 6) The electronic device of claim 6, wherein the one or more computer programs further include computer-executable instructions that, when executed by the one or more processors individually or collectively, cause the electronic device to: calculate an average value of the first time interval and the second time interval, and change the time interval to the calculated average value. ### Claim 8 (depends on 3) The electronic device of claim 3, wherein the at least one piece of first information includes information on a strength related to the user utterance identified by the at least some of the plurality of external electronic devices, and wherein the one or more computer programs further include computer-executable instructions that, when executed by the one or more processors individually or collectively, cause the electronic device to: identify the first external electronic device of the plurality of external electronic devices as an external electronic device transmitting information on a highest strength related to the user utterance among the at least some of the plurality of external electronic devices, based on the at least one piece of first information. ### Claim 9 (depends on 8) The electronic device of claim 8, wherein the memory stores information on priorities of the plurality of external electronic devices, and wherein the one or more computer programs further include computer-executable instructions that, when executed by the one or more processors individually or collectively, cause the electronic device to: identify a first candidate external electronic device and a second candidate external electronic device among the at least some of the plurality of external electronic devices, based on the at least one piece of first information, and identify the first external electronic device of the plurality of external electronic devices as an external electronic device having a higher priority among the first candidate external electronic device and a candidate second external electronic device of the plurality of external electronic devices, based on the information on the priorities of the plurality of external electronic devices. ### Claim 10 (depends on 9) The electronic device of claim 9, wherein the one or more computer programs further include computer-executable instructions that, when executed by the one or more processors individually or collectively, cause the electronic device to: identify that the candidate second external electronic device of the plurality of external electronic devices is re-identified as the device to be woken up after the first external electronic device of the plurality of external electronic devices is identified as the device to be woken up, and change a priority of the second candidate external electronic device to a first priority higher than the priority of the first candidate external electronic device, based on the re-identification of the second candidate external electronic device as the device to be woken up. ### Claim 11 (depends on 1) The electronic device of claim 1, wherein the one or more computer programs further include computer-executable instructions that, when executed by the one or more processors individually or collectively, cause the electronic device to: accumulate information acquired in at least one operation of identifying the device to be woken up, performed before the at least one piece of information is received, and wherein the accumulated information includes at least one of, information on a signal to noise ratio (SNR) of each of the plurality of external electronic devices acquired in each of the operations for wake-up, performed before the at least one piece of information is received, information on a time point at which information is received from each of the plurality of external electronic devices, information related to a state of each of the plurality of external electronic devices, information on a device identified to be initially woken up, or information on a device to be finally woken up. ### Claim 12 (depends on 11) The electronic device of claim 11, wherein the one or more computer programs further include computer-executable instructions that, when executed by the one or more processors individually or collectively, cause the electronic device to: set a value used for the operation of identifying the device to be woken up, based on information related to the plurality of external electronic devices, and wherein the value includes at least one of the time interval for identifying the device to be woken up or priorities of the plurality of external electronic devices to be identified as the device to be woken up. ### Claim 13 (depends on 11) The electronic device of claim 11, wherein the one or more computer programs further include computer-executable instructions that, when executed by the one or more processors individually or collectively, cause the electronic device to: perform learning, based on an algorithm for generating an artificial intelligence model using, as training data, at least some pieces of information related to the plurality of external electronic devices of the plurality of external electronic devices, wherein the artificial intelligence model is configured to output information on a device to be finally woken up in response to an input of the information on the SNR of each of the plurality of external electronic devices, wherein the information related to the state of each of the plurality of external electronic devices, and wherein the information on a device to be initially woken up. ### Claim 14 (depends on 13) The electronic device of claim 13, wherein the one or more computer programs further include computer-executable instructions that, when executed by the one or more processors individually or collectively, cause the electronic device to: identify first information related to the SNR of each of the at least some of the plurality of external electronic devices and second information related to the state of each of the at least some of the plurality of external electronic devices from the at least one piece of information received from the at least some of the plurality of external electronic devices, identify third information on a device identified to be woken up, determined based on the at least one piece of information, and identify the device to be woken up from the artificial intelligence model based on an input of the first information, the second information, and the third information into the artificial intelligence model. ### Claim 15 A method performed by an electronic device, the method comprising: establishing, by the electronic device, communication connections with a plurality of external electronic devices for providing an intelligent speech service; receiving, by the electronic device, at least one piece of information related to a user utterance including a specific word for wake-up from at least some of the plurality of external electronic devices; identifying, by the electronic device, a device to be woken up among the at least some of the plurality of external electronic devices, based on at least one piece of first information received from a first external electronic device of the plurality of external electronic devices during a time interval for identifying the device to be woken up; identifying, by the electronic device, a first time interval longer than the time interval, based on a reception time point of at least one piece of second information received from a second external electronic device of the plurality of external electronic devices when the at least one piece of second information is received after the time interval; identifying, by the electronic device, a second time interval shorter than the time interval, based on a reception time point of third information received received from a third external electronic device of the plurality of external electronic devices last among the at least one piece of first information received during the time interval; and changing, by the electronic device, the time interval based on the first time interval and the second time interval and further based on a quality of a communication state between the first external electronic device of the plurality of external electronic devices and the electronic device and a quality of a communication state between the second external electronic device of the plurality of external electronic devices and the electronic device. ### Claim 16 (depends on 15) The method of claim 15, wherein the electronic device is configured as a main device, wherein the plurality of external electronic devices are configured as sub devices, and wherein the main device is configured to identify the device to be woken up among the sub devices. ### Claim 17 (depends on 16) The method of claim 16, wherein the identified device to be woken up is a first external electronic device of the plurality of external electronic devices, and wherein the method further comprises: controlling the first external electronic device of the plurality of external electronic devices to be woken up such that the first external electronic device of the plurality of external electronic devices is capable of receiving a first user utterance for controlling the first external electronic device of the plurality of external electronic devices and processing the first user utterance. ### Claim 18 (depends on 15) The method of claim 15, wherein the identified device to be woken up is the first external electronic device of the plurality of external electronic devices, and wherein the method further comprises: when the device to be woken up is re-identified based on the at least one piece of first information and the received at least one piece of second information, identifying at least one of the second external electronic device or the third external electronic device of the plurality of external electronic devices, which is different from the first external electronic device of the plurality of external electronic devices, corresponding to the at least one piece of second information as the device to be woken up, and changing the time interval to the first time interval, based on the identification of the at least one of the second external electronic device or the third external electronic device of the plurality of external electronic devices as the device to be woken up. ### Claim 19 (depends on 18) The method of claim 18, further comprising: when a number of the at least one piece of second information is plural, changing the time interval to the first time interval, based on a latest reception time point among at least one reception time point of the at least one piece of second information. ### Claim 20 One or more non-transitory computer-readable storage media storing one or more computer programs including computer-executable instructions that, when executed by one or more processors of an electronic device individually or collectively, cause the electronic device to: establish, by the electronic device, communication connections with a plurality of external electronic devices for providing an intelligent speech service, receive, by the electronic device, at least one piece of information related to a user utterance including a specific word for wake-up from at least some of the plurality of external electronic devices, identify, by the electronic device, a device to be woken up among the at least some of the plurality of external electronic devices, based on at least one piece of first information received from a first external electronic device of the plurality of external electronic devices during a time interval for identifying the device to be woken up, identify, by the electronic device, a first time interval longer than the time interval, based on a reception time point of at least one piece of second information received from a second external electronic device of the plurality of external electronic devices when the at least one piece of second information is received after the time interval, identify, by the electronic device, a second time interval shorter than the time interval, based on a reception time point of third information received from a third external electronic device of the plurality of external electronic devices last among the at least one piece of first information received during the time interval, and change, by the electronic device, the time interval based on the first time interval and the second time interval and further based on a quality of a communication state between the first external electronic device of the plurality of external electronic devices and the electronic device and a quality of a communication state between the second external electronic device of the plurality of external electronic devices and the electronic device.