# US 12,112,747 B2 · Method for controlling external device based on voice and electronic device thereof > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,112,747 B2 - Document ID: US12112747B2 - Status: Granted - Kind: B2 - Application number: 17/535,831 - Filed: 2021-11-26 - Published: 2022-06-09 - Granted: 2024-10-08 - Earliest claimed: 2020-12-04 - Assignees: Samsung Electronics Co., Ltd. - Applicants: Samsung Electronics Co., Ltd. - Inventors: Hyeonjeong Kim; Soyoung Kim; Taegu Kim; Yoonju Lee - Web page: https://patentgrep.com/patent/US12112747B2 ## CPC - G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue - G06F 3/16: Sound input; Sound output (speech processing G10L) - G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback} - G10L 15/04: Segmentation; Word boundary detection - G10L 15/18: using natural language modelling - G10L 15/28: Constructional details of speech recognition systems - G10L 2015/223: {Execution procedure of a spoken command} - G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract An electronic device is provided. The electronic device includes a voice input device, a communication circuit, a display, a processor operatively connected to the voice input device, the communication circuit, and the display, and a memory operatively connected to the processor. The memory may store one or more instructions that, when executed, cause the processor to receive a first utterance from a first user through the voice input device, to communicatively connect to a first external electronic device based on the first utterance, to display, to the display, a first user interface indicating a state of communicatively connecting to the first external electronic device, and to display, to the display, a second user interface indicating that the electronic device and the second external electronic device are simultaneously connected to the first external electronic device when the first external electronic device is communicatively connected to a second external electronic device. ## Claims ### Claim 1 An electronic device comprising: a voice input device; a communication circuit; a display; memory storing one or more computer programs; and one or more processors communicatively coupled to the voice input device, the communication circuit, the display, and the memory, wherein the one or more computer programs include computer-executable instructions that, when executed by the one or more processors, cause the electronic device to: receive a first utterance from a first user through the voice input device, based on the first utterance, communicatively connect to a first external electronic device, control the display to display a first screen indicating a state of communicatively connecting the electronic device to the first external electronic device, the first screen including a first user interface corresponding to the electronic device being indicated as being in the state of communicatively connecting to a second user interface corresponding to the first external electronic device, and based on the first external electronic device being communicatively connected to a second external electronic device, control the display to display a second screen indicating that the electronic device and the second external electronic device are simultaneously connected to the first external electronic device, the second screen including the first user interface corresponding to the electronic device and a third user interface corresponding to the second external electronic device being indicated as being in the state of being communicatively connected to the second user interface corresponding to the first external electronic device. ### Claim 2 (depends on 1) The electronic device of claim 1, wherein, based on the electronic device being communicatively connected to the first external electronic device, an account of a second user using the second external electronic device is an account for which communicative connection to the first external electronic device is allowed. ### Claim 3 (depends on 2) The electronic device of claim 2, wherein the account of the second user is identical to an account of the first user or an account included in a group set by the first user. ### Claim 4 (depends on 1) The electronic device of claim 1, wherein sharing of the first external electronic device is allowed to a user in a specific range, and wherein the specific range is set by the first user. ### Claim 5 (depends on 1) The electronic device of claim 1, wherein the second external electronic device is located within a specific distance of the electronic device. ### Claim 6 (depends on 1) The electronic device of claim 1, wherein a domain according to an intent of a user identified from a second utterance of a second user received through the second external electronic device is identical to a domain according to an intent of a user identified from the first utterance. ### Claim 7 (depends on 1) The electronic device of claim 1, wherein sharing of a capsule corresponding to a domain according to an intent of a user identified from the first utterance of the first user is allowed to another user in a specific range, and wherein the specific range is set by the first user. ### Claim 8 (depends on 7) The electronic device of claim 7, wherein an account of a second user that is a user of the second external electronic device is included in the specific range. ### Claim 9 (depends on 1) The electronic device of claim 1, wherein the one or more computer programs further include computer-executable instructions that, when executed by the one or more processors, cause the electronic device to: control the display to display a user interface indicating a result obtained by performing a task based on a second utterance received through the second external electronic device. ### Claim 10 (depends on 1) The electronic device of claim 1, wherein the one or more computer programs further include computer-executable instructions that, when executed by the one or more processors, cause the electronic device to: before displaying the second screen, control the display to display a user interface for receiving information about whether the first external electronic device is communicatively connected to the second external electronic device. ### Claim 11 A method performed by an electronic device for controlling an external electronic device based on voice, the method comprising: receiving, by the electronic device, a first utterance from a first user through a voice input device of the electronic device; based on the first utterance, communicatively connecting, by the electronic device, to a first external electronic device; displaying, by the electronic device on a display of the electronic device, a first screen indicating a state of communicatively connecting the electronic device to the first external electronic device, the first screen including a first user interface corresponding to the electronic device being indicated as being in the state of communicatively connecting to a second user interface corresponding to the first external electronic device; and based on the first external electronic device being communicatively connected to a second external electronic device, displaying, by the electronic device on the display, a second screen indicating that the electronic device and the second external electronic device are simultaneously connected to the first external electronic device, the second screen including the first user interface corresponding to the electronic device and a third user interface corresponding to the second external electronic device being indicated as being in the state of being communicatively connected to the second user interface corresponding to the first external electronic device. ### Claim 12 (depends on 11) The method of claim 11, wherein, when based on the electronic device being communicatively connected to the first external electronic device, an account of a second user using the second external electronic device is an account for which communicative connection to the first external electronic device is allowed. ### Claim 13 (depends on 12) The method of claim 12, wherein the account of the second user is identical to an account of the first user or an account included in a group set by the first user. ### Claim 14 (depends on 11) The method of claim 11, wherein sharing of the first external electronic device is allowed to a user in a specific range, and wherein the specific range is set by the first user. ### Claim 15 (depends on 11) The method of claim 11, wherein the second external electronic device is located within a specific distance of the electronic device. ### Claim 16 (depends on 11) The method of claim 11, wherein a domain according to an intent of a user identified from a second utterance of a second user received through the second external electronic device is identical to a domain according to an intent of a user identified from the first utterance. ### Claim 17 (depends on 11) The method of claim 11, wherein sharing of a capsule corresponding to a domain according to an intent of a user identified from the first utterance of the first user is allowed to another user in a specific range, and wherein the specific range is set by the first user. ### Claim 18 (depends on 17) The method of claim 17, wherein an account of a second user that is a user of the second external electronic device is included in the specific range. ### Claim 19 (depends on 11) The method of claim 11, further comprising: displaying, by the electronic device on the display, a user interface indicating a result obtained by performing a task based on a second utterance received through the second external electronic device. ### Claim 20 (depends on 11) The method of claim 11, further comprising: before displaying the second screen, displaying, by the electronic device on the display, a user interface for receiving information about whether the first external electronic device is communicatively connected to the second external electronic device. ### Claim 21 (depends on 1) The electronic device of claim 1, wherein the first user interface comprises a first shape corresponding to the electronic device, wherein the second user interface comprises a second shape corresponding to the first external electronic device and being different from the first shape, and wherein the third user interface comprises a third shape corresponding to the second external electronic device and being different from the second shape.