# US 2025/0095649 A1 · Multi-modal interaction with intelligent assistants in voice command devices > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2025/0095649 A1 - Document ID: US20250095649A1 - Status: Published application - Kind: A1 - Application number: 18/965,668 - Filed: 2024-12-02 - Published: 2025-03-20 - Earliest claimed: 2019-03-27 - Assignees: Samsung Electronics Co., Ltd. - Applicants: Samsung Electronics Co., Ltd. - Inventors: Jeffrey C. OLSON; Henry N. HOLTZMAN; Jean-David Hsu; Jeffrey A. MORGAN - Web page: https://patentgrep.com/patent/US20250095649A1 ## CPC - G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue - G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback} - G10L 15/08: Speech classification or search - G10L 17/00: Speaker identification or verification techniques - G10L 2015/088: {Word spotting} - G10L 2015/223: {Execution procedure of a spoken command} - G10L 2015/228: {of application context} - G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract A method comprising detecting an activation of an intelligent assistant on an electronic device, waking up the intelligent assistant from a sleep mode in response to the activation, and determining an amount of vocabulary the intelligent assistant acts upon during a listening mode based on a type of the activation. ## Claims ### Claim 1 An electronic device comprising: a display; a microphone; a speaker; at least one sensor; at least one processor coupled to the display, the microphone, the speaker, and the at least one sensor, and memory storing instructions, wherein the instructions, when executed by the at least one processor, cause the electronic device to: based on a first occurrence of a first event, provide a first feedback via at least one of the display or the speaker, the first event comprising identifying a wake word from a first speech signal obtained via the microphone; generate a first timeout based on no speech signal being obtained via the microphone within a first time duration after providing the first feedback; based on a first occurrence of a second event, provide a second feedback via at least one of the display or the speaker, the second event comprising detecting, via the at least one sensor, an external object within a proximity of the electronic device, and the second feedback being different from the first feedback, and generate a second timeout based on no speech signal being obtained via the microphone within a second time duration after providing the second feedback, wherein the first time duration is longer than the second time duration. ### Claim 2 (depends on 1) The electronic device of claim 1, wherein the first feedback includes a feedback based on a sound, provided via the speaker, or a feedback based on a visual indication, provided via the display. ### Claim 3 (depends on 1) The electronic device of claim 1, wherein the first time duration is different from the third time duration, and the second time duration is different from the fourth time duration. ### Claim 4 (depends on 1) The electronic device of claim 1, wherein the instructions, when executed by the at least one processor, cause the electronic device to provide, based on the generating the first timeout, a visual indication indicating a transition to a sleep mode. ### Claim 5 (depends on 1) The electronic device of claim 1, wherein the instructions, when executed by the at least one processor, cause the electronic device to provide, based on the generating the second timeout, a visual indication indicating a transition to a sleep mode. ### Claim 6 (depends on 1) The electronic device of claim 1, wherein the instructions, when executed by the at least one processor, cause the electronic device to, based on the second speech signal being obtained via the microphone and prior to the generating the third timeout, control the display to display a text phrase indicating a transition to a listening mode. ### Claim 7 (depends on 1) The electronic device of claim 1, wherein the instructions, when executed by the at least one processor, cause the electronic device to, based on the third speech signal being obtained via the microphone and prior to the generating the fourth timeout, control the display to display a text phrase indicating a transition to a listening mode. ### Claim 8 (depends on 1) The electronic device of claim 1, wherein the instructions, when executed by the at least one processor, cause the electronic device to, in generating the third timeout, provide a speech response, via the speaker, indicating no voice command being identified from the second speech signal. ### Claim 9 (depends on 1) The electronic device of claim 1, wherein the instructions, when executed by the at least one processor, cause the electronic device to, in generating the fourth timeout, provide a visual feedback, via the display, indicating no voice command being identified from the third speech signal. ### Claim 10 (depends on 3) The electronic device of claim 3, wherein the third time duration is longer than the fourth time duration. ### Claim 11 A non-transitory storage medium storing one or more program, the one or more program comprising computer-executable instructions, when executed by at least one processor of an electronic device, cause the electronic device to: based on a first occurrence of a first event, provide a first feedback via at least one of a display of the electronic device or a speaker of the electronic device, the first event including identifying a wake word from a first speech signal obtained via a microphone of the electronic device; generate a first timeout based on no speech signal being obtained via the microphone within a first time duration after providing the first feedback; based on a first occurrence of a second event, provide a second feedback via at least one of the display or the speaker, the second event including detecting, via at least one sensor of the electronic device, an external object within a proximity of the electronic device, and the second feedback being different from the first feedback, and generate a second timeout based on no speech signal being obtained via the microphone within a second time duration after providing the second feedback, wherein the first time duration is longer than the second time duration. ### Claim 12 (depends on 11) The non-transitory storage medium of claim 11, wherein the first feedback includes a feedback based on at least one of a sound, provided via the speaker, and or a feedback based on a visual indication, provided via the display, and wherein the second feedback includes a feedback based on a visual indication, provided via the display. ### Claim 13 (depends on 11) The non-transitory storage medium of claim 11, wherein the first time duration is different from the third time duration, and the second time duration is different from the fourth time duration. ### Claim 14 (depends on 11) The non-transitory storage medium of claim 11, wherein the computer-executable instructions, when executed by the at least one processor, cause the electronic device to provide, based on the generating the first timeout, a visual indication indicating a transition to a sleep mode. ### Claim 15 (depends on 11) The non-transitory storage medium of claim 11, wherein the computer-executable instructions, when executed by the at least one processor, cause the electronic device to provide, based on the generating the second timeout, a visual indication indicating a transition to a sleep mode. ### Claim 16 (depends on 11) The non-transitory storage medium of claim 11, wherein the computer-executable instructions, when executed by the at least one processor, cause the electronic device to, based on the second speech signal being obtained via the microphone and prior to the generating the third timeout, display, on the display, a text phrase indicating a transition to a listening mode. ### Claim 17 (depends on 11) The non-transitory storage medium of claim 11, wherein the computer-executable instructions, when executed by the at least one processor, cause the electronic device to, based on the third speech signal being obtained via the microphone and prior to the generating the fourth timeout, display, on the display, a text phrase indicating a transition to a listening mode. ### Claim 18 (depends on 11) The non-transitory storage medium of claim 11, wherein the generating the third timeout includes providing a speech response, via the speaker, indicating no voice command being identified from the second speech signal. ### Claim 19 (depends on 11) The non-transitory storage medium of claim 11, wherein the generating the fourth timeout includes providing a visual feedback, via the display, indicating no voice command being identified from the third speech signal. ### Claim 20 (depends on 13) The non-transitory storage medium of claim 13, wherein the third time duration is longer than the fourth time duration.