# US 12,192,570 B2 · Systems and methods for routing content to an associated output device > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,192,570 B2 - Document ID: US12192570B2 - Status: Granted - Kind: B2 - Application number: 17/828,406 - Filed: 2022-05-31 - Published: 2023-01-26 - Granted: 2025-01-07 - Earliest claimed: 2016-06-27 - Assignees: Amazon Technologies, Inc. - Applicants: Amazon Technologies, Inc. - Inventors: Soniya Jobanputra; Marcello Typrin; Mallory Trudell - Web page: https://patentgrep.com/patent/US12192570B2 ## CPC - H04N 21/439: Processing of audio elementary streams - G06F 3/165: {Management of the audio stream, e.g. setting of volume, audio stream path} - G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback} - G06F 16/3329: Natural language query formulation - G06F 40/35: Discourse or dialogue representation - G10L 25/51: for comparison or discrimination - H04N 21/25875: {involving end-user authentication (restricting access to computer systems by authenticating users using a predetermined code G06F21/33; arrangements for secret or secure communication including means for verifying the identity or authority of a user of the system H04L9/32; networks authentication protocols H04L63/08; authentication in wireless network security H04W12/06)} - H04N 21/4415: using biometric characteristics of the user, e.g. by voice recognition or fingerprint scanning {(cryptography using biological data H04L9/3231; authentication in networks using biometric H04L63/0861)} - H04N 21/4516: {involving client characteristics, e.g. Set-Top-Box type, software version or amount of memory available} - H04N 21/4518: {involving characteristics of one or more peripherals, e.g. peripheral type, software version, amount of memory available or display capabilities} - H04N 21/4751: {for defining user accounts, e.g. accounts for children} - H04N 21/835: Generation of protective data, e.g. certificates {(protecting software against unauthorised usage in a vending or licensing environment G06F21/10)} - H04N 21/8586: {by using a URL (processing chained hypermedia data for information retrieval G06F16/94; information retrieval from the Internet by using URLs G06F16/955; URL in broadcast information H04H20/93; Web-based protocols H04L67/02)} - G10L 15/26: Speech to text systems (G10L15/08 takes precedence) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING ## Abstract Devices and methods for routing content are provided herein. In some embodiments, a method for routing content include receiving audio data representing a command from a first electronic device, determining content that is associated with the command, sending responsive audio data to the first electronic device, and sending instructions to the second electronic device to output the content associated with the command. In some embodiments, a method for routing contents includes determining a state of the second electronic device and sending instructions to output the content to a selected one of the first and second electronic devices based on the state of the second electronic device. ## Claims ### Claim 1 A computer-implemented method, comprising: determining that first audio detected by a first device represents a first request to perform a first action; and after determining that the first audio represents the first request: determining that a second device, which is remote from the first device, is able to perform the first action when the second device is in a first operational state, determining that the second device is in a second operational state in which the second device is unable to perform the first action, based at least in part on the second device being in the second operational state, causing the first device to begin performance of the first action, after the first device has begun performance of the first action, determining that the second device has transitioned from the second operational state to the first operational state, and based at least in part on the second device having transitioned from the second operational state to the first operational state, causing the second device to perform the first action corresponding to the first request. ### Claim 2 (depends on 1) The computer-implemented method of claim 1, further comprising: determining that a user account is associated with the first device; and determining that the second device is associated with the user account, wherein causing the second device to perform the first action is further based on the user account being associated with the first device and the second device being associated with the user account. ### Claim 3 (depends on 2) The computer-implemented method of claim 2, further comprising: determining that the user account indicates a preference that the second device be used to perform actions of a same type as the first action; wherein causing the second device to perform the first action is further based on the preference. ### Claim 4 (depends on 1) The computer-implemented method of claim 1, further comprising: after determining that the second device is in the second operational state, instructing the second device to transition from the second operational state to the first operational state. ### Claim 5 (depends on 1) The computer-implemented method of claim 1, further comprising: causing the first device to output an indication that the second device is unable to perform the first action. ### Claim 6 A system, comprising: at least one processor; and at least one computer-readable medium encoded with instructions which, when executed by the at least one processor, cause the system to: determine that first audio detected by a first device represents a first request to perform a first action; and after determining that the first audio represents the first request: determine that a second device, which is remote from the first device, is able to perform the first action when the second device is in a first operational state, determine that the second device is in a second operational state in which the second device is unable to perform the first action, based at least in part on the second device being in the second operational state, cause the first device to begin performance of the first action, after the first device has begun performance of the first action, determine that the second device has transitioned from the second operational state to the first operational state, and based at least in part on the second device having transitioned from the second operational state to the first operational state, cause the second device to perform the first action. ### Claim 7 (depends on 6) The system of claim 6, wherein the at least one computer-readable medium is further encoded with additional instructions which, when executed by the at least one processor, further cause the system to: determine that a user account is associated with the first device; determine that the second device is associated with the user account; and cause the second device to perform the first action further based on the user account being associated with the first device and the second device being associated with the user account. ### Claim 8 (depends on 7) The system of claim 7, wherein the at least one computer-readable medium is further encoded with additional instructions which, when executed by the at least one processor, further cause the system to: determine that the user account indicates a preference that the second device be used to perform actions of a same type as the first action; and cause the second device to perform the first action further based on the preference. ### Claim 9 (depends on 6) The system of claim 6, wherein the at least one computer-readable medium is further encoded with additional instructions which, when executed by the at least one processor, further cause the system to: after determining that the second device is in the second operational state, instruct the second device to transition from the second operational state to the first operational state. ### Claim 10 (depends on 6) The system of claim 6, wherein the at least one computer-readable medium is further encoded with additional instructions which, when executed by the at least one processor, further cause the system to: cause the first device to output an indication that the second device is unable to perform the first action. ### Claim 11 (depends on 6) The system of claim 6, wherein the at least one computer-readable medium is further encoded with additional instructions which, when executed by the at least one processor, further cause the system to: based at least in part on the second device having transitioned from the second operational state to the first operational state, causing the first device to cease performing the first action. ### Claim 12 (depends on 6) The system of claim 6, wherein the at least one computer-readable medium is further encoded with additional instructions which, when executed by the at least one processor, further cause the system to: in response to determining that the second device has transitioned from the second operational state to the first operational state, sending first data to the first device that causes the first device to a prompt for an instruction to cause the second device to perform the first action; and determining that an input detected by the first device represents the instruction, wherein causing the second device to perform the first action is further based at least in part on the input representing the instruction. ### Claim 13 (depends on 12) The system of claim 12, wherein the at least one computer-readable medium is further encoded with additional instructions which, when executed by the at least one processor, further cause the system to: the first data comprises first audio data; and in input comprises an audio input detected by the first device. ### Claim 14 (depends on 12) The system of claim 12, wherein the at least one computer-readable medium is further encoded with additional instructions which, when executed by the at least one processor, further cause the system to: based at least in part on the second device being in the second operational state, and prior to determining that the second device has transitioned from the second operational state to the first operational state, sending second data to the first device that causes the first device to output an indication that the second device is currently unable to perform the first action. ### Claim 15 (depends on 1) The computer-implemented method of claim 1, further comprising: based at least in part on the second device having transitioned from the second operational state to the first operational state, causing the first device to cease performing the first action. ### Claim 16 (depends on 1) The computer-implemented method of claim 1, further comprising: in response to determining that the second device has transitioned from the second operational state to the first operational state, sending first data to the first device that causes the first device to a prompt for an instruction to cause the second device to perform the first action; and determining that an input detected by the first device represents the instruction, wherein causing the second device to perform the first action is further based at least in part on the input representing the instruction. ### Claim 17 (depends on 16) The computer-implemented method of claim 16, wherein: the first data comprises first audio data; and in input comprises an audio input detected by the first device. ### Claim 18 (depends on 16) The computer-implemented method of claim 16, further comprising: based at least in part on the second device being in the second operational state, and prior to determining that the second device has transitioned from the second operational state to the first operational state, sending second data to the first device that causes the first device to output an indication that the second device is currently unable to perform the first action.