# US 12,190,885 B2 · Configurable output data formats > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,190,885 B2 - Document ID: US12190885B2 - Status: Granted - Kind: B2 - Application number: 18/369,291 - Filed: 2023-09-18 - Published: 2024-03-07 - Granted: 2025-01-07 - Earliest claimed: 2017-06-01 - Assignees: Amazon Technology, Inc. - Applicants: Amazon Technologies, Inc. - Inventors: Rohan Mutagi; Felix Wu; Rongzhou Shen; Neelam Satish Agrawal; Vibhunandan Gavini; Pablo Carballude Gonzalez - Web page: https://patentgrep.com/patent/US12190885B2 ## CPC - G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue - G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback} - G06F 16/00: Information retrieval; Database structures therefor; File system structures therefor - G06F 16/635: Filtering based on additional data, e.g. user or group profiles - G10L 13/08: Text analysis or generation of parameters for speech synthesis out of text, e.g. grapheme to phoneme translation, prosody generation or stress or intonation determination - G10L 15/1815: {Semantic context, e.g. disambiguation of the recognition hypotheses based on word meaning} - G10L 15/30: Distributed recognition, e.g. in client-server systems, for mobile phones or network applications - G10L 17/22: Interactive procedures; Man-machine interfaces - G10L 13/00: Speech synthesis; Text to speech systems - G10L 15/00: Speech recognition (G10L17/00 takes precedence) - G10L 2015/223: {Execution procedure of a spoken command} - G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract Configurable core domains of a speech processing system are described. A core domain output data format for a given command is originally configured with default content portions. When a user indicates additional content should be output for the command, the speech processing system creates a new output data format for the core domain. The new output data format is user specific and includes both default content portions as well as user preferred content portions. ## Claims ### Claim 1 A computer-implemented method, comprising: receiving input data representing a natural language command; performing natural language processing using the input data to determine first data corresponding to a default content source; determining that output responsive to the natural language command is to include first content corresponding to a default content source; identifying a profile associated with the input data; determining that the profile is associated with an additional content source; determining, based at least in part on the profile being associated with the additional content source, that the output is to additionally include second content corresponding to the additional content source; receiving second data responsive to the natural language command, the second data corresponding to the additional content source; and based at least in part on the first data and the second data, causing the output to include at least the first content of the default content source and the second content of the additional content source. ### Claim 2 (depends on 1) The computer-implemented method of claim 1, wherein the additional content source is configured to provide output data in response to a natural language input. ### Claim 3 (depends on 1) The computer-implemented method of claim 1, further comprising: determining a category of the natural language command, wherein determining that the output is to additionally include the second content of the additional content source is based at least in part on the category. ### Claim 4 (depends on 1) The computer-implemented method of claim 1, further comprising: the default content source is associated with a first domain of a natural language processing system; and the additional content source is associated with a second domain of the natural language processing system. ### Claim 5 (depends on 1) The computer-implemented method of claim 1, wherein: the first data comprises first text data; and the second data comprises second text data. ### Claim 6 (depends on 1) The computer-implemented method of claim 1, further comprising: sending, to the additional content source, context data corresponding to the profile. ### Claim 7 (depends on 1) The computer-implemented method of claim 1, further comprising: determining a geographic location corresponding to the natural language command; and determining the additional content source based at least in part on the geographic location. ### Claim 8 (depends on 1) The computer-implemented method of claim 1, wherein performing natural language processing using the input data to determine first data corresponding to a default content source is based at least in part on the profile. ### Claim 9 (depends on 1) The computer-implemented method of claim 1, further comprising: generating an output data format including a first slot to be populated with content from the default content source and a second slot to be populated with content from the additional content source; and configuring output data corresponding to the output data format, the output data including the first data in the first slot and the second data in the second slot, wherein causing the output uses the output data. ### Claim 10 (depends on 1) The computer-implemented method of claim 1, further comprising: performing speech synthesis using the first data and the second data to determine audio data, wherein causing the output uses the audio data. ### Claim 11 A system comprising: at least one processor; and at least one memory comprising instructions that, when executed by the at least one processor, cause the system to: receive input data representing a natural language command; perform natural language processing using the input data to determine first data corresponding to a default content source; determine that output responsive to the natural language command is to include first content corresponding to a default content source; identify a profile associated with the input data; determine that the profile is associated with an additional content source; determine, based at least in part on the profile being associated with the additional content source, that the output is to additionally include second content corresponding to the additional content source; receive second data responsive to the natural language command, the second data corresponding to the additional content source; and based at least in part on the first data and the second data, cause the output to include at least the first content of the default content source and the second content of the additional content source. ### Claim 12 (depends on 11) The system of claim 11, wherein the additional content source is configured to provide output data in response to a natural language input. ### Claim 13 (depends on 11) The system of claim 11, wherein the at least one memory further comprises instructions that, when executed by the at least one processor, further cause the system to: determine a category of the natural language command, wherein the instructions that cause the system to determine that the output is to additionally include the second content of the additional content source are based at least in part on the category. ### Claim 14 (depends on 11) The system of claim 11, wherein: the default content source is associated with a first domain of a natural language processing system; and the additional content source is associated with a second domain of the natural language processing system. ### Claim 15 (depends on 11) The system of claim 11, wherein: the first data comprises first text data; and the second data comprises second text data. ### Claim 16 (depends on 11) The system of claim 11, wherein the at least one memory further comprises instructions that, when executed by the at least one processor, further cause the system to: send, to the additional content source, context data corresponding to the profile. ### Claim 17 (depends on 11) The system of claim 11, wherein the at least one memory further comprises instructions that, when executed by the at least one processor, further cause the system to: determine a geographic location corresponding to the natural language command; and determine the additional content source based at least in part on the geographic location. ### Claim 18 (depends on 11) The system of claim 11, wherein the instructions that cause the system to perform natural language processing using the input data to determine first data corresponding to a default content source are based at least in part on the profile. ### Claim 19 (depends on 11) The system of claim 11, wherein the at least one memory further comprises instructions that, when executed by the at least one processor, further cause the system to: generate an output data format including a first slot to be populated with content from the default content source and a second slot to be populated with content from the additional content source; and configure output data corresponding to the output data format, the output data including the first data in the first slot and the second data in the second slot, wherein the instructions that cause the system to cause the output use the output data. ### Claim 20 (depends on 11) The system of claim 11, wherein the at least one memory further comprises instructions that, when executed by the at least one processor, further cause the system to: perform speech synthesis using the first data and the second data to determine audio data, wherein the instructions that cause the system to cause the output use the audio data.