# US 12,003,575 B2 · Routing of sensitive-information utterances through secure channels in interactive voice sessions > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,003,575 B2 - Document ID: US12003575B2 - Status: Granted - Kind: B2 - Application number: 17/652,057 - Filed: 2022-02-22 - Published: 2023-08-24 - Granted: 2024-06-04 - Earliest claimed: 2022-02-22 - Assignees: Optum, Inc. - Applicants: Optum, Inc. - Inventors: Devikiran Ramadas; Ninad D. Sathaye; Gregory J. Boss; Raghav Bali - Web page: https://patentgrep.com/patent/US12003575B2 ## CPC - H04L 67/10: in which an application is distributed across nodes in the network (software deployment G06F8/60; multiprogramming arrangements G06F9/46) - G10L 15/1815: {Semantic context, e.g. disambiguation of the recognition hypotheses based on word meaning} - G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue - G10L 15/30: Distributed recognition, e.g. in client-server systems, for mobile phones or network applications - G10L 25/72: for transmitting results of analysis - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) - G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING ## Abstract An example method includes obtaining first audio data representing one or more initial utterances during an interactive voice session with an interactive voice system (IVS); generating, based on the first audio data, a prediction regarding whether a subsequent utterance of the user in the interactive voice session will contain sensitive information; obtaining second audio data representing the subsequent utterance; determining, based on the prediction, whether to transmit the second audio data to the IVS via a first communication channel; based on a determination not to transmit the second audio data to the IVS via the first communication channel: transmitting third audio data to the IVS via the first communication channel in place of the second audio data; and transmitting the second audio data to a server via a second communication channel that bypasses the IVS. ## Claims ### Claim 1 A computer-implemented method comprising: obtaining, by one or more processors of a first computing system, first audio data representing one or more initial utterances during an interactive voice session with an interactive voice system that interacts with a server to obtain content to provide to a user during the interactive voice session, wherein the interactive voice system is configured to execute on a second computing system and the server is configured to execute on a third computing system; transmitting, by the one or more processors of the first computing system, the first audio data to the interactive voice system via a first communication channel; generating, by the one or more processors of the first computing system, based on the first audio data, a prediction that a second audio data representing a subsequent utterance of the user in the interactive voice session will contain sensitive information, wherein the subsequent utterance follows the one or more initial utterances in time; upon obtaining, by the one or more processors of the first computing system, the second audio data that includes the sensitive information: transmitting, by the one or more processors of the first computing system, third audio data to the interactive voice system via the first communication channel in place of the second audio data, wherein the third audio data represents data that replaces the sensitive information; and transmitting, by the one or more processors of the first computing system, the second audio data to the server via a second communication channel that bypasses the interactive voice system. ### Claim 2 (depends on 1) The computer-implemented method of claim 1, wherein: the interactive voice system is configured to provide semantic content of the third audio data to the server, and the server is configured to determine that the semantic content of the third audio data corresponds to the second audio data and perform an action based on the second audio data instead of the third audio data. ### Claim 3 (depends on 2) The computer-implemented method of claim 2, further comprising: sending, by the one or more processors of the first computing system, the third audio data to the server via the second communication channel, and causing the server to (1) generate a mapping of the second audio data and the semantic content of the third audio data, and (2) determine, based on the mapping, that the semantic content of the third audio data corresponds to the second audio data. ### Claim 4 (depends on 1) The computer-implemented method of claim 1, wherein the third audio data is based on a voice of the user. ### Claim 5 (depends on 1) The computer-implemented method of claim 1, further comprising: obtaining, by the one or more processors of the first computing system, a timed volatile random subset (t-VRS) for the interactive voice session from the server; and generating, by the one or more processors of the first computing system, the third audio data based on words in the t-VRS for the interactive voice session. ### Claim 6 A computing system comprising: memory; and one or more processors implemented in circuitry and communicatively coupled to the memory, the one or more processors configured to: obtain first audio data representing one or more initial utterances during an interactive voice session with an interactive voice system and that interacts with a server to obtain content to provide to a user during the interactive voice session, wherein the computing system is a first computing system, the interactive voice system is configured to execute on a second computing system and the server is configured to execute on a third computing system; transmit the first audio data to the interactive voice system via a first communication channel; generate, based on the first audio data, a prediction that a second audio data representing a subsequent utterance of the user in the interactive voice session will contain sensitive information, wherein the subsequent utterance follows the one or more initial utterances in time; upon obtaining the second audio data that includes the sensitive information: transmit third audio data to the interactive voice system via the first communication channel in place of the second audio data, wherein the third audio represents data that replaces the sensitive information; and transmit, the second audio data to the server via a second communication channel that bypasses the interactive voice system. ### Claim 7 (depends on 6) The computing system of claim 6, wherein the server comprises an application configured to operate on the third computing system. ### Claim 8 (depends on 6) The computing system of claim 6, wherein: the interactive voice system is configured to provide semantic content of the third audio data, and the server is configured to determine that the semantic content of the third audio data corresponds to the second audio data and perform an action based on the second audio data instead of the third audio data. ### Claim 9 (depends on 8) The computing system of claim 8, wherein: the one or more processors are further configured to send the third audio data to the server via the second communication channel, causing the server to (1) generate a mapping of the second audio data and the semantic content of the third audio data, and (2) determine, based on the mapping, that the semantic content of the third audio data corresponds to the second audio data. ### Claim 10 (depends on 6) The computing system of claim 6, wherein the third audio data is based on a voice of the user. ### Claim 11 (depends on 6) The computing system of claim 6, wherein the interactive voice system is a voice assistant system. ### Claim 12 (depends on 6) The computing system of claim 6, wherein the one or more processors of the first computing system are further configured to: obtain a timed volatile random subset (t-VRS) for the interactive voice session from the server; and generate the third audio data based on words in the t-VRS for the interactive voice session. ### Claim 13 (depends on 12) The computing system of claim 12, wherein the one or more processors are further configured to receive refreshed t-VRS's from the server at configured intervals or in response to an event. ### Claim 14 One or more non-transitory computer-readable storage media including instructions that, when executed by the one or more processors, cause the one or more processors of a first computing system to: obtain first audio data representing one or more initial utterances during an interactive voice session with an interactive voice system that interacts with a server to obtain content to provide to a user during the interactive voice session, wherein the interactive voice system is configured to execute on a second computing system and the server is configured to execute on a third computing system; transmit the first audio data to the interactive voice system via a first communication channel; generate, based on the first audio data, a prediction that a second audio data representing a subsequent utterance of the user in the interactive voice session will contain sensitive information, wherein the subsequent utterance follows the one or more initial utterances in time; upon obtaining the second audio data that includes the sensitive information: transmit third audio data to the interactive voice system via the first communication channel in place of the second audio data, wherein the third audio data represents data that replaces the sensitive information; and transmit the second audio data to the server via a second communication channel that bypasses the interactive voice system. ### Claim 15 (depends on 14) The one or more non-transitory computer-readable storage media of claim 14, wherein the instructions further cause the one or more processors of the computing system to: obtain a timed volatile random subset (t-VRS) for the interactive voice session from the server; and generate the third audio data based on words in the t-VRS for the interactive voice session. ### Claim 16 (depends on 14) The one or more non-transitory computer-readable storage media of claim 14, wherein the third audio data is based on a voice of the user.