# US 2025/0097168 A1 · Voice wrapper(s) for existing third-party text-based chatbot(s)

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0097168 A1
- Document ID: US20250097168A1
- Status: Published application
- Kind: A1
- Application number: 18/370,239
- Filed: 2023-09-19
- Published: 2025-03-20
- Earliest claimed: 2023-09-19
- Assignees: Google Inc.
- Applicants: Google LLC
- Inventors: Sasha Goldshtein; Yoav Tzur; Shlomo Fruchter; Gal Moshitch; ChiTa Tsai; Sharon Sultan
- Web page: https://patentgrep.com/patent/US20250097168A1

## CPC

- H04L 51/02: using automatic reactions or user delegation, e.g. automatic replies or chatbot-generated messages
- G10L 13/00: Speech synthesis; Text to speech systems
- G10L 13/08: Text analysis or generation of parameters for speech synthesis out of text, e.g. grapheme to phoneme translation, prosody generation or stress or intonation determination
- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L 15/26: Speech to text systems (G10L15/08 takes precedence)
- G10L 2015/225: {Feedback of the input speech}
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

Implementations are directed to providing a voice wrapper to an existing third-party text-based chatbot to enable the existing third-party text-based chatbot to engage in corresponding voice-based conversations. The voice wrapper can include a plurality of components. For instance, the voice wrapper can include a plurality of input components for utilization in responding to a spoken utterance, and in lieu of the existing third-party text-based chatbot, and/or to modify input to be provided to the existing third-party text-based chatbot in responding to the spoken utterance. Also, for instance, the voice wrapper can include a plurality of output components for utilization in responding to the spoken utterance, to reduce perceived latency of the existing third-party text-based chatbot, and/or to modify output generated by the existing third-party text-based chatbot in responding to the spoken utterance.

## Claims

### Claim 1

A method implemented by one or more processors, the method comprising:
receiving, from a first-party entity, a voice wrapper for an existing third-party text-based chatbot that is managed by a third-party entity, the third-party entity being distinct from the first-party entity, and the voice wrapper including a plurality of components that enable the existing third-party text-based chatbot to engage in corresponding voice-based conversations with corresponding human users; and
causing the existing third-party text-based chatbot to engage in a given voice-based conversation with a given human user via a client device of the given human user, wherein causing the existing third-party text-based chatbot to engage in the given voice-based conversation with the given human user comprises:
receiving audio data that captures a spoken utterance provided by the given human user;
determining, based on processing the audio data that captures the spoken utterance and using one or more of the plurality of components of the voice wrapper, whether to utilize the voice wrapper in responding to the spoken utterance or the existing third-party text-based chatbot in responding to the spoken utterance; and
in response to determining to utilize the voice wrapper in responding to the spoken utterance:
processing, using one or more of the plurality of components of the voice wrapper and without using the existing third-party text-based chatbot, the audio data that captures the spoken utterance to generate a voice wrapper response that is responsive to the spoken utterance; and
causing the voice wrapper response that is responsive to the spoken utterance to be audibly rendered for presentation to the given human user via one or more speakers of the client device of the given human user.

### Claim 2 (depends on 1)

The method of claim 1, wherein the spoken utterance is an interruption that interrupts a current response that is being audibly rendered for presentation to the given human user via the one or more speakers of the client device of the given human user, and wherein determining whether to utilize the voice wrapper in responding to the spoken utterance or the existing third-party text-based chatbot in responding to the spoken utterance based on processing the audio data that captures the spoken utterance and using one or more of the plurality of components of the voice wrapper comprises:
processing, using an automatic speech recognition (ASR) component, of the plurality of components, of the voice wrapper, the audio data that captures the spoken utterance to generate ASR output that corresponds to the spoken utterance;
processing, using an interruption component, of the plurality of components, of the voice wrapper, the ASR output, or natural language understanding (NLU) output, that is generated by the voice wrapper based on processing the ASR output, to determine a type of the interruption, from among a plurality of disparate types of interruptions; and
determining, based on the type of interruption, whether to utilize the voice wrapper in responding to the spoken utterance or the existing third-party text-based chatbot in responding to the spoken utterance.

### Claim 3 (depends on 2)

The method of claim 2, wherein the plurality of disparate types of interruptions include at least a non-critical interruption and a critical interruption.

### Claim 4 (depends on 3)

The method of claim 3, wherein determining to utilize the voice wrapper in responding to the spoken utterance is in response to determining that the type of interruption is the non-critical interruption.

### Claim 5 (depends on 4)

The method of claim 4, wherein processing the audio data that captures the spoken utterance to generate the voice wrapper response that is responsive to the spoken utterance and using one or more of the plurality of components of the voice wrapper and without using the existing third-party text-based chatbot comprises:
processing, using a fulfillment component, of the plurality of components, of the voice wrapper, the ASR output and/or the NLU output, to generate the voice wrapper response that is responsive to the spoken utterance.

### Claim 6 (depends on 5)

The method of claim 5, wherein causing the voice wrapper response that is responsive to the spoken utterance to be audibly rendered for presentation to the given human user via the one or more speakers of the client device of the given human user comprises:
processing, using a text-to-speech (TTS) component, of the plurality of components, of the voice wrapper, the voice wrapper response to generate synthesized speech audio data that captures synthesized speech corresponding to an audible response for the voice wrapper response;
ceasing the current response from being audibly rendered for presentation to the given human user via the one or more speakers of the client device of the given human user; and
causing the audible response for the voice wrapper response that is responsive to the spoken utterance to be audibly rendered for presentation to the given human user via the one or more speakers of the client device of the given human user.

### Claim 7 (depends on 3)

The method of claim 3, wherein determining to utilize the existing third-party text-based in responding to the spoken utterance is in response to determining that the type of interruption is the critical interruption.

### Claim 8 (depends on 7)

The method of claim 7, further comprising:
in response to determining to utilize the existing third-party text-based chatbot in responding to the spoken utterance:
processing, using the existing third-party text-based chatbot, the ASR output generated by the voice wrapper to generate an existing third-party text-based chatbot response that is responsive to the spoken utterance;
ceasing the current response from being audibly rendered for presentation to the given human user via the one or more speakers of the client device of the given human user; and
causing the existing third-party text-based chatbot response that is responsive to the spoken utterance to be audibly rendered for presentation to the given human user via the one or more speakers of the client device of the given human user.

### Claim 9 (depends on 8)

The method of claim 8, wherein causing the existing third-party text-based chatbot response that is responsive to the spoken utterance to be audibly rendered for presentation to the given human user via the one or more speakers of the client device of the given human user comprises:
processing, using a text-to-speech (TTS) component, of the plurality of components, of the voice wrapper, the existing third-party text-based chatbot response to generate synthesized speech audio data that captures synthesized speech corresponding to an audible response for the existing third-party text-based chatbot response; and
causing the audible response for the existing third-party text-based chatbot response that is responsive to the spoken utterance to be audibly rendered for presentation to the given human user via the one or more speakers of the client device of the given human user.

### Claim 10 (depends on 8)

The method of claim 8, further comprising:
while the existing third-party text-based chatbot is processing the ASR output generated by the voice wrapper to generate the existing third-party text-based chatbot response that is responsive to the spoken utterance:
determining, using a latency component, from among the plurality of components, of the voice wrapper, to cause pre-cached content to be audibly rendered for presentation to the given human user via one or more speakers of the client device of the given human user; and
causing the pre-cached content to be audibly rendered for presentation to the given human user via the one or more speakers of the client device of the given human user.

### Claim 11 (depends on 1)

The method of claim 1, wherein determining whether to utilize the voice wrapper in responding to the spoken utterance or the existing third-party text-based chatbot in responding to the spoken utterance based on processing the audio data that captures the spoken utterance and using one or more of the plurality of components of the voice wrapper comprises:
processing, using an automatic speech recognition (ASR) component, of the plurality of components, of the voice wrapper, the audio data that captures the spoken utterance to generate ASR output that corresponds to the spoken utterance;
processing, using a disambiguation component, of the plurality of components, of the voice wrapper, the ASR output, or natural language understanding (NLU) output, that is generated by the voice wrapper based on processing the ASR output, to determine whether a need exists to disambiguate the spoken utterance; and
determining, based on whether the need exists to disambiguate the spoken utterance, whether to utilize the voice wrapper in responding to the spoken utterance or the existing third-party text-based chatbot in responding to the spoken utterance.

### Claim 12 (depends on 11)

The method of claim 11, wherein determining to utilize the voice wrapper in responding to the spoken utterance is in response to determining that the need exists to disambiguate the spoken utterance.

### Claim 13 (depends on 12)

The method of claim 12, wherein processing the audio data that captures the spoken utterance to generate the voice wrapper response that is responsive to the spoken utterance and using one or more of the plurality of components of the voice wrapper and without using the existing third-party text-based chatbot comprises:
processing, using a fulfillment component, of the plurality of components, of the voice wrapper, the ASR output and/or the NLU output, to generate the voice wrapper response that is responsive to the spoken utterance.

### Claim 14 (depends on 13)

The method of claim 13, wherein causing the voice wrapper response that is responsive to the spoken utterance to be audibly rendered for presentation to the given human user via the one or more speakers of the client device of the given human user comprises:
processing, using a text-to-speech (TTS) component, of the plurality of components, of the voice wrapper, the voice wrapper response to generate synthesized speech audio data that captures synthesized speech corresponding to an audible response for the voice wrapper response; and
causing the audible response for the voice wrapper response that is responsive to the spoken utterance to be audibly rendered for presentation to the given human user via the one or more speakers of the client device of the given human user.

### Claim 15 (depends on 11)

The method of claim 11, wherein determining to utilize the existing third-party text-based in responding to the spoken utterance is in response to determining that the need does not exist to disambiguate the spoken utterance.

### Claim 16 (depends on 15)

The method of claim 15, further comprising:
in response to determining to utilize the existing third-party text-based chatbot in responding to the spoken utterance:
processing, using the existing third-party text-based chatbot, the ASR output generated by the voice wrapper to generate an existing third-party text-based chatbot response that is responsive to the spoken utterance; and
causing the existing third-party text-based chatbot response that is responsive to the spoken utterance to be audibly rendered for presentation to the given human user via the one or more speakers of the client device of the given human user.

### Claim 17 (depends on 16)

The method of claim 16, wherein causing the existing third-party text-based chatbot response that is responsive to the spoken utterance to be audibly rendered for presentation to the given human user via the one or more speakers of the client device of the given human user comprises:
processing, using a text-to-speech (TTS) component, of the plurality of components, of the voice wrapper, the existing third-party text-based chatbot response to generate synthesized speech audio data that captures synthesized speech corresponding to an audible response for the existing third-party text-based chatbot response; and
causing the audible response for the existing third-party text-based chatbot response that is responsive to the spoken utterance to be audibly rendered for presentation to the given human user via the one or more speakers of the client device of the given human user.

### Claim 18 (depends on 1)

The method of claim 1, wherein the plurality of components of the voice wrapper include a plurality of input components and a plurality of output components.

### Claim 19

A method implemented by one or more processors, the method comprising:
receiving, from a first-party entity, a voice wrapper for an existing third-party text-based chatbot that is managed by a third-party entity, the third-party entity being distinct from the first-party entity, and the voice wrapper including a plurality of components to enable the existing third-party text-based chatbot to engage in corresponding voice-based conversations with corresponding human users; and
causing the existing third-party text-based chatbot to engage in a given voice-based conversation with a given human user via a client device of the given human user, wherein causing the existing third-party text-based chatbot to engage in the given voice-based conversation with the given human user comprises:
receiving audio data that captures a spoken utterance provided by the given human user;
processing, using an automatic speech recognition (ASR) component, from among the plurality of components, of the voice wrapper, the audio data that captures the spoken utterance to generate ASR output;
determining, based on the ASR output, or natural language understanding (NLU) output, that is generated by the voice wrapper based on processing the ASR output, whether to generate voice wrapper output that is based on the ASR output but differs from the ASR output; and
in response to determining to generate the voice wrapper output that is based on the ASR output but differs from the ASR output:
processing, using a modification component, from among the plurality of components, of the voice wrapper, the ASR output to generate the voice wrapper output that is based on the ASR output but differs from the ASR output;
processing, using the existing third-party text-based chatbot, the voice wrapper output to generate an existing third-party text-based chatbot response that is responsive to the spoken utterance; and
causing the existing third-party text-based chatbot response that is responsive to the spoken utterance to be audibly rendered for presentation to the given human user via one or more speakers of the client device of the given human user.

### Claim 20

A system comprising:
one or more hardware processors; and
memory storing instructions that, when executed by the one or more hardware processors, the one or more hardware processors are operable to:
receive, from a first-party entity, a voice wrapper for an existing third-party text-based chatbot that is managed by a third-party entity, the third-party entity being distinct from the first-party entity, and the voice wrapper including a plurality of components that enable the existing third-party text-based chatbot to engage in corresponding voice-based conversations with corresponding human users; and
cause the existing third-party text-based chatbot to engage in a given voice-based conversation with a given human user via a client device of the given human user, wherein, in causing the existing third-party text-based chatbot to engage in the given voice-based conversation with the given human user, the one or more hardware processors are operable to:
receive audio data that captures a spoken utterance provided by the given human user;
determine, based on processing the audio data that captures the spoken utterance and using one or more of the plurality of components of the voice wrapper, whether to utilize the voice wrapper in responding to the spoken utterance or the existing third-party text-based chatbot in responding to the spoken utterance; and
in response to determining to utilize the voice wrapper in responding to the spoken utterance:
process, using one or more of the plurality of components of the voice wrapper and without using the existing third-party text-based chatbot, the audio data that captures the spoken utterance to generate a voice wrapper response that is responsive to the spoken utterance; and
cause the voice wrapper response that is responsive to the spoken utterance to be audibly rendered for presentation to the given human user via one or more speakers of the client device of the given human user.
