# US 2026/0088013 A1 · Method and system for user-interface adaptation of text-to-speech synthesis

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0088013 A1
- Document ID: US20260088013A1
- Status: Published application
- Kind: A1
- Application number: 19/404,800
- Filed: 2025-12-01
- Published: 2026-03-26
- Earliest claimed: 2025-12-01
- Assignees: Google Inc.
- Applicants: Google LLC
- Inventors: Ajit NARAYANAN
- Web page: https://patentgrep.com/patent/US20260088013A1

## CPC

- G10L 13/02: Methods for producing synthetic speech; Speech synthesisers
- G10L 13/033: Voice editing, e.g. manipulating the voice of the synthesiser
- G10L 13/08: Text analysis or generation of parameters for speech synthesis out of text, e.g. grapheme to phoneme translation, prosody generation or stress or intonation determination
- G10L 13/06: Elementary speech units used in speech synthesisers; Concatenation rules
- G10L 2013/105: {Duration}
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

A method and system is disclosed for adapting speech synthesis according to user-interface input. While synthesizing speech from a text segment with a text-to-speech (TTS) system and concurrently displaying the text segment in a display device, the system may receive tracking operation input tracking a portion of text undergoing synthesis and identifying a context portion of the text for which prior-synthesized speech has been synthesized at a canonical speech-pace. The tracking information may be used to adjust a speech-pace of TTS synthesis of the portion from the canonical speech-pace to an adapted speech-pace, and speech characteristics of synthesized speech of the portion may be adapted by applying both the adapted speech-pace and synthesized speech characteristics of the prior-synthesized speech of the context portion to TTS synthesis processing of the portion. The synthesized speech of the identified portion may be output at the adapted speech-pace and with the adapted speech characteristics.

## Claims

### Claim 1

A method comprising:
while synthesizing speech from a text segment with a text-to-speech (TTS) system and concurrently displaying the text segment in a display device, receiving input indicating a position and motion of a tracking operation relative to the displayed text segment in the display device;
using the indicated position of the tracking operation to identify both a portion of the text segment undergoing TTS synthesis processing at a time proximate to when the tracking operation input is received, and a context portion of the text segment;
using the indicated motion of the tracking operation to adjust a speech-pace of TTS synthesis of the identified portion from a canonical speech-pace to an adapted speech-pace determined based on the indicated motion;
outputting synthesized speech of the identified portion at the adapted speech-pace and with adapted speech characteristics based on the context portion; and
following outputting the synthesized speech of the identified portion at the adapted speech-pace and with the adapted speech characteristics, repeating output of the synthesized speech of the identified portion at the canonical speech-pace and with canonical speech characteristics in order to associate the repeated output with the synthesized speech at the adapted speech-rate and with the adapted speech characteristics.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
generating the synthesized speech of the identified portion by applying to TTS synthesis processing of the identified portion both the adapted speech-pace and synthesized speech characteristics of prior-synthesized speech of the context portion.

### Claim 3 (depends on 2)

The method of claim 2, wherein the speech characteristics of the prior-synthesized speech of the context portion comprise pitch and prosody of the prior-synthesized speech of the context portion.

### Claim 4 (depends on 3)

The method of claim 3, wherein applying to the TTS synthesis processing of the identified portion both the adapted speech-pace and synthesized speech characteristics of the prior-synthesized speech of the context portion comprises:
generating synthesized speech of the identified portion that is spoken at the adapted speech-pace, and with the pitch and prosody of the synthesized speech of the text of the identified portion continuous with the pitch and prosody of the synthesized speech of the text of the context portion.

### Claim 5 (depends on 2)

The method of claim 2, further comprising:
synthesizing the prior-synthesized speech of the context portion during a time interval prior to synthesizing speech of the portion.

### Claim 6 (depends on 1)

The method of claim 1, wherein receiving the tracking operation input comprises receiving input of a virtual pointing indicator via a user interface communicatively connected to, or part of, the display device, wherein the virtual pointing indicator being at least one of: a rendered cursor, haptic input of position and motion on a touch-screen, or input of eye-tracking position and motion of a user projected on a display screen.

### Claim 7 (depends on 1)

The method of claim 1, wherein receiving the input indicating the position and motion of the tracking operation in the display device relative to the displayed text segment in the display device comprises receiving, in real-time, tracking of position, velocity, and acceleration of the tracking operation relative to the displayed text segment.

### Claim 8 (depends on 1)

The method of claim 1, wherein using the indicated position of the tracking operation to identify the portion of the text segment undergoing TTS synthesis processing comprises:
using the position of the tracking operation to identify a language unit in the identified portion that is undergoing TTS synthesis processing,
wherein the language unit is at least one of: a phoneme, a word, a phrase, or a sentence corresponding to the text in the identified portion that is undergoing TTS synthesis processing.

### Claim 9 (depends on 1)

The method of claim 1, wherein the indicated motion of the tracking operation corresponds to real-time tracking of text in the identified portion at a tracking rate of word-by-word.

### Claim 10 (depends on 1)

The method of claim 1, wherein the indicated motion of the tracking operation corresponds to real-time tracking of text in the identified portion at a tracking rate of phoneme-by-phoneme.

### Claim 11 (depends on 1)

The method of claim 1, wherein concurrently displaying the text segment in the display device comprises:
displaying the text of the identified portion with visual clarity and focus; and
displaying the text of the text segment, other than the text of the identified portion, with visual defocusing, wherein visual defocusing comprises visual effects, the visual effects being at least one of fading, blurring, displaying with a different background or foreground color, changing font and/or font size, or excluding defocused text from a text box drawn around the identified portion.

### Claim 12

A system including a text-to-speech (TTS) system comprising:
one or more processors;
memory; and
machine-readable instructions stored in the memory, that upon execution by the one or more processors cause the system to carry out operations comprising:
while synthesizing speech from a text segment with the TTS system and concurrently displaying the text segment in a display device, receiving input indicating a position and motion of a tracking operation relative to the displayed text segment in the display device;
using the indicated position of the tracking operation to identify both a portion of the text segment undergoing TTS synthesis processing at a time proximate to when the tracking operation input is received, and a context portion of the text segment;
using the indicated motion of the tracking operation to adjust a speech-pace of TTS synthesis of the identified portion from a canonical speech-pace to an adapted speech-pace determined based on the indicated motion;
outputting synthesized speech of the identified portion at the adapted speech-pace and with adapted speech characteristics based on the context portion; and
following outputting the synthesized speech of the identified portion at the adapted speech-pace and with the adapted speech characteristics, repeating output of the synthesized speech of the identified portion at the canonical speech-pace and with canonical speech characteristics in order to associate the repeated output with the synthesized speech at the adapted speech-rate and with the adapted speech characteristics.

### Claim 13 (depends on 12)

The system of claim 12, wherein the operations further comprise:
generating the synthesized speech of the identified portion by applying to TTS synthesis processing of the identified portion both the adapted speech-pace and synthesized speech characteristics of prior-synthesized speech of the context portion.

### Claim 14 (depends on 13)

The system of claim 13, wherein the speech characteristics of the prior-synthesized speech of the context portion comprise pitch and prosody of the prior-synthesized speech of the context portion.

### Claim 15 (depends on 14)

The system of claim 14, wherein applying to the TTS synthesis processing of the identified portion both the adapted speech-pace and synthesized speech characteristics of the prior-synthesized speech of the context portion comprises:
generating synthesized speech of the identified portion that is spoken at the adapted speech-pace, and with the pitch and prosody of the synthesized speech of the text of the identified portion continuous with the pitch and prosody of the synthesized speech of the text of the context portion.

### Claim 16 (depends on 12)

The system of claim 12, wherein receiving the tracking operation input comprises receiving input of a virtual pointing indicator via a user interface communicatively connected to, or part of, the display device, wherein the virtual pointing indicator being at least one of: a rendered cursor, haptic input of position and motion on a touch-screen, or input of eye-tracking position and motion of a user projected on a display screen.

### Claim 17 (depends on 12)

The system of claim 12, wherein receiving the input indicating the position and motion of the tracking operation in the display device relative to the displayed text segment in the display device comprises receiving, in real-time, tracking of position, velocity, and acceleration of the tracking operation relative to the displayed text segment.

### Claim 18 (depends on 12)

The system of claim 12, wherein using the indicated position of the tracking operation to identify the portion of the text segment undergoing TTS synthesis processing comprises:
using the position of the tracking operation to identify a language unit in the identified portion that is undergoing TTS synthesis processing,
wherein the language unit is at least one of: a phoneme, a word, a phrase, or a sentence corresponding to the text in the identified portion that is undergoing TTS synthesis processing.

### Claim 19 (depends on 12)

The system of claim 12, wherein concurrently displaying the text segment in the display device comprises:
displaying the text of the identified portion with visual clarity and focus; and
displaying the text of the text segment, other than the text of the identified portion, with visual defocusing, wherein visual defocusing comprises visual effects, the visual effects being at least one of fading or blurring or displaying with a different background or foreground color.

### Claim 20

An article of manufacture including a non-transitory computer-readable storage medium having stored thereon program instructions that, upon execution by one or more processors of a system including a text-to-speech (TTS) system, cause the system to perform operations comprising:
while synthesizing speech from a text segment with the TTS system and concurrently displaying the text segment in a display device, receiving input indicating a position and motion of a tracking operation relative to the displayed text segment in the display device;
using the indicated position of the tracking operation to identify both a portion of the text segment undergoing TTS synthesis processing at a time proximate to when the tracking operation input is received, and a context portion of the text segment;
using the indicated motion of the tracking operation to adjust a speech-pace of TTS synthesis of the identified portion from a canonical speech-pace to an adapted speech-pace determined based on the indicated motion;
outputting synthesized speech of the identified portion at the adapted speech-pace and with adapted speech characteristics based on the context portion; and
following outputting the synthesized speech of the identified portion at the adapted speech-pace and with the adapted speech characteristics, repeating output of the synthesized speech of the identified portion at the canonical speech-pace and with canonical speech characteristics in order to associate the repeated output with the synthesized speech at the adapted speech-rate and with the adapted speech characteristics.
