# US 2014/0195241 A1 · Synchronizing the Playing and Displaying of Digital Content

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2014/0195241 A1
- Document ID: US20140195241A1
- Status: Published application
- Kind: A1
- Application number: 14/207,222
- Filed: 2014-03-12
- Published: 2014-07-10
- Earliest claimed: 2009-06-12
- Assignees: Amazon Technologies, Inc.
- Applicants: Amazon Technologies, Inc.
- Inventors: Laurent An Minh Nguyen; Edward James Gayles; Robert Wai-Chi Chu; Dennis Paul Fleming; Sailesh Rachabathuni; David Berbessou
- Web page: https://patentgrep.com/patent/US20140195241A1

## CPC

- G10L 13/00: Speech synthesis; Text to speech systems
- G10L 21/0356: for synchronising with other signals, e.g. video signals
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

The techniques disclosed herein allow a user to synchronize the playing and displaying of digital content on an electronic device. The device may render a first portion of digital content so it may be displayed. The device may also play a segment of the digital content as audio using text to speech software. The device may also render a second portion of digital content for display depending on whether the position of the last word read is greater than the last position in the first portion of digital content.

## Claims

### Claim at position 1

-20. (canceled)

### Claim 21

One or more non-transitory computer-readable media that include a plurality of instructions executable by one or more processors of a computing device to:
obtain digital content comprising text data and a plurality of markings;
cause a speaker of the computing device to output the speech audio corresponding to the digital content;
cause a display of the computing device to display a first portion of the text data while the speech audio is output by the speaker, wherein the display of the first portion of the text data is according to a first display property;
receive an input to change from the first display property to a second display property; and
responsive to receipt of the input, cause a second portion of the digital content to be displayed according to the second display property such that the second portion of the digital content corresponds to a currently playing portion of the speech audio.

### Claim 22 (depends on 21)

The one or more non-transitory computer-readable media of claim 21, wherein the plurality of instructions are further executable by the one or more processors of the computing device to:
identify, based at least on the plurality of markings of the digital content, a word of the text data that corresponds to the currently playing portion of the speech audio; and
determine an initial portion of the digital content displayed according to the second display property such that the initial portion begins with the word.

### Claim 23 (depends on 21)

The one or more non-transitory computer-readable media of claim 21, wherein the first display property and the second display property are one of:
a first font size and a second font size, respectively, or
a first screen orientation and a second screen orientation, respectively.

### Claim 24 (depends on 21)

The non-transitory computer-readable media of claim 21, wherein the plurality of instructions are further executable by the one or more processors of the computing device to:
determine an initial portion of the digital content displayed according to the second display property based at least on an amount of time that the computing device takes to display a new portion of the digital content and a play speed of the speech audio.

### Claim 25 (depends on 21)

The one or more non-transitory computer-readable media of claim 21, wherein the text data includes a plurality of text units, ones of the text units including a plurality of words, and wherein the plurality of instructions are further executable by the one or more processors of the computing device to insert the plurality of markings between ones of the text units.

### Claim 26

An electronic device comprising:
one or more processors;
memory;
instructions stored in the memory, the instructions executable by the one or more processors to:
cause output of speech audio that corresponds to digital content;
cause a first portion of the digital content to be displayed on the electronic device;
receive input to change a display property of the digital content; and
responsive to receipt of the input, cause a second portion of the digital content to be displayed such that the second portion:
corresponds to a portion of the speech audio that is output at a time that the second portion of the digital content is displayed, and
is displayed according to the change in the display property.

### Claim 27 (depends on 26)

The electronic device of claim 26, wherein the instructions are further executable by the one or more processors to synthesize the speech audio from the digital content.

### Claim 28 (depends on 26)

The electronic device of claim 26, wherein the instructions are further executable by the one or more processors to determine the second portion such that a beginning of the second portion of the digital content corresponds to the speech audio that is output at the time that the second portion of the digital content is displayed.

### Claim 29 (depends on 26)

The electronic device of claim 26, wherein the instructions are further executable by the one or more processors to estimate the portion of the speech audio that is output at the time that the second portion of the digital content is displayed based at least on a speed of the speech audio output.

### Claim 30 (depends on 29)

The electronic device of claim 29, wherein the instructions are further executable by the one or more processors to estimate the portion of the speech audio that is output at the time that the second portion of the digital content is displayed further based at least on an amount of time that the electronic device takes to display portions of the digital content.

### Claim 31 (depends on 26)

The electronic device of claim 26, wherein the instructions are further executable by the one or more processors to:
insert markings into the digital content at a plurality of locations of the digital content;
synthesize the digital content to produce the speech audio; and
determine the second portion of the digital content based at least on identification of a particular marking of the digital content that corresponds to the portion of the speech audio that is output at the time that the second portion of the digital content is displayed.

### Claim 32 (depends on 31)

The electronic device of claim 31, wherein the instructions are further executable by the one or more processors to insert the markings between a plurality of display portions, the plurality of display portions including one or more of text units and images.

### Claim 33 (depends on 26)

The electronic device of claim 26, wherein the display property is one of a font size or a screen orientation.

### Claim 34

A method comprising:
causing an electronic device to display a first portion of digital content on a display of the electronic device;
causing speech audio corresponding to the digital content to be output to a speaker associated with the electronic device; and
causing the electronic device to display a second portion of the digital content on the display of the electronic device, the second portion being displayed in accordance with a changed display property and corresponding to a current portion of the speech audio.

### Claim 35 (depends on 34)

The method of claim 34, wherein the digital content includes text data, and the method further comprises generating the speech audio using text-to-speech conversion of the text data.

### Claim 36 (depends on 34)

The method of claim 34, further comprising estimating a location of the second portion of the digital content based at least on a play speed of the speech audio.

### Claim 37 (depends on 34)

The method of claim 34, further comprising:
inserting a plurality of markings into the digital content at a plurality of locations of the digital content;
causing the digital content to be synthesized into the speech audio; and
identifying the second portion of the digital content based at least on determining a particular location of the digital content having a particular one of the plurality of markings that corresponds to the current portion of the speech audio.

### Claim 38 (depends on 34)

The method of claim 34, wherein the digital content includes text data, the method further comprising:
synthesizing the text data into the speech audio;
determining a word of the text data that is most recently synthesized into the speech audio; and
determining the second portion based at least on a location of the word within the digital content.

### Claim 39 (depends on 34)

The method of claim 34, wherein the digital content includes text data, and wherein the display property change results in a change in a number of text characters displayable on the display at a single time.

### Claim 40 (depends on 39)

The method of claim 39, wherein the display property is a font size of the text data.
