Back to results
US 11,443,646 B2Granted
E-Reader interface system with audio and highlighting synchronization for digital books
AssigneeFathom Technologies, LLC
InventorLee B. German
Life of this patent
Estimating the term…
Abstract
The present invention is directed to systems and methods for providing an improved interactive and educational eBook platform through an improved eReader. The system provides a platform through which a book is transformed into an interactive, multi-language, assisted reading, read-aloud eBook and is displayed in an eReader with an improved graphical user interface that provides features which enhance the effectiveness of eBook learning.
Claims20
A method for an improved eReader interface, comprising:
- receiving text and audio, wherein the text includes at least two language sets of text, and wherein the audio includes at least two language sets of audio;
- deriving keyframes for the audio via force alignment of the audio to the text, wherein the keyframes indicate beginning keyframes and ending keyframes for spoken words, spoken characters, spoken sentences, or spoken sentence fragments corresponding to words, characters, sentences, or sentence fragments of the text;
- receiving a selection of a language set of the at least two language sets of text as a primary language text;
- displaying the primary language text across a spread of pages on a graphical user interface (GUI), the spread of pages including at least a first page and a second page displayed simultaneously;
- providing highlighting preference options via the GUI, wherein the highlighting preference options include selections for word or character highlighting, sentence highlighting, and sentence fragment highlighting;
- receiving a selection of one of the highlighting preference options;
- automatically inserting non-printing characters between at least two words, at least two characters, at least two sentences, or at least two sentence fragments of the primary language text, wherein the non-printing characters do not increase a distance between the respective words, characters, sentences, or sentence fragments of the primary language text on the GUI, and wherein the non-printing characters are not visible via the GUI;
- outputting computer-readable code that separates the primary language text into separate highlightable elements based on the non-printing characters;
- initiating playback of the audio to play the audio;
- while playing the audio:
- determining a current portion of the primary language text based on a current instance of time;
- and
- highlighting the current portion of the primary language text according to the selected highlighting preference option and the keyframes, wherein the highlighting and the audio playing occurs based on the selected language set of the at least two language sets of text and a corresponding language set of the at least two language sets of audio;
- creating an alternate language dynamic text container, wherein the alternate language dynamic text container displays an alternate language text corresponding to an alternate selected language set of the at least two language sets of text, and wherein the alternate language text corresponds to a translation of the primary language text displayed on the first page of the spread of pages;
- highlighting a corresponding highlightable element of the alternate language text at the same time as each highlightable element of the primary language text is highlighted during the audio playback;
- while a highlightable element of the primary language text on the first page is highlighted, automatically positioning the alternate language dynamic text container in a first position over the primary language text displayed on the second page such that the alternate language dynamic text container does not overlap with the highlighted primary language text displayed on the first page;
- following completion of the highlighting and the audio playing for the primary language text displayed on the first page of the spread of pages:
- continuing the highlighting and the audio playing of the primary language text displayed on the second page of the spread of pages;
- and
- automatically repositioning the alternate language dynamic text container in a second position over the primary language text displayed on the first page of the spread of pages such that the alternate language dynamic text container does not overlap with the highlighted primary language text displayed on the second page;
- receiving a word selection, a character selection, a sentence selection, a graphic selection or a sentence fragment selection;
- highlighting the words, the characters, the sentences, the graphic, or the sentence fragments based on the word selection, the character selection, the sentence selection, the graphic selection, or the sentence fragment selection;
- and
- playing audio corresponding to the word selection, the character selection, the sentence selection, the graphic selection, or the sentence fragment selection based on the keyframes.
21 more elements
A system for an improved eReader interface, comprising:
- a memory;
- and
- a processor coupled with the memory, wherein the processor is operable to:
- receive text and audio, wherein the text includes at least two language sets of text, and wherein the audio includes at least two language sets of audio;
- derive keyframes for the audio via force alignment of the audio to the text, wherein the keyframes indicate beginning keyframes and ending keyframes for spoken words, spoken characters, spoken sentences, or spoken sentence fragments corresponding to words, characters, sentences, or sentence fragments of the text;
- receive a selection of a language set of the at least two language sets of text as a primary language text;
- display the primary language text across a spread of pages on a graphical user interface (GUI), the spread of pages including at least a first page and a second page displayed simultaneously;
- provide highlighting preference options via the GUI, wherein the highlighting preference options include selections for word or character highlighting, sentence highlighting, and sentence fragment highlighting;
- receive a selection of one of the highlighting preference options;
- automatically insert non-printing characters between at least two words, at least two characters, at least two sentences, or at least two sentence fragments of the primary language text, wherein the non-printing characters do not increase a distance between the respective words, characters, sentences, or sentence fragments of the primary language text on the GUI, and wherein the non-printing characters are not visible via the GUI;
- output computer-readable code that separates the primary language text into separate highlightable elements based on the non-printing characters;
- initiate playback of the audio to play the audio;
- while playing the audio:
- determine a current portion of the primary language text based on a current instance of time;
- and
- highlight the current portion of the primary language text, wherein the highlighting and the audio playing occurs based on the selected language set of the at least two language sets of text and a corresponding language set of the at least two language sets of audio;
- create an alternate language dynamic text container, wherein the alternate language dynamic text container displays an alternate language text corresponding to an alternate selected language set of the at least two language sets of text, and wherein the alternate language text corresponds to a translation of the primary language text displayed on the first page of the spread of pages;
- highlight a corresponding highlightable element of the alternate language text at the same time as each highlightable element of the primary language text is highlighted during the audio playback;
- while a highlightable element of the primary language text on the first page is highlighted, automatically position the alternate language dynamic text container in a first position over the primary language text displayed on the second page such that the alternate language dynamic text container does not overlap with the highlighted primary language text displayed on the first page;
- following completion of the highlighting and the audio playing for the primary language text displayed on the first page of the spread of pages:
- continue the highlighting and the audio playing of the primary language text displayed on the second page of the spread of pages;
- and
- automatically reposition the alternate language dynamic text container in a second position over the primary language text displayed on the first page of the spread of pages such that the alternate language dynamic text container does not overlap with the highlighted primary language text displayed on the second page;
- receive a word selection, a character selection, a sentence selection, a graphic selection or a sentence fragment selection;
- highlight the words, the characters, the sentences, the graphic, or the sentence fragments based on the word selection, the character selection, the sentence selection, the graphic selection, or the sentence fragment selection;
- and
- play audio corresponding to the word selection, the character selection, the sentence selection, the graphic selection, or the sentence fragment selection based on the keyframes.
24 more elements
Dependencies are inferred from the claim text.