US 12,755,645 B2 · Technology and systems to develop reading fluency through an interactive, multi-sensory reading experience

Abstract

Technology and systems to develop reading fluency through an interactive, multi-sensory reading experience, include a computing platform that receives position data associated with motion of a user, periodically computes position, speed, and direction of the motion of the user based on the position data, correlates the position and the direction to a sequence of pronounceable characters of a textual passage presented to the user, and performs an action with respect to the sequence of pronounceable characters, contemporaneous with the motion of the user, based on the correlation. The action may include audibly presenting the sequence of pronounceable characters contemporaneous with the motion of the user and/or visually accentuating the sequence of pronounceable characters contemporaneous with the motion of the user. The computing platform may visually demarcate sections of the textual passage to indicate where a reader is to pause or slow down.

Claims20

Dependent claims

A non-transitory computer readable medium encoded with a computer program comprising instructions to cause a processor to:

identify user-selected pronounceable characters within material presented to a user based on a stream of 2-dimensional position data associated with the user;
audibly present the user-selected pronounceable characters as an audible presentation contemporaneous with motion of the user, wherein the audible presentation comprises one or more of pre-recorded human voice and synthesized speech;
periodically determine a difference between the 2-dimensional position data and a current point of the audible presentation;
smooth the differences between the 2-dimensional position data and a current point of the audible presentation, over time, to provide a first smoothed difference;
adjust a rate of the audible presentation based on the first smoothed difference to provide a rate-adjusted audible presentation contemporaneous with the motion of the user;
and
alter a pitch of the rate-adjusted audible presentation to counter the adjusted rate of the audible presentation.

4 more elements

A method, comprising:

receiving a file and an audio file from a server, wherein the file comprises pronounceable characters and the audio file comprises pre-recorded human voice of the pronounceable characters;
displaying the pronounceable characters on a user device;
identifying user-selected pronounceable characters of the pronounceable characters displayed on the user device based on a stream of 2-dimensional position data associated with the user;
audibly presenting the user-selected pronounceable characters from the audio file, as an audible presentation, contemporaneous with motion of the user;
periodically determining a difference between the 2-dimensional position data and a current point of the audible presentation;
smoothing the differences over time to provide a smoothed difference;
adjusting a rate of the audible presentation based on the smoothed difference to provide a rate-adjusted audible presentation contemporaneous with the motion of the user;
and
altering a pitch of the rate-adjusted audible presentation to counter the adjusted rate of the audible presentation.

6 more elements

A system, comprising:

a user device comprising a processor and memory that stores instruction that, when executed by the processor, cause the processor to:
receive a file from a server, wherein the file comprises pronounceable characters;
display the pronounceable characters on the user device;
identify user-selected pronounceable characters of the pronounceable characters displayed on the user device based on a stream of 2-dimensional position data associated with the user;
audibly present synthesized audio of the user-selected pronounceable characters as a synthesized audible presentation at the user device, contemporaneous with motion of the user;
periodically determine a difference between the 2-dimensional position data and a current point of the synthesized audible presentation;
smooth the differences over time to provide a smoothed difference;
adjust a rate of the synthesized audible presentation based on the smoothed difference to provide a rate-adjusted synthesized audible presentation contemporaneous with the motion of the user;
and
alter a pitch of the rate-adjusted synthesized audible presentation based on the rate-adjusted synthesized audible presentation.

7 more elements

Dependencies are inferred from the claim text.

Technology and systems to develop reading fluency through an interactive, multi-sensory reading experience

Life of this patent

Technology and systems to develop reading fluency through an interactive, multi-sensory reading experience

Life of this patent

Abstract

Claims20