Back to results
US 11,696,088 B1Granted
Method and apparatus to generate a six dimensional audio dataset
AssigneeOpic Technologies, Inc.
InventorsRobert Edwin Douglas, David Byron Douglas
Life of this patent
Estimating the term…
Abstract
This patent teaches a method and apparatus of an enhanced reading experience. This enables books to be brought to life by enhancing the reading experience by delivering sounds and visual effects at a precise timing based on eye tracking technology during the reading experience.
Claims20
A method of enhancing a first user's reading experience while said first user is reading a reading material comprising:
- using said reading material wherein said reading material is comprised of segments;
- generating, for said first user, a first dynamic sound file to accompany said reading material
- wherein said first dynamic sound file comprises segments, and
- wherein said generating, for said first user, said first dynamic sound file to accompany said reading material is based on a segment-by-segment matching of said reading material's segments with said first dynamic sound file's segments;
- analyzing, on a segment-by-segment basis, said first user's reading of said reading material wherein said analyzing said first user's reading of said reading material comprises:
- performing eye tracking of said first user using an eye-facing camera to collect eye tracking data;
- and
- determining, based on said eye tracking data of said first user, a segment of said reading material that said first user is actively reading;
- using said segment of said reading material that said user is actively reading and said segment-by-segment matching of said reading material's segments with said first dynamic sound file's segments to determine, for said first user, a corresponding segment of said first dynamic sound file that corresponds to said segment of said reading material that said first user is actively reading;
- and
- playing said corresponding segment of said first dynamic sound file on a speaker to said first user while said first user is actively reading said segment of said reading material.
8 more elements
A set of headphones comprising:
- a speaker for a user's left ear;
- a speaker for said user's right ear;
- wherein said set of headphones is operably connected to an eye-facing camera;
- and
- wherein said speaker for said user's left ear and said speaker for said user's right ear are configured to enhance said user's reading experience while said user is reading a reading material comprising:
- using said reading material wherein said reading material is comprised of segments;
- using, for said user, a dynamic sound file to accompany said reading material
- wherein said dynamic sound file comprises segments, and
- wherein using, for said user, said dynamic sound file to accompany said reading material is based on a segment-by-segment matching of said reading material's segments with said dynamic sound file's segments;
- analyzing, on a segment-by-segment basis, said user's reading of said reading material wherein said analyzing said user's reading of said reading material comprises:
- performing eye tracking of said user using said eye-facing camera to collect eye tracking data;
- and
- determining based on said eye tracking data of said user a segment of said reading material that said user is actively reading;
- using said segment of said reading material that said user is actively reading and said segment-by-segment matching of said reading material's segments with said dynamic sound file's segments to determine, for said user, a corresponding segment of said dynamic sound file that corresponds to said segment of said reading material that said user is actively reading;
- and
- playing said corresponding segment of said dynamic sound file on said speaker for said user's left ear and said speaker for said user's right ear to said user while said user is actively reading said segment of said reading material.
13 more elements
An extended reality display comprising:
- a left eye display;
- a right eye display;
- an eye tracking system;
- and
- wherein said left eye display and said right eye display are configured to enhance a user's reading experience while said user is reading a reading material comprising:
- using said reading material wherein said reading material is comprised of segments;
- using, for said user, a dynamic visual file to accompany said reading material
- wherein said dynamic visual file comprises segments, and
- wherein said using, for said user, said dynamic visual file to accompany said reading material is based on a segment-by-segment matching of said reading material's segments with said dynamic visual file's segments;
- analyzing, on a segment-by-segment basis, said user's reading of said reading material wherein said analyzing said user's reading of said reading material comprises:
- performing eye tracking of said user using said eye tracking system to collect eye tracking data;
- and
- determining, based on said eye tracking data of said user, a segment of said reading material that said user is actively reading;
- using said segment of said reading material that said user is actively reading and said segment-by-segment matching of said reading material's segments with said dynamic visual file's segments to determine, for said user, a corresponding segment of said dynamic visual file that corresponds to said segment of said reading material that said user is actively reading;
- and
- displaying said corresponding segment of said dynamic visual file on said left eye display and said right eye display while said user is actively reading said segment of said reading material.
13 more elements
Dependencies are inferred from the claim text.