# US 2025/0208697 A1 · Machine learning systems and methods for sensory augmentation using gaze tracking and emotional prediction techniques

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0208697 A1
- Document ID: US20250208697A1
- Status: Published application
- Kind: A1
- Application number: 19/075,398
- Filed: 2025-03-10
- Published: 2025-06-26
- Earliest claimed: 2021-10-28
- Applicants: MetaSoul Inc.
- Inventors: Patrick LEVY-ROSENTHAL
- Web page: https://patentgrep.com/patent/US20250208697A1

## CPC

- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06F 40/30: Semantic analysis
- G06F 2203/011: Emotion or mood input determined on the basis of sensed human body parameters such as pulse, heart rate or beat, temperature of skin, facial expressions, iris, voice pitch, brain activity patterns
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A method for reading sensory augmentation comprising displaying a text on a reading device, determining a reader's current location in the text with a gaze tracking system, identifying a subsequent location in the text, processing the text at the subsequent location with an emotion processing unit to predict an emotional response to the text at the subsequent location, generating a sensory augmentation routine based on the predicted emotional response, and initiating playback of the sensory augmentation routine at the subsequent location in the text. The sensory augmentation routine can include a musical composition, a sound, and/or an ambient lighting effect. The gaze tracking system can be configured to receive data from the reading device related to the text currently displayed thereon and to receive data from an image capture device related to eye movement tracking of the reader.

## Claims

### Claim 1

A method for reading sensory augmentation comprising the steps of:
displaying a text on a reading device;
determining a current location of a reader in the text with a gaze tracking system;
identifying a subsequent location in the text;
processing the text at the subsequent location with an emotion processing unit to predict an emotional response to the text at the subsequent location;
generating a sensory augmentation routine based on the predicted emotional response; and
initiating playback of the sensory augmentation routine upon the reader reaching the subsequent location in the text;
determining if the reader is currently reading;
stopping the playback of the sensory augmentation routine if the reader is not currently reading; and
determining a current reading speed of the reader if the reader is currently reading.

### Claim 2 (depends on 1)

The method of claim 1, wherein the sensory augmentation routine comprises one or more of a musical composition, a sound, and an ambient lighting effect.

### Claim 3 (depends on 1)

The method of claim 1, wherein the gaze tracking system receives data from the reading device related to the text currently displayed thereon and receives data from an image capture device related to eye movement tracking of the reader.

### Claim 4 (depends on 1)

The method of claim 1, comprising the steps of:
processing the text at the subsequent location to identify one or more contextual indicators;
generating a second sensory augmentation routine based on the one or more contextual indicators; and
initiating playback of the second sensory augmentation routine upon the reader reaching the subsequent location in the text.

### Claim 5 (depends on 4)

The method of claim 4, wherein the second sensory augmentation routine comprises one or more of a musical composition, a sound, and an ambient lighting effect.

### Claim 6 (depends on 1)

The method of claim 1, comprising the steps of:
determining if the current reading speed of the reader is above a predetermined threshold;
generating a second sensory augmentation routine if the current reading speed is below the predetermined threshold; and
generating a third sensory augmentation routine if the current reading speed is above the predetermined threshold.

### Claim 7 (depends on 6)

The method of claim 6, comprising the steps of:
reducing the predetermined threshold if the current reading speed is below the predetermined threshold;
increasing the predetermined threshold if the current reading speed is above the predetermined threshold; and
storing the reduced or increased predetermined threshold to a memory for subsequent retrieval.

### Claim 8 (depends on 1)

The method of claim 1, wherein the sensory augmentation routine comprises an augmented reality scene or augmented reality environment.

### Claim 9 (depends on 8)

The method of claim 8, wherein the sensory augmentation routine comprises one or more of a musical composition, a sound, and an ambient lighting effect.

### Claim 10

A non-transitory computer-readable medium having stored thereon a plurality of computer-executable instructions which, when executed by one or more processors, cause the one or more processors to:
display a text on a reading device;
determine a current location of a reader in the text with a gaze tracking system;
identify a subsequent location in the text;
process the text at the subsequent location with an emotion processing unit to predict an emotional response to the text at the subsequent location;
generate a sensory augmentation routine based on the predicted emotional response; and
initiate playback of the sensory augmentation routine upon the reader reaching the subsequent location in the text;
determine if the reader is currently reading;
stop the playback of the sensory augmentation routine if the reader is not currently reading; and
determine a current reading speed of the reader if the reader is currently reading.

### Claim 11 (depends on 10)

The non-transitory computer-readable medium of claim 10, wherein the sensory augmentation routine comprises one or more of a musical composition, a sound, and an ambient lighting effect.

### Claim 12 (depends on 10)

The non-transitory computer-readable medium of claim 10, wherein the gaze tracking system receives data from the reading device related to the text currently displayed thereon and receives data from an image capture device related to eye movement tracking of the reader.

### Claim 13 (depends on 10)

The non-transitory computer-readable medium of claim 10, wherein the plurality of computer-executable instructions, when executed by the one or more processors, cause the one or more processors to:
process the text at the subsequent location to identify one or more contextual indicators;
generate a second sensory augmentation routine based on the one or more contextual indicators; and
initiate playback of the second sensory augmentation routine upon the reader reaching the subsequent location in the text.

### Claim 14 (depends on 13)

The non-transitory computer-readable medium of claim 13, wherein the second sensory augmentation routine comprises one or more of a musical composition, a sound, and an ambient lighting effect.

### Claim 15 (depends on 10)

The non-transitory computer-readable medium of claim 10, wherein the plurality of computer-executable instructions, when executed by the one or more processors, cause the one or more processors to:
determine if the current reading speed of the reader is above a predetermined threshold;
generate a second sensory augmentation routine if the current reading speed is below the predetermined threshold; and
generate a third sensory augmentation routine if the current reading speed is above the predetermined threshold.

### Claim 16 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein the plurality of computer-executable instructions, when executed by the one or more processors, cause the one or more processors to:
reduce the predetermined threshold if the current reading speed is below the predetermined threshold;
increase the predetermined threshold if the current reading speed is above the predetermined threshold; and
store the reduced or increased predetermined threshold to a memory for subsequent retrieval.

### Claim 17 (depends on 10)

The non-transitory computer-readable medium of claim 10, wherein the sensory augmentation routine comprises an augmented reality scene or augmented reality environment.

### Claim 18 (depends on 17)

The non-transitory computer-readable medium of claim 17, wherein the sensory augmentation routine comprises one or more of a musical composition, a sound, and an ambient lighting effect.
