# US 2021/0059591 A1 · Systems and methods for estimating and predicting emotional states and affects and providing real time feedback

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0059591 A1
- Document ID: US20210059591A1
- Status: Published application
- Kind: A1
- Application number: 17/095,058
- Filed: 2020-11-11
- Published: 2021-03-04
- Earliest claimed: 2015-11-20
- Inventors: Gregory Charles Flickinger
- Web page: https://patentgrep.com/patent/US20210059591A1

## CPC

- A61B 5/165: {Evaluating the state of mind, e.g. depression, anxiety}
- A61B 5/02055: {Simultaneously evaluating both cardiovascular condition and temperature}
- A61B 5/11: Measuring movement of the entire body or parts thereof, e.g. head or hand tremor or mobility of a limb {(A61B5/1038 takes precedence; motion detection to correct for motion artifacts in physiological signals A61B5/721)}
- A61B 5/486: {Biofeedback (using electroencephalography [EEG] A61B5/375)}
- A61B 5/6803: {Head-worn items, e.g. helmets, masks, headphones or goggles}
- A61B 5/681: {Wristwatch-type devices}
- A61B 5/6826: {Finger}
- A61B 5/6898: {Portable consumer electronic devices, e.g. music players, telephones, tablet computers}
- A61B 5/7264: {Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems}
- A61B 5/7282: {Event detection, e.g. detecting unique waveforms indicative of a medical condition (cough events A61B5/0823; seizures A61B5/4094; sleep apnoea A61B5/4818)}
- A61B 5/742: {using visual displays (displays for heart-related electrical signals, e.g. ECG, A61B5/339)}
- A63B 24/0006: {Computerised comparison for qualitative assessment of motion sequences or the course of a movement}
- A63B 24/0062: {Monitoring athletic performances, e.g. for determining the work of a user on an exercise apparatus, the completed jogging or cycling distance}
- A63B 24/0084: {Exercising apparatus with means for competitions, e.g. virtual races}
- A63B 71/0622: {Visual, audio or audio-visual systems for entertaining, instructing or motivating the user}
- A63F 13/212: using sensors worn by the player, e.g. for measuring heart beat or leg activity
- A63F 13/213: comprising photodetecting means, e.g. cameras, photodiodes or infrared cells (A63F13/219 takes precedence)
- A63F 13/215: comprising means for detecting acoustic signals, e.g. using a microphone
- A63F 13/25: Output arrangements for video game devices
- A63F 13/33: using wide area network [WAN] connections
- A63F 13/46: Computing the game score
- A61B 5/021: Measuring pressure in heart or blood vessels
- A61B 5/024: Measuring pulse rate or heart rate
- A61B 5/0816: {Measuring devices for examining respiratory frequency (measuring frequency of electric signals G01R23/00)}
- A61B 5/1116: {Determining posture transitions}
- A61B 5/112: {Gait analysis}
- A61B 5/14546: {for measuring analytes not otherwise provided for, e.g. ions, cytochromes}
- A61B 5/4266: {sweat secretion}
- A61B 5/4368: {Sexual arousal evaluation}
- A61B 5/4393: {Sexual arousal or erectile dysfunction evaluation, e.g. tumescence evaluation}
- A61B 2503/10: Athletes
- A63B 2220/12: Absolute positions, e.g. by using GPS
- A63B 2220/40: Acceleration
- A63B 2220/56: Pressure
- A63B 2220/803: Motion sensors
- A63B 2220/807: Photo cameras
- A63B 2220/808: Microphones
- A63B 2220/836: Sensors arranged on the body of the user
- A63B 2225/50: Wireless data transmission, e.g. by radio transmitters or telemetry
- A63F 13/211: using inertial sensors, e.g. accelerometers or gyroscopes
- A63F 13/216: using geographical information, e.g. location of the game device or player using GPS
- A63F 13/217: using environment-related information, i.e. information generated otherwise than by the player, e.g. ambient temperature or humidity
- A63F 13/58: by computing conditions of game characters, e.g. stamina, strength, motivation or energy level
- A63F 2300/1012: involving biosensors worn by the player, e.g. for measuring heart beat, limb activity
- A63F 2300/8082: Virtual reality
- G16H 50/20: for computer-aided diagnosis, e.g. based on medical expert systems
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- A63B: APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT (apparatus for passive exercising, massage A61H)
- A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA

## Abstract

Systems and methods for estimating emotional states, moods, affects of an individual and providing feedback to the individual or others are disclosed. Systems and methods that provide real time detection and monitoring of physical aspects of an individual and/or aspects of the individual's activity and means of estimating that person's emotional state or affect and change to those are also disclosed. Real time feedback to the individual about the person's emotional change, change or potential change is provided to the user, helping the user cope, adjust or appropriately act on their emotions.

## Claims

### Claim at position 1

1: A method for computer gaming wherein a player's own emotional state is part of a computer game comprising the steps of:
providing a computer game or algorithm wherein a first player games or competes with a second player;
providing a gaming interface to the first player and a gaming interface to the second player with which to interact with and play said computer game;
generating an emotional state personal datum for each of the first and second player representing an emotional state of the respective player;
generating another personal datum for each of the first and second player representing a change of said emotional state of the respective player; and
generating a point score for each player wherein said point score is derived using said emotional state personal datum or said change of emotional state personal datum of each respective player and wherein the players compete based on said point score.

### Claim at position 2 (depends on 1)

2: The method of claim 1 wherein an object or metric of the game is for a player to change said emotional state of the respective player and one or more points are scored by said player when said emotional state of said player is changed.

### Claim at position 3 (depends on 1)

3: The method of claim 1 wherein an object or metric of the game is for a player to change a rate of change of an emotional state of the respective player and one or more points are scored by said player when the rate of change of said emotional state of said player is changed.

### Claim at position 4 (depends on 1)

4: The method of claim 1 wherein an object or metric of the game is for a player to change a level of a physiological or physical personal datum of the respective player and one or more points are scored by said player when the level of said physiological or physical personal datum of said player is changed.

### Claim at position 5 (depends on 1)

5: The method of claim 1 wherein an object or metric of the game is for a player to elicit a specific emotional, physiological or physical player datum or change thereto from another player and one or more points are scored by said player when said specific emotional, physiological or physical player datum or change thereto is elicited.

### Claim at position 6 (depends on 1)

6: The method of computer gaming of claim 1 wherein the game is customizable by the players to allow for control over the which personal datums are shared between players and which datums are used as competitive scoring metrics.

### Claim at position 7 (depends on 1)

7: The method of claim 1 further comprising the step of providing feedback to a player in the form of performance coaching or guidance.

### Claim at position 8

8: A computer game wherein game players' idiosyncratic physiological or physical parameters are measured or estimated and displayed to other game players and wherein the scoring of the game depend on game players physiological or physical parameters comprising:
means for generating a first player specific physiological or physical personal datum for each of the first player and the second player, wherein said first physiological or physical personal datums are subject to change during the playing of the game;
means for displaying said first personal datums of the first player to the second player and for displaying said first personal datums of the second player to the first player; and
a scoring system wherein a point score is generated for each player wherein said point score is derived using said physiological or physical personal datums or changes of said physiological or physical personal datums of each respective player and wherein said point score is generated and updated in real or near real time during game play wherein the players compete based on said point score.

### Claim at position 9 (depends on 8)

9: The computer game of claim 8 further comprising:
means for generating a second player specific physiological or physical personal datum for each of the first player and the second player wherein said second physiological or physical personal datums are subject to change during the playing of the game and wherein said point score is derived using both of said first and said second physiological or physical personal datums or changes thereto and is generated and updated in real or near real time for each player during game play.

### Claim at position 10 (depends on 9)

10: The computer game of claim 9 further comprising means for measuring or estimating a rate of change of one of said first or second physiological or physical personal datums and wherein said point score is derived using said rate of change of one of said physiological or physical personal datums.

### Claim at position 11 (depends on 8)

11: The computer game of claim 8 wherein said player specific personal datum represents at least one of a player's: skin salinity, facial expression, grip or keypad analysis, or voice analysis.

### Claim at position 12 (depends on 8)

12: The computer game of claim 8 wherein the game is customizable by the players allowing for control over the which personal datums are shared between players and which personal datums are used as competitive scoring metrics in deriving said point score.

### Claim at position 13 (depends on 8)

13: The computer game of claim 8 wherein a player can buy access to personal datums representing physiological, physical or emotional states of another player using game credits during game play.

### Claim at position 14

14: A computerized game or trainer for use by an individual wherein a user's own emotional or affective state is a training objective or performance metric of the game comprising:
means for estimating an emotional or affective state of a user;
means for estimating a change of an emotional or affective state of a user;
means for communicating said estimated emotional or affective state or said change of emotional or affective state to the user; and
a scoring system wherein a goal or target level of said emotional or affective state or change thereto is a performance metric or objective of the game and wherein said user is scored based on said performance metric or objective.

### Claim at position 15 (depends on 14)

15: The computer game of claim 14 further comprising a means for estimating a rate of change of said emotional or affective state of the user and wherein said rate of change is used as a performance metric and wherein said user is scored based on said performance metric or objective.

### Claim at position 16 (depends on 14)

16: The computer game of claim 14 wherein the user may customize the game by choosing an emotional or affective state on which to game and customize a performance metric by setting a personal target or objective.

### Claim at position 17 (depends on 14)

17: The computer game of claim 14 wherein the user engages in solitary play or plays against a computer.

### Claim at position 18 (depends on 14)

18: The computer game of claim 14 further comprising a means for providing feedback to the user in the form of performance coaching or guidance.

### Claim at position 19 (depends on 14)

19: The computer game of claim 14 wherein said scoring system includes generating a point score for the user wherein said point score is derived using said emotional or affective state or change of emotional or affective state of the user.

### Claim at position 20 (depends on 14)

20: The computer game of claim 14 further comprising:
means for estimating a physiological or physical state of a user;
means for estimating a change of said physiological or physical state of a user; and
means for communicating said estimated physiological or physical state or said change of said physiological or physical state to the user wherein a goal or target level of said physiological or physical state or change thereto is a second performance metric or objective of the game and wherein the user is scored based on said second performance metric or objective.

### Claim at position 21

21: A gaming or training system for competitive or cooperative athletics wherein one or more emotional or affective states of an athlete is estimated and shared with another athlete during athletic activity wherein athletes game or train based on said emotional or affective states comprising:
means for estimating an emotional or affective state of an athlete during athletic activity;
means for estimating a change of said emotional or affective state of an athlete during athletic activity; and
means for displaying said estimated emotional or affective state data or change of emotional or affective state data of one athlete to another athlete wherein said emotional or affective state data is displayed in real or near real time during athletic activity.

### Claim at position 22 (depends on 21)

22: The gaming or training system of claim 21 further comprising a means for allowing one athlete to provide feedback to another athlete during athletic activity and means for communicating or displaying said feedback to the other athlete in real or near real time during athletic activity.

### Claim at position 23 (depends on 21)

23: The gaming or training system of claim 21 further comprising means for virtual coaching of an athlete including means for providing real or near real time feedback in the form of coaching or encouragement to an athlete during athletic activity wherein said coaching or encouragement is generated based on the athletes emotional or affective state.

### Claim at position 24 (depends on 21)

24: The gaming or training system of claim 21 further comprising means for measuring a rate of change of an emotional or affective state of an athlete and means for displaying said rate of change to another athlete.

### Claim at position 25 (depends on 21)

25: The gaming or training system of claim 21 further comprising means for scoring an athlete using said emotional or affective state or change of emotional or affective state of the athlete wherein a score is derived and updated in real or near real time using said emotional or affective state or changes thereto of the athlete and wherein athletes compete or train in real or near real time based on said score.
