# US 2022/0274010 A1 · Brain Activity Tracking During Electronic Gaming

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0274010 A1
- Document ID: US20220274010A1
- Status: Published application
- Kind: A1
- Application number: 17/668,691
- Filed: 2022-02-10
- Published: 2022-09-01
- Earliest claimed: 2021-02-26
- Assignees: Hi LLC
- Applicants: Hi LLC
- Inventors: Bryan Johnson; Ryan Field; Katherine Perdue
- Web page: https://patentgrep.com/patent/US20220274010A1

## CPC

- A63F 13/212: using sensors worn by the player, e.g. for measuring heart beat or leg activity
- A61B 5/02405: {Determining heart rate variability}
- A61B 5/053: Measuring electrical impedance or conductance of a portion of the body
- A61B 5/163: {by tracking eye movement, gaze, or pupil change}
- A61B 5/165: {Evaluating the state of mind, e.g. depression, anxiety}
- A61B 5/6803: {Head-worn items, e.g. helmets, masks, headphones or goggles}
- A61B 5/7435: {Displaying user selection data, e.g. icons in a graphical user interface}
- A63F 13/213: comprising photodetecting means, e.g. cameras, photodiodes or infrared cells (A63F13/219 takes precedence)
- A63F 13/24: Constructional details thereof, e.g. game controllers with detachable joystick handles
- A63F 13/25: Output arrangements for video game devices
- A63F 13/30: Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
- A63F 13/67: adaptively or by learning from player actions, e.g. skill level adjustment or by storing successful combat sequences for re-use
- A63F 13/69: by enabling or updating specific game elements, e.g. unlocking hidden features, items, levels or versions
- G01R 33/26: using optical pumping
- G06F 3/015: {Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection}
- H10F 30/225: the potential barrier working in avalanche mode, e.g. avalanche photodiodes
- A61B 5/0205: Simultaneously evaluating both cardiovascular conditions and different types of body conditions, e.g. heart and respiratory condition
- A61B 5/0531: Measuring skin impedance
- A61B 5/1118: {Determining activity level}
- A61B 5/14542: {for measuring blood gases (A61B5/14551 takes precedence)}
- A63F 2300/1012: involving biosensors worn by the player, e.g. for measuring heart beat, limb activity
- A63F 2300/308: Details of the user interface
- A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G01R: MEASURING ELECTRIC VARIABLES; MEASURING MAGNETIC VARIABLES (indicating correct tuning of resonant circuits H03J3/12)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H10F: INORGANIC SEMICONDUCTOR DEVICES SENSITIVE TO INFRARED RADIATION, LIGHT, ELECTROMAGNETIC RADIATION OF SHORTER WAVELENGTH OR CORPUSCULAR RADIATION

## Abstract

An illustrative system includes a brain interface system configured to be worn by a user and to output brain activity data representative of brain activity of the user while the user concurrently plays an electronic game and a computing device configured to obtain the brain activity data and modify, based on the brain activity data, an attribute of the electronic game.

## Claims

### Claim 1

A system comprising:
a brain interface system configured to be worn by a user and to output brain activity data representative of brain activity of the user while the user concurrently plays an electronic game; and
a computing device configured to
obtain the brain activity data, and
modify, based on the brain activity data, an attribute of the electronic game.

### Claim 2 (depends on 1)

The system of claim 1, wherein the brain interface system comprises an optical measurement system configured to perform optical-based brain data acquisition operations, the brain activity data based on the optical-based brain data acquisition operations.

### Claim 3 (depends on 2)

The system of claim 2, wherein the optical measurement system comprises:
a wearable assembly configured to be worn by the user and comprising:
a plurality of light sources each configured to emit light directed at a brain of the user, and
a plurality of detectors configured to detect arrival times for photons of the light after the light is scattered by the brain, the brain activity data based on the arrival times.

### Claim 4 (depends on 3)

The system of claim 3, wherein the detectors each comprise a plurality of single-photon avalanche diode (SPAD) circuits.

### Claim 5 (depends on 3)

The system of claim 3, wherein the wearable assembly further comprises:
a first module comprising a first light source included in the plurality of light sources and a first set of detectors included in the plurality of detectors; and
a second module physically distinct from the first module and comprising a second light source included in the plurality of light sources and a second set of detectors included in the plurality of detectors.

### Claim 6 (depends on 5)

The system of claim 5, wherein the first and second modules are configured to be removably attached to the wearable assembly.

### Claim 7 (depends on 1)

The system of claim 1, wherein the brain interface system comprises a multimodal measurement system configured to perform optical-based brain data acquisition operations and electrical-based brain data acquisition operations, the brain activity data based on the optical-based brain data acquisition operations and the electrical-based brain data acquisition operations.

### Claim 8 (depends on 7)

The system of claim 7, wherein the multimodal measurement system comprises:
a wearable assembly configured to be worn by the user and comprising:
a plurality of light sources each configured to emit light directed at a brain of the user,
a plurality of detectors configured to detect arrival times for photons of the light after the light is scattered by the brain, and
a plurality of electrodes configured to be external to the user and detect electrical activity of the brain, the brain activity based on the arrival times and the electrical activity.

### Claim 9 (depends on 8)

The system of claim 8, wherein the wearable assembly further comprises:
a first module comprising a first light source included in the plurality of light sources and a first set of detectors included in the plurality of detectors; and
a second module physically distinct from the first module and comprising a second light source included in the plurality of light sources and a second set of detectors included in the plurality of detectors.

### Claim 10 (depends on 9)

The system of claim 9, wherein the plurality of electrodes comprises a first electrode on a surface of the first module and a second electrode on a surface of the second module.

### Claim 11 (depends on 10)

The system of claim 10, wherein the first electrode surrounds the first light source on the surface of the first module.

### Claim 12 (depends on 1)

The system of claim 1, wherein the brain interface system comprises a magnetic field measurement system configured to perform magnetic field-based brain data acquisition operations, the brain activity data based on the magnetic field-based brain data acquisition operations.

### Claim 13 (depends on 12)

The system of claim 12, wherein the magnetic field measurement system comprises a wearable sensor unit configured to be worn by the user and comprising a magnetometer configured to detect a magnetic field generated within a brain of the user.

### Claim 14 (depends on 1)

The system of claim 1, wherein the outputting the brain activity data, the obtaining the brain activity data, and the modifying the attribute of the electronic game are performed in substantially real time while the user concurrently plays the electronic game.

### Claim 15 (depends on 1)

The system of claim 1, wherein the electronic game requires physical interaction by the user with one or more user input devices for the user to play the electronic game.

### Claim 16 (depends on 1)

The system of claim 1, wherein:
the computing device is further configured to obtain game data representative of one or more characteristics of the electronic game; and
the modifying of the attribute of the electronic game is further based on the game data.

### Claim 17 (depends on 16)

The system of claim 16, wherein the one or more characteristics of the game represented by the game data comprise one or more of a current difficulty level of the electronic game, a current scene of the electronic game that the user is experiencing, a score achieved by the user while playing the electronic game, or an attribute of a user profile used by the user to play the electronic game.

### Claim 18 (depends on 16)

The system of claim 16, wherein the obtaining of the game data comprises receiving the game data from a gaming system that presents the electronic game to the user.

### Claim 19 (depends on 1)

The system of claim 1, wherein the computing device is further configured to present the electronic game to the user.

### Claim 20 (depends on 1)

The system of claim 1, wherein:
the computing device is further configured to:
determine, based on the brain activity data, a current mental state of the user, and
obtain data representative of a desired mental state of the user;
wherein the modifying the attribute of the electronic game comprises setting the attribute to a value configured to change the current mental state of the user to the desired mental state of the user.

### Claim 21 (depends on 1)

The system of claim 1, wherein the computing device is further configured to present, by way of a graphical user interface, content representative of the brain activity data.

### Claim 22 (depends on 21)

The system of claim 21, wherein the electronic game is presented to the user via the graphical user interface.

### Claim 23 (depends on 21)

The system of claim 21, wherein the graphical user interface is presented to one or more other users by way of a network.

### Claim 24 (depends on 1)

The system of claim 1, wherein:
the computing device is further configured to obtain sensor data associated with the user from a sensor not included in the brain interface system; and
the modifying of the attribute of the electronic game is further based on the sensor data.

### Claim 25 (depends on 24)

The system of claim 24, wherein the sensor data is representative of one or more of eye movement by the user, electrodermal activity of the user, pupillometry associated with the user, a heart rate of the user, heart rate variability of the user, or a pulse oximetry reading for the user.

### Claim 26 (depends on 1)

The system of claim 1, wherein the computing device is further configured to predict, based on the brain activity data, an action that the user will perform while playing the electronic game.

### Claim at position 27

27-49. (canceled)
