# US 11,304,657 B2 · Cognitive platform coupled with a physiological component

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,304,657 B2
- Document ID: US11304657B2
- Status: Granted
- Kind: B2
- Application number: 16/327,144
- Filed: 2017-08-25
- Published: 2019-07-18
- Granted: 2022-04-19
- Earliest claimed: 2016-08-26
- Assignees: Akili Interactive Labs, Inc.
- Applicants: Akili Interactive Labs, Inc.
- Inventors: Jeffrey Bower; Titiimaea Alailima; Jason Johnson; Walter Edward Martucci; Isabella Slaby; Matthew Omernick; Adam Piper; Paul Rand Pierce; Ashley Mateus; Scott Kellogg
- Web page: https://patentgrep.com/patent/US11304657B2

## CPC

- A61B 5/4884: {inducing physiological or psychological stress, e.g. applications for stress testing}
- A61B 5/0533: Measuring galvanic skin response
- A61B 5/162: {Testing reaction times}
- A61B 5/168: {Evaluating attention deficit, hyperactivity}
- A61B 5/4076: {Diagnosing or monitoring particular conditions of the nervous system}
- A61B 5/4088: {Diagnosing of monitoring cognitive diseases, e.g. Alzheimer, prion diseases or dementia}
- A61B 5/7267: {involving training the classification device}
- G16H 20/30: relating to physical therapies or activities, e.g. physiotherapy, acupressure or exercising
- G16H 20/70: relating to mental therapies, e.g. psychological therapy or autogenous training
- G16H 30/40: for processing medical images, e.g. editing
- G16H 40/63: for local operation
- G16H 50/20: for computer-aided diagnosis, e.g. based on medical expert systems
- G16H 50/50: for simulation or modelling of medical disorders
- A61B 5/021: Measuring pressure in heart or blood vessels
- A61B 5/024: Measuring pulse rate or heart rate
- A61B 5/163: {by tracking eye movement, gaze, or pupil change}
- A61B 2562/0219: Inertial sensors, e.g. accelerometers, gyroscopes, tilt switches
- G06N 20/00: Machine learning
- G09B 5/00: Electrically-operated educational appliances (working with questions and answers G09B7/00; simulators G09B9/00; advertising or displaying in general G09F)
- G09B 7/00: Electrically-operated teaching apparatus or devices working with questions and answers (mechanically operated G09B3/00; computing arrangements G06F)
- G16H 50/00: ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B)

## Abstract

Example systems, methods, and apparatus, including cognitive platforms, are provided for computing performance metrics of an individual based at least in part on user interaction(s) with computerized tasks and/or interference and at least one physiological measure of the individual, where the performance metric provides an indication of the cognitive abilities of the individual. The apparatus can be coupled to at least one physiological component to perform the physiological measurement of the individual. The apparatus also can be configured to adapt the tasks and/or interferences to enhance the individual's cognitive abilities.

## Claims

### Claim 1

An apparatus for generating a quantifier of cognitive skills in an individual, said apparatus being coupled to at least one physiological component, the apparatus comprising:
a user interface comprising a display and an input device;
a memory to store processor-executable instructions; and
a processing unit communicatively coupled to the user interface and the memory, wherein upon execution of the processor-executable instructions by the processing unit, the processing unit is configured to:
render a first instance of a primary task with an interference at a graphical user interface being displayed at the display of the user interface, wherein the primary task comprises one or more first computerized stimuli or interaction comprising one or more graphical objects configured to prompt a first response from the individual to the first instance of the primary task in the presence of the interference via the input device of the user interface, wherein the primary task comprises a time-varying task having a response deadline;
wherein the interference comprises one or both of an interruptor or a distraction, wherein the interruptor or the distraction comprises one or more additional graphical objects configured to divert the individual's attention from performing the primary task;
render a second instance of the primary task without the interference at the user interface, wherein the second instance of the primary task without the interference is configured to require a second response from the individual to the second instance of the primary task;
wherein the processing unit is configured to:
(i) receive a secondary response to the interference at substantially the same time as the processing unit receives the second response; or
(ii) receive the secondary response to the interference that is an interruptor at substantially the same time as the processing unit receives the first response and not receive the secondary response to the interference that is a distraction at substantially the same time that the processing unit receives the first response; and
wherein the processing unit is configured to receive data indicative of at least one physiological profile of the individual, the physiological profile being based on one or more measurements of the at least one physiological component, the at least one physiological component being coupled to measure a physiological measurement of the individual;
receive data indicative of the first response, the second response, and the at least one physiological profile;
analyze the differences in the individual's performance from performing the primary task without interference and with interference at least in part by determining a difference between the data indicative of the first response and the data indicative of the second response relative to the at least one physiological profile to determine a performance metric of the individual, the performance metric comprising an indicator of the cognitive ability of the individual; and
modify a time-varying aspect of one or both of the primary task or the interference in response to the performance metric,
wherein modifying the time-varying aspect of one or both of the primary task or the interference comprises modifying one or more of a speed of an object, a rate of change of a facial expression, a direction of trajectory of an object, a change of orientation of an object, at least one color of an object, a type of an object, or a size of an object.

### Claim 2 (depends on 1)

The apparatus of claim 1, wherein the processing unit is further configured to send a control signal to the at least one physiological component to perform the one or more measurements.

### Claim 3 (depends on 1)

The apparatus of claim 1, wherein the physiological profile provides an indication of a state of attentiveness of the individual to the primary task and/or the interference.

### Claim 4 (depends on 1)

The apparatus of claim 1, wherein the processing unit is further configured to:
identify physiological profiles indicative of one or both of a state of anger or a state of frustration of the individual; and
adjust a difficulty of one or both of the primary task or the interference to normalize such that a subsequently computed at least one physiological profile is indicative of a modification of the state of anger or the state of frustration of the individual.

### Claim 5 (depends on 1)

The apparatus of claim 1, wherein the processing unit is further configured to analyze the at least one physiological profile to determine whether a user is likely to respond or not to respond to a treatment.

### Claim 6 (depends on 1)

The apparatus of claim 1, wherein the processing unit is further configured to:
adjust a difficulty of one or both of the primary task or the interference to normalize such that a subsequently computed at least one physiological profile is indicative of an emotionally-regulated state of the individual.

### Claim 7 (depends on 1)

The apparatus of claim 1, wherein the processing unit is further configured to compute the performance metric as an interference cost.

### Claim 8 (depends on 1)

The apparatus of claim 1, further comprising at least one actuating component, wherein the processing unit is further configured to control the actuating component to effect one or both of the primary task or the interference as comprising one or more of an auditory stimulus, a tactile stimulus, or a vibrational stimulus.

### Claim 9 (depends on 1)

The apparatus of claim 1, wherein the performance metric comprises data indicative of one or both of: (i) a projected performance of the individual at one or both of a cognitive test or a behavioral test, and (ii) a diagnosis of a status or progression of a cognitive condition, a disease or an executive function disorder of the individual.

### Claim 10 (depends on 1)

The apparatus of claim 1, wherein the processing unit is further configured to use the performance metric to perform at least one of (i) changing one or more of an amount, concentration, or dose titration of a pharmaceutical agent, drug, or biologic, (ii) identifying a likelihood of the individual experiencing an adverse event in response to administration of the pharmaceutical agent, drug, or biologic, (iii) identifying a change in the individual's cognitive abilities, (iv) recommending a treatment regimen, or (v) recommending or determining a degree of effectiveness of at least one of a behavioral therapy, counseling, or physical exercise.

### Claim 11 (depends on 1)

The apparatus of claim 1, wherein the processing unit is configured to control the user interface to render the first instance of one or both of the primary task or the interference as a continuous visuo-motor tracking task, and wherein the first instance of the primary task or the interference is a first time interval of the continuous visuo-motor task.

### Claim 12 (depends on 1)

The apparatus of claim 1, wherein the processing unit is configured to control the user interface to render one or both of the primary task or the interference as a target discrimination interference.

### Claim 13 (depends on 1)

The apparatus of claim 1, wherein the processing unit is configured to render the first instance of the primary task with the interference by configuring the user interface to:
render the first instance of the primary task in the presence of the interference such that the interference diverts the individual's attention from the primary task, in which the interference is rendered as one or both of a distraction or an interruptor.

### Claim 14 (depends on 1)

The apparatus of claim 1, wherein the processing unit is further configured to render a predictive model based on the determined performance metric, to generate a predictive model output indicative of a measure of one or more of a cognition, a mood, a level of cognitive bias, attentiveness, user engagement, or an affective bias of the individual.

### Claim 15 (depends on 1)

The apparatus of claim 1, wherein the determined performance metric comprises an indicator of a projected response of the individual to a cognitive treatment being or to be delivered.

### Claim 16 (depends on 1)

The apparatus of claim 1, wherein the processing unit is further configured to transmit control signals to one or more of a controller to implement a feedback loop based on the one or more measurements of the at least one physiological component.

### Claim 17 (depends on 1)

A system comprising one or more physiological components and an apparatus of claim 1, wherein upon execution of the processor-executable instructions by the processing unit, the processing unit is configured to:
receive data indicative of one or more measurements of the physiological component; and
analyze the data indicative of the first response and the second response, and the data indicative of the one or more measurements of the physiological component to compute the performance metric.

### Claim 18 (depends on 1)

The apparatus of claim 1, wherein the processing unit is configured to control at least one sensing device to measure at least one physical action of the individual to provide one or both of the first response or the second response, and (ii) the sensing device comprises one or more of a gyroscope, an accelerometer, a motion sensor, a position sensor, a pressure sensor, an optical sensor, an auditory sensor, a vibrational sensor, a video camera, a pressure-sensitive surface, or a touch-sensitive surface.

### Claim 19 (depends on 1)

The apparatus of claim 1, wherein the at least one physiological component comprises one or more of a electroencephalogram, magnetoencephalography, electrocardiograph, heart rate monitor, heart rate variability monitor, blood pressure monitor, event-related potential (ERP) monitor, functional magnetic resonance imaging (fMRI), skin electrical potential measurement device, galvanic skin response (GSR), eye-tracking device, optical detection device, functional near-infrared spectroscopy (fNIRS), or positron emissiontomography (PET).

### Claim 20

An apparatus for enhancing cognitive skills in an individual, said apparatus comprising:
a user interface comprising a display and an input device;
a memory to store processor-executable instructions; and
a processing unit communicatively coupled to the user interface and the memory, wherein upon execution of the processor-executable instructions by the processing unit, the processing unit is configured to:
render a first instance of a primary task with an interference at a graphical user interface being displayed at the display of the user interface, wherein the primary task comprises one or more first computerized stimuli or interaction comprising one or more graphical objects configured to prompt a first response from the individual to the first instance of the primary task in the presence of the interference via the input device of the user interface, wherein the primary task comprises a time-varying task having a response deadline;
wherein the interference comprises one or both of an interruptor or a distraction wherein the interruptor or the distraction comprises one or more additional graphical objects configured to divert the individual's attention from performing the primary task;
render a second instance of the primary task without the interference at the user interface, wherein the second instance of the primary task without the interference is configured to require a second response from the individual to the second instance of the primary task;
wherein the processing unit is configured to:
(i) receive a secondary response to the interference at substantially the same time as the processing unit receives the second response; or
(ii) receive the secondary response to the interference that is an interruptor at substantially the same time as the processing unit receives the first response and not receive the secondary response to the interference that is a distraction at substantially the same time that the processing unit receives the first response; and
wherein the processing unit is configured to receive data indicative of at least one physiological profile of the individual, the physiological profile being based on one or more measurements of at least one physiological component to provide a physiological measurement, the at least one physiological component being coupled to measure a physiological measurement of the individual;
receive data indicative of the first response, the second response, and the at least one physiological profile;
analyze the differences in the individual's performance from performing the primary task without interference and with interference at least in part by determining a difference between the data indicative of the first response and the data indicative of the second response relative to the at least one physiological profile to determine a first performance metric of the individual, the first performance metric comprising a first indicator of a cognitive ability of the individual;
adjust a difficulty of one or both of the primary task or the interference based on the at least one physiological profile such that the apparatus renders one or both of a third instance of the primary task or the interference at a second difficulty level; and
determine a second performance metric of the individual, the second performance metric comprising a second indicator of the cognitive ability of the individual,
wherein adjusting the difficulty of one or both of the primary task or the interference comprises modifying a time-varying aspect of one or both of the primary task or the interference in response to one or both of the first performance metric and the second performance metric,
wherein modifying the time-varying aspect of one or both of the primary task or the interference comprises modifying one or more of a speed of an object, a rate of change of a facial expression, a direction of trajectory of an object, a change of orientation of an object, at least one color of an object, a type of an object, or a size of an object.

### Claim 21 (depends on 20)

The apparatus of claim 20, wherein the processing unit is further configured to send a control signal to the at least one physiological component to perform the one or more measurements.

### Claim 22 (depends on 20)

The apparatus of claim 20, wherein the processing unit is further configured to send a control signal to one or more controllers, to adjust the difficulty of one or both of the primary task or the interference based on a feedback loop.

### Claim 23 (depends on 20)

The apparatus of claim 20, wherein the processing unit is further configured to adjust, based on the first performance metric, one or both of at least one user instruction to the individual rendered to the user interface or at least one reward rendered to the user interface.

### Claim 24 (depends on 20)

The apparatus of claim 20, wherein the processing unit is further configured to adjust the difficulty of one or both of the primary task or the interference such that the at least one physiological profile is indicative of at least one of (i) a state of attentiveness of the individual to one or both of the primary task or the interference, or (ii) increased engagement of the individual to one or both of the primary task or the interference.

### Claim 25 (depends on 20)

The apparatus of claim 20, wherein the processing unit is further configured to adjust the difficulty of one or both of the primary task or the interference in response to the at least one physiological profile indicating task automation.

### Claim 26 (depends on 20)

The apparatus of claim 20, wherein the processing unit is further configured to render the first instance of the primary task and the second instance of the primary task to obtain the first and second responses in an iterative manner, with the difficulty being adjusted between two or more of the iterations.

### Claim 27 (depends on 20)

The apparatus of claim 20, further comprising at least one actuating component, wherein the processing unit is further configured to control the actuating component to effect one or both of the primary task or the interference as comprising one or more of an auditory stimulus, a tactile stimulus, and a vibrational stimulus.

### Claim 28 (depends on 20)

The apparatus of claim 20, wherein the processing unit is configured to control the user interface to render the first instance of the primary task as a continuous visuo-motor tracking task, and wherein the first instance of the primary task is a first time interval of the continuous visuo-motor task.

### Claim 29 (depends on 20)

The apparatus of claim 20, wherein (i) the processing unit is configured to control at least one sensing device to measure at least one physical action of the individual to provide one or both of the first response or the second response, and (ii) the sensing device comprises one or more of a gyroscope, an accelerometer, a motion sensor, a position sensor, a pressure sensor, an optical sensor, an auditory sensor, a vibrational sensor, a video camera, a pressure-sensitive surface, or a touch-sensitive surface.

### Claim 30 (depends on 20)

The apparatus of claim 20, wherein the at least one physiological component comprises one or more of a electroencephalogram, magnetoencephalography, electrocardiograph, heart rate monitor, heart rate variability monitor, blood pressure monitor, event-related potential (ERP) monitor, functional magnetic resonance imaging (fMRI), skin electrical potential measurement device, galvanic skin response (GSR), eye-tracking device, optical detection device, functional near-infrared spectroscopy (fNIRS), or positron emission tomography (PET).

### Claim 31 (depends on 20)

The apparatus of claim 20, wherein one or both of the primary task or interference comprises a targeting task.

### Claim 32 (depends on 20)

The apparatus of claim 20, wherein the adjusting the difficulty comprises modifying a time-varying aspect of one or both of the primary task or the interference.

### Claim 33 (depends on 20)

A system comprising the at least one physiological component and the apparatus of claim 20, wherein upon execution of the processor-executable instructions by the processing unit, the processing unit is configured to:
receive data indicative of one or more measurements of the at least one physiological component; and
analyze the data indicative of the first response and the second response, and the data indicative of the one or more measurements of the at least one physiological component to compute the performance metric.