# US 2021/0174933 A1 · Social-Emotional Skills Improvement

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0174933 A1
- Document ID: US20210174933A1
- Status: Published application
- Kind: A1
- Application number: 17/113,620
- Filed: 2020-12-07
- Published: 2021-06-10
- Earliest claimed: 2019-12-09
- Assignees: Social Skills Training Pty Ltd
- Applicants: Social Skills Training Pty Ltd
- Inventors: Renae Brooke Beaumont; Kathleen Joy Davey
- Web page: https://patentgrep.com/patent/US20210174933A1

## CPC

- A61B 5/16: Devices for psychotechnics (using teaching or educational appliances G09B1/00 - G09B7/00); Testing reaction times {; Devices for evaluating the psychological state}
- G16H 20/70: relating to mental therapies, e.g. psychological therapy or autogenous training
- A61B 5/165: {Evaluating the state of mind, e.g. depression, anxiety}
- A61B 5/167: {Personality evaluation}
- A61B 5/7267: {involving training the classification device}
- A63F 13/67: adaptively or by learning from player actions, e.g. skill level adjustment or by storing successful combat sequences for re-use
- A63F 13/80: Special adaptations for executing a specific game genre or game mode
- G06N 20/00: Machine learning
- G16H 50/20: for computer-aided diagnosis, e.g. based on medical expert systems
- G16H 50/70: for mining of medical data, e.g. analysing previous cases of other patients
- A61B 5/0205: Simultaneously evaluating both cardiovascular conditions and different types of body conditions, e.g. heart and respiratory condition
- A61B 5/02416: {using photoplethysmograph signals, e.g. generated by infrared radiation (A61B5/14552 takes precedence)}
- A61B 5/02438: {with portable devices, e.g. worn by the patient}
- A61B 5/0533: Measuring galvanic skin response
- A61B 5/681: {Wristwatch-type devices}
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

A method for improving social-emotional skills in a biological subject, including acquiring subject data indicative of a subject response to one or more social cues, deriving metrics from the subject data, including at least one response metric indicative of the subject response, applying the one or more metrics to a computational model to generate a skill state indicator relating to a social-emotional skills state of the subject, the at least one computational model embodying a relationship between social-emotional skill states and the one or more metrics, wherein the at least one computational model is obtained by applying machine learning to reference metrics derived from reference subject data measured for one or more reference subjects and using the skill state indicator to perform a therapeutic intervention to thereby improve the social-emotional skills of the subject.

## Claims

### Claim 1

A method for improving social-emotional skills in a biological subject, the method comprising:
acquiring subject data, the subject data being at least partially indicative of a subject response to one or more social cues;
deriving one or more metrics from the subject data, the one or more metrics including at least one response metric at least partially indicative of the subject response;
in one or more electronic processing devices, applying the one or more metrics to at least one computational model to generate a skill state indicator relating to a social-emotional skills state of the subject, the at least one computational model embodying a relationship between social-emotional skill states and the one or more metrics, wherein the at least one computational model is obtained by applying machine learning to reference metrics derived from reference subject data measured for one or more reference subjects; and,
using the skill state indicator to perform a therapeutic intervention to thereby improve the social-emotional skills of the subject.

### Claim 2 (depends on 1)

The method of claim 1 further comprising:
generating subject data at least in part based on an assessment of an ability of the subject to recognize the social cues.

### Claim 3 (depends on 1)

The method of claim 1 further comprising:
exposing the subject to one or more social cues;
monitoring subject responses; and,
using the subject responses to at least one of:
assess the ability of the subject to recognize the social cues; and,
train the subject to recognize the social cues.

### Claim 4 (depends on 1)

The method of claim 1 further comprising:
having the user interact with a computer game implemented using a suitably programmed computer system, the computer game being configured to teach social-emotional skills to the subject;
using the computer game to generate game play data; and,
using the game play data to derive one or more response metrics.

### Claim 5 (depends on 4)

The method of claim 4 further comprising:
in a computer implementing the computer game;
presenting the subject with one or more social cues;
ascertaining a subject responses to the social cues in accordance with user input commands;
generating game play data indicative of at least one of:
the user input commands;
the subject responses;
an accuracy of the subject responses;
a speed of the subject responses;
a degree of participation;
demonstrated elements of knowledge; and,
selected choices; and
at least one of:
progressing the game based on the subject response; and,
selectively displaying feedback to the subject based on the subject response.

### Claim 6 (depends on 1)

The method according to claim 1 further comprising:
using one or more sensors to measure subject attributes, optionally while the subject is interacting with a computer game implemented using a suitably programmed computer system, the computer game being configured to teach social-emotional skills to the subject playing the computer game; and,
generating one or more metrics using measured subject attributes.

### Claim 7 (depends on 1)

The method of claim 1, wherein the subject data includes at least one of:
game play data collected while the subject is interacting with a computer game implemented using a suitably programmed computer system, the computer game being configured to teach social-emotional skills to the subject playing the computer game;
details of therapeutic interventions performed on the subject;
results of therapeutic interventions performed on the subject;
results of one or more assessments of social-emotional skills of the subject;
ratings of one or more social-emotional skills of the subject;
responses to one or more social cues;
subject attributes including one or more of:
diagnosed psychological and/or developmental disorders;
demographic attributes;
physiological attributes;
physical attributes;
psychological attributes;
nutritional information relating to nutrition of the subject; and,
medication information relating to medication administered to the subject;
recordings of at least one of:
conversations;
social interactions; and,
responses to social cues; and,
journal records.

### Claim 8 (depends on 1)

The method of claim 1 further comprising:
acquiring subject data by at least one of:
having the subject interact with a computer game implemented using a suitably programmed computer system, the computer game being configured to teach social-emotional skills to the subject playing the computer game;
querying a subject medical history;
receiving sensor data from a sensing device;
performing an assessment of responses to social cues;
using questionnaires or forms completed by the subject;
using questionnaires or forms completed by one or more entities delivering therapeutic interventions; and,
using questionnaires or forms completed by one or more entities assessing social-economic skills of the subject.

### Claim 9 (depends on 1)

The method of claim 1, wherein the one or more metrics include at least one of:
at least one subject attribute metric indicative of one or more subject attributes of the subject;
at least one physiological metric indicative of one or more physiological attributes of the subject;
at least one psychological metric indicative of one or more psychological attributes of the subject;
at least one physical characteristic metric indicative of one or more physical attributes of the subject;
at least one demographic metric indicative of one or more demographic attributes of the subject;
a physical activity metric indicative of physical activity of the subject; and,
at least one nutritional metric indicative of nutrition ingested by the subject;
at least one medication metric indicative of medication administered to the subject;
at least one pre-therapy metric; and,
at least one post-therapy metric.

### Claim 10 (depends on 9)

The method of claim 9, wherein at least one of the physiological attributes includes at least one of:
heart rate;
heart rate variability;
galvanic skin response;
breathing;
temperature;
a blood pressure;
facial expression;
gaze;
speech; and
a presence, absence or degree of one or more disorder states,
wherein the physical attributes includes at least one of:
a subject age;
a subject height;
a subject weight;
a subject sex; and
a subject ethnicity,
wherein the psychological attributes includes at least one of:
happy;
sad;
anxious;
angry;
tired; and,
a mental state including at least one of:
engaged;
focused;
disinterested; and
bored, and
wherein the physical activity attributes include at least one of:
activity type;
activity intensity;
activity duration;
activity location;
activity time; and
amount of movement.

### Claim 11 (depends on 1)

The method of claim 1, wherein at least one of:
the social-emotional skills state includes at least one of:
a diagnosis of a presence, absence or degree of a condition that impacts on social-emotional skills of a subject;
a competency level for one or more social-emotional skills;
a change in competency level for one or more social-emotional skills;
a comparison between a competency level and an expected competency level for one or more social-emotional skills; and
a ranking of social-emotional skills; and
the skill state indicator includes an indication of at least one of:
a score for one or more social-emotional skills, the score being indicative of a competency level;
results of a comparison between a competency level and an expected competency level for one or more social-emotional skills;
a change in competency level for one or more social-emotional skills;
a list of one or more social-emotional skills that require improvement;
an ordered list indicative of a ranking of social-emotional skills;
a recommendation for improving one or more social-emotional skills;
one or more tasks designed to improve one or more social-emotional skills;
an intervention program for improving one or more social-emotional skills;
medication for improving one or more social-emotional skills; and,
a diagnosis of a presence, absence or degree of a condition that impacts on social-emotional skills of a subject.

### Claim 12 (depends on 1)

The method of claim 1, wherein the therapeutic intervention includes at least one of:
controlling a computer game implemented using a suitably programmed computer system, the computer game being configured to teach social-emotional skills to the subject playing the computer game;
training the subject;
training the subject in accordance with a recommendation;
having the subject interact with a computer game implemented using a suitably programmed computer system, the computer game being configured to teach social-emotional skills to the subject playing the computer game;
having the subject perform one or more intervention tasks;
having the subject complete a treatment program; and,
administering medication.

### Claim 13 (depends on 1)

The method of claim 1, wherein the method includes generating a report indicative of at least one of:
a usage of one or more therapeutic interventions;
an adherence to one or more therapeutic interventions;
an effectiveness of one or more therapeutic interventions;
an effectiveness of one or more entities delivering therapeutic interventions;
an effectiveness of one or more entities assessing social-emotional skills;
an effectiveness of therapeutic interventions for different classifications of subject; and,
a comparison of the effectiveness of different therapeutic interventions.

### Claim 14 (depends on 1)

The method of claim 1 further comprising:
assigning the subject to a classification, optionally at least in part using subject attributes; and,
applying the one or more metrics to at least one computational model associated with the classification, the at least one computational model embodying a relationship between social-emotional skills and the one or more metrics for reference subjects assigned to the classification.

### Claim 15 (depends on 1)

The method of claim 1 further comprising:
comparing at least one current metric determined for the subject and at least one previous metric determined for the subject; and,
using results of the comparison to track at least one of:
change in social-emotional skills of the subject; and,
effectiveness of therapeutic interventions.

### Claim 16 (depends on 1)

The method of claim 1, wherein the method includes:
for each of a plurality of reference subjects:
acquiring reference subject data at least partially indicative of:
a reference subject response to one or more social cues; and,
an assessment of a reference social-emotional skills state for the reference subject; and,
deriving one or more reference metrics from the reference subject data, the one or more reference metrics including at least one response reference metric at least partially indicative of the reference subject response; and,
in one or more electronic processing devices, using the reference metrics and the assessed reference social-emotional skills state to train at least one computational model so that the at least one computational model embodies relationships between different social-emotional skill states and the one or more metrics.

### Claim 17

A method for calculating at least one computational model, the at least one computational model being used for generating a skill state indicator relating to a social-emotional skills state of a biological subject, the method comprising:
in one or more electronic processing devices:
for each of a plurality of reference subjects:
acquiring reference subject data at least partially indicative of:
a reference subject response to one or more social cues; and,
an assessment of a reference social-emotional skills state for the reference subject; and,
deriving one or more reference metrics from the reference subject data, the one or more reference metrics including at least one response reference metric at least partially indicative of the reference subject response; and,
using the reference metrics and the assessed reference social-emotional skills states to train the at least one computational model so that the at least one computational model embodies relationships between different social-emotional skill states and the one or more metrics.

### Claim 18 (depends on 17)

The method of claim 17, wherein the one or more processing devices is configured to:
select a plurality of reference metrics;
train at least one computational model using the plurality of reference metrics;
test the at least one computational model to determine a discriminatory performance of the model; and,
if the discriminatory performance of the model falls below a threshold, at least one of:
selectively retrain the at least one computational model using a different plurality of reference metrics; and,
train a different computational model.

### Claim 19 (depends on 17)

The method of claim 17 further comprising:
selecting a plurality of combinations of reference metrics;
training a plurality of computational models using each of the combinations;
testing each computational model to determine a discriminatory performance of the model; and,
selecting the at least one computational model with the highest discriminatory performance for use in determining a mental state indicator indicative of a mental state.

### Claim 20 (depends on 17)

The method of claim 17 further comprising:
determining one or more reference subject attributes from the reference subject data;
training the at least one computational model using the one or more reference subject attributes; and
assigning the reference subjects to classifications and training the at least one computational model using the classifications, so that the at least one computational model embodies a relationship between social-emotional skills and the one or more metrics for reference subjects assigned to a respective classification.
