# US 10,311,744 B2 · Autodidactic cognitive training device and method thereof

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,311,744 B2
- Document ID: US10311744B2
- Status: Granted
- Kind: B2
- Application number: 14/423,614
- Filed: 2013-08-22
- Published: 2015-07-02
- Granted: 2019-06-04
- Earliest claimed: 2012-08-24
- Assignees: Agency for Science, Technology and Research; National University of Singapore
- Applicants: Agency for Science, Technology and Research; National University of Singapore
- Inventors: Hai Hong Zhang; Cuntai Guan; Ranga Krishnan; Tih Shih Lee; Zheng Yang Chin; Chuan Chu Wang
- Web page: https://patentgrep.com/patent/US10311744B2

## CPC

- G09B 19/00: Teaching not covered by other main groups of this subclass (teaching or practice apparatus for gun-aiming or gun-laying F41G3/26)
- A61B 5/0077: {Devices for viewing the surface of the body, e.g. camera, magnifying lens}
- A61B 5/162: {Testing reaction times}
- A61B 5/4088: {Diagnosing of monitoring cognitive diseases, e.g. Alzheimer, prion diseases or dementia}
- A61B 5/72: {Signal processing specially adapted for physiological signals or for diagnostic purposes}
- G02B 6/12033: {characterised by means for configuring the device, e.g. moveable element for wavelength tuning (switching G02B6/35; thermo-optic devices G02F1/0147)}
- G02F 1/0147: {based on thermo-optic effects (G02F1/132 takes precedence)}
- G02F 1/025: in an optical waveguide structure (G02F1/017, {G02F1/2257} take precedence)
- G02F 1/225: in an optical waveguide structure
- A61B 5/742: {using visual displays (displays for heart-related electrical signals, e.g. ECG, A61B5/339)}
- A61B 5/7475: {User input or interface means, e.g. keyboard, pointing device, joystick}
- G02F 2203/585: Add/drop devices
- G09B 5/06: with both visual and audible presentation of the material to be studied
- G09B 5/065: {Combinations of audio and video presentations, e.g. videotapes, videodiscs, television systems}
- G09B 5/08: providing for individual presentation of information to a plurality of student stations
- G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B)
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02F: OPTICAL DEVICES OR ARRANGEMENTS FOR THE CONTROL OF LIGHT BY MODIFICATION OF THE OPTICAL PROPERTIES OF THE MEDIA OF THE ELEMENTS INVOLVED THEREIN; NON-LINEAR OPTICS; FREQUENCY-CHANGING OF LIGHT; OPTICAL LOGIC ELEMENTS; OPTICAL ANALOGUE/DIGITAL CONVERTERS

## Abstract

A cognitive training method has a step of obtaining sensor data of a subject during a memory exercise which in turn determines whether the sensor data includes predetermined information indicative of cognitive functions used for remembering. The step of advancing the memory exercise is carried out when it is determined that the sensor data includes predetermined information indicative of cognitive functions used for remembering. The step of calculating an objective cognitive assessment of the subject is carried out when the memory exercise is completed and cognitive training is measured at least partially in response to the advancing of the memory exercise. The fact that an objective cognitive assessment is calculated provides a method of using an autodidactic cognitive training device.

## Claims

### Claim 1

An autodidactic method for personalized memory training, comprising:
coupling one or more electroencephalography (EEG) electrodes to a subject;
obtaining real-time sensor data of a subject during a memory exercise, the real-time sensor data comprising EEG data obtained from the subject by the one or more EEG electrodes during the memory exercise and visual data of the subject obtained from a video camera viewing the subject during the memory exercise;
determining throughout the memory exercise whether the real-time sensor data includes predetermined information indicative of cognitive functions used for remembering, wherein a subject's cognitive functions used for remembering comprise immediate memory, visuospatial memory, attention memory and delayed memory, and wherein the memory exercise is configured to evaluate in real-time at least two of the subject's cognitive functions used for remembering as the subject performs the memory exercise;
advancing the memory exercise when it is determined that the real-time sensor data includes the predetermined information indicative of the cognitive functions used for remembering;
calculating an objective cognitive assessment of the subject for determining memory functions of the subject in response to completion of the memory exercise within a predetermined time duration, the objective cognitive assessment of the subject measuring the subject's performance of the cognitive functions used for remembering as such performance varies throughout the memory exercise and calculated in response to the advancing of the memory exercise, time taken to complete the memory exercise and accuracy of the subject's performance of the memory exercise; and
revising the memory exercise to test for an adjusted set of the subject's cognitive functions used for remembering in response to the calculated objective cognitive assessment of the subject by reconfiguring the predetermined time duration for completion of the memory exercise and a complexity of the memory exercise in response to the objective cognitive assessment of the subject.

### Claim 2 (depends on 1)

The method according to claim 1, wherein the memory exercise will not advance when it is determined that the real-time sensor data does not include the predetermined information indicative of the cognitive functions used for remembering.

### Claim 3 (depends on 1)

The method according to claim 1, wherein determining whether the real-time sensor data includes the predetermined information indicative of the cognitive functions used for remembering comprises determining the real-time sensor data includes the predetermined information indicative of cognitive functions used for remembering in response to one or more of a predetermined portion of the memory exercise is completed in a predetermined time duration, a complexity of the memory exercise, a difficulty of the memory exercise, accuracy of the subject and condition of the subject.

### Claim 4 (depends on 1)

The method according to claim 1, further comprising determining whether a score is achieved for a current level of the memory exercise before the step of advancing the memory exercise when it is determined that the real-time sensor data includes the predetermined information indicative of the cognitive functions used for remembering, the score being indicative of the accuracy of the subject's performance of the memory exercise and time taken to complete the memory exercise, and wherein advancing the memory exercise comprises advancing the memory exercise when it is determined that the real-time sensor data includes the predetermined information indicative of the cognitive functions used for remembering and the score determined in response to the accuracy of the subject's performance of the memory exercise is equal to or greater than the score to be achieved for the current level of the memory exercise.

### Claim 5 (depends on 1)

The method according to claim 1, wherein the memory exercise comprises flipping and matching cards illustrating pictures and/or words in different languages to match the pictures and/or words.

### Claim 6 (depends on 1)

The method according to claim 1, wherein the step of determining whether the real-time sensor data includes the predetermined information indicative of the cognitive functions used for remembering comprises passing the EEG data through a filter to determine whether the real-time sensor data includes the predetermined information indicative of the cognitive functions used for remembering.

### Claim 7

An autodidactic personalized memory training device comprising:
at least a first input device and a second input device for receiving real-time sensor data of a subject during a memory exercise, the first input device comprising an electroencephalography (EEG) electrode for receiving real-time EEG sensor data from the subject during the memory exercise and the second input device comprising a video camera for receiving real-time visual information of the subject during the memory exercise, the real-time sensor data comprising the real-time EEG sensor data and the real-time visual information;
a cognitive function evaluator adapted to receive the real-time sensor data from the at least the first input device and the second input device and determine whether the real-time sensor data includes predetermined information indicative of cognitive functions used for remembering, wherein a subject's cognitive functions used for remembering comprise immediate memory, visuospatial memory, attention memory and delayed memory, and wherein the memory exercise is configured for the cognitive function evaluator to evaluate in real-time at least two of the subject's cognitive functions used for remembering as the subject performs the memory exercise;
an exercise device adapted to advance the memory exercise when it is determined that the real-time sensor data includes the predetermined information indicative of cognitive functions used for remembering, the exercise device comprising a calculating device adapted to calculate an objective cognitive assessment of the subject for determining memory functions of the subject in response to completion of the memory exercise within a predetermined time duration, the objective cognitive assessment of the subject measuring the subject's performance of the cognitive functions used for remembering as such performance varies during the memory exercise, wherein the calculating device is further adapted to calculate the objective cognitive assessment of the subject in response to the advancing of the memory exercise, time taken to complete the memory exercise and accuracy of the subject's performance of the memory exercise;
a cognitive assessor coupled to the exercise device and operable to receive and assess the calculated objective cognitive assessment of the subject;
an optimizer coupled to the cognitive assessor and adapted to store information, the information comprising the real-time sensor data and one or more parameters pertaining to the memory exercise; and
a configurator coupled to the optimizer, the configurator adapted to configure the predetermined time duration for completion of the memory exercise and a complexity of the memory exercise in response to the received assessed objective cognitive assessment of the subject, the configurator revising the memory exercise to test for an adjusted set of the subject's cognitive functions used for remembering in response to the calculated objective cognitive assessment of the subject,
wherein the cognitive assessor is adapted to transmit the assessed objective cognitive assessment of the subject to the optimizer.

### Claim 8 (depends on 7)

The autodidactic personalized memory training device according to claim 7, wherein the exercise device is adapted not to advance the memory exercise when it is determined that the real-time sensor data does not include the predetermined information indicative of the cognitive functions used for remembering.

### Claim 9 (depends on 7)

The autodidactic personalized memory training device according to claim 7, wherein the cognitive function evaluator is further adapted to determine the real-time sensor data includes the predetermined information indicative of the cognitive functions used for remembering in response to one or more of a predetermined portion of the memory exercise is completed in the predetermined time duration, the complexity of the memory exercise, the accuracy of the subject's performance of the memory exercise and a condition of the subject.

### Claim 10 (depends on 7)

The autodidactic personalized memory training device according to claim 7, wherein the exercise device is further adapted to determine whether a score is achieved for a current level of the memory exercise in response to the accuracy of the subject's performance of the memory exercise and advance the memory exercise when it is determined that the accuracy of the subject's performance of the memory exercise is equal to or greater than the score to be achieved for the current level of the memory exercise.

### Claim 11 (depends on 7)

The autodidactic personalized memory training device according to claim 7, wherein the at least the first input device and the second input device is coupled to a sensor signal translator, the sensor signal translator operable to translate the real-time sensor data received from the at least the first input device and the second input device, and wherein the cognitive function evaluator is coupled to the sensor signal translator and operable to receive the translated real-time sensor data and determine whether the translated real-time sensor data includes the predetermined information indicative of the cognitive functions used for remembering.

### Claim 12 (depends on 7)

The autodidactic personalized memory training device according to claim 7, wherein the information stored in the optimizer further comprises a subject profile corresponding to the subject.

### Claim 13 (depends on 12)

The autodidactic personalized memory training device according to claim 12, wherein the optimizer is further adapted to update the subject profile of the subject in response to the assessed objective cognitive assessment.

### Claim 14 (depends on 13)

The autodidactic personalized memory training device according to claim 13, wherein the configurator is further adapted to configure the memory exercise in response to the updated subject profile.

### Claim 15 (depends on 14)

The autodidactic personalized memory training device according to claim 14, wherein the configurator is further adapted to adjust the predetermined information indicative of the cognitive functions used for remembering corresponding to the subject in response to the updated subject profile.

### Claim 16 (depends on 7)

The autodidactic personalized memory training device according to claim 7, wherein the memory exercise comprises flipping and matching cards illustrating pictures and/or words in different languages to match the pictures and/or words.

### Claim 17 (depends on 7)

The autodidactic personalized memory training device according to claim 7, wherein the cognitive function evaluator comprises a filter, and wherein the cognitive function evaluator is further adapted to pass the EEG sensor data through the filter so as to determine whether the EEG sensor data includes the predetermined information indicative of the cognitive functions used for remembering.

### Claim 18 (depends on 7)

The autodidactic personalized memory training device according to claim 7, wherein the exercise device is further adapted to advance the memory exercise in accordance with machine learning techniques.

### Claim 19 (depends on 7)

The autodidactic personalized memory training device according to claim 7, wherein the calculating device is further adapted to calculate the objective cognitive assessment of the subject in accordance with probabilistic modeling.

### Claim 20

A system for memory training comprising:
an autodidactic personalized memory training device comprising:
at least a first input device and a second input device for receiving real-time sensor data of a subject during a memory exercise, the first input device comprising an electroencephalography (EEG) electrode for receiving real-time EEG sensor data from the subject during the memory exercise and the second input device comprising a video camera for receiving real-time visual information of the subject during the memory exercise, the real-time sensor data comprising the real-time EEG sensor data and the real-time visual information;
a cognitive function evaluator adapted to receive the real-time sensor data from the at least the first input device and the second input device and determine whether the real-time sensor data includes predetermined information indicative of cognitive functions used for remembering, wherein a subject's cognitive functions used for remembering comprise immediate memory, visuospatial memory, attention memory and delayed memory, and wherein the memory exercise is configured for the cognitive function evaluator to evaluate in real-time at least two of the subject's cognitive functions used for remembering as the subject performs the memory exercise;
an exercise device adapted to advance the memory exercise when it is determined that the real-time sensor data includes the predetermined information indicative of cognitive functions used for remembering, the exercise device comprising a calculating device adapted to calculate an objective cognitive assessment of the subject for determining memory functions of the subject in response to completion of the memory exercise within a predetermined time duration, the objective cognitive assessment of the subject measuring the subject's performance of the cognitive functions used for remembering as such performance varies during the memory exercise, wherein the calculating device is further adapted to calculate the objective cognitive assessment of the subject in response to the advancing of the memory exercise, time taken to complete the memory exercise and accuracy of the subject's performance of the memory exercise;
a cognitive assessor coupled to the exercise device and operable to receive and assess the calculated objective cognitive assessment of the subject;
an optimizer coupled to the cognitive assessor and adapted to store information, the information comprising the real-time sensor data and one or more parameters pertaining to the memory exercise; and
a configurator coupled to the optimizer, the configurator adapted to configure the predetermined time duration for completion of the memory exercise and a complexity of the memory exercise in response to the received assessed objective cognitive assessment of the subject, the configurator revising the memory exercise to test for an adjusted set of the subject's cognitive functions used for remembering in response to the calculated objective cognitive assessment of the subject,
wherein the cognitive assessor is adapted to transmit the assessed objective cognitive assessment of the subject to the optimizer; and
a server coupled to the autodidactic personalized memory training device and comprising a receiver operable to receive the objective cognitive assessment of the subject from the autodidactic personalized memory training device.

### Claim 21 (depends on 20)

The system according to claim 20, wherein the server is operable to receive and store a subject profile corresponding to the subject, and wherein the optimizer is further adapted to update the subject profile of the subject in response to the assessed objective cognitive assessment, and wherein the configurator is further adapted to configure the memory exercise and adjust the predetermined information indicative of cognitive functions used for remembering corresponding to the subject in response to one or more of the subject profile or the updated subject profile.

### Claim 22 (depends on 20)

The system according to claim 20 further comprising two or more additional autodidactic personalized memory training devices, wherein the receiver is further operable to receive the objective cognitive assessment of two or more additional subjects calculated by the two or more additional autodidactic personalized memory training devices and wherein the server is further operable to correlate the two or more additional subjects with their respective objective cognitive assessments.

### Claim 23 (depends on 22)

The system according to claim 22, wherein the server is operable to receive and store subject profiles corresponding to each of the two or more additional subjects.

### Claim 24

A non-transitory computer readable medium for autodidactic personalized memory training, the computer readable medium having stored thereon computer program code which when executed by a computer causes the computer to perform at least the following:
receiving real-time sensor data of a subject during a memory exercise, the real-time sensor data comprising electroencephalography (EEG) data from one or more EEG electrodes coupled to the subject during the memory exercise and visual data of the subject obtained from a video camera viewing the subject during the memory exercise;
determining throughout the memory exercise whether the real-time sensor data obtained from the subject during the memory exercise includes predetermined information indicative of cognitive functions used for remembering, and wherein a subject's cognitive functions used for remembering comprises immediate memory, visuospatial memory, attention memory and delayed memory, and wherein the memory exercise is configured to evaluate in real-time at least two of the subject's cognitive functions used for remembering as the subject performs the memory exercise;
advancing the memory exercise when it is determined that the real-time sensor data includes predetermined information indicative of the cognitive functions used for remembering;
calculating an objective cognitive assessment of the subject for determining memory functions of the subject in response to completion of the memory exercise within a predetermined time duration, wherein the objective cognitive assessment of the subject measures the subject's performance of the cognitive functions used for remembering as such performance varies throughout the memory exercise and calculated in response to the advancing of the memory exercise, time taken to complete the memory exercise and accuracy of the subject's performance of the memory exercise; and
revising the memory exercise to test for an adjusted set of the subject's cognitive functions used for remembering in response to the calculated objective cognitive assessment of the subject by reconfiguring the predetermined time duration for completion of the memory exercise and a complexity of the memory exercise in response to the objective cognitive assessment of the subject.

### Claim 25 (depends on 16)

The autodidactic personalized memory training device according to claim 16, further comprising a memory exercise input control device coupled to the exercise device for the subject to flip and match the cards, the memory exercise input control device comprising one or more of a computer keyboard, a computer joy stick and a computer mouse control.