Back to results
US 2018/0018540 A1Published application
Method for adaptive learning utilizing facial recognition
AssigneeEdTech Learning LLC
InventorsPhillip Hazur, Elizabeth Hazur
Life of this patent
Estimating the term…
Abstract
A computer implemented method for significantly increasing the efficacy of computer adaptive learning (which currently measures and acts on a learner's performance in the cognitive or objective learning domain of education) by additionally detecting and identifying the learner's emotional response data and together with the cognitive data, optimizing the educational content being presented. These emotional responses constitute the affective or emotional domain of education.
Claims20
A computer implemented method for integrating affective based user data with traditional cognitive data in computer adaptive learning comprising:
- presenting to a learner one or more instructional components comprising full instructional component metadata for the adaptive learning system to reference;
- capturing affective data in a learning profile for each learner in reaction to the one or more instructional components, wherein the affective data includes facial expression data captured while the one or more instructional components are presented;
- inferring emotional states, using one or more processors to analyze the facial expression data which was captured;
- capturing cognitive data for the learner based on the learner's correct or incorrect answer to the one or more instructional components, wherein the cognitive data is indicative of the learner's performance in responding to the one or more instructional components;
- assigning a positive or negative adaptivity score based on the individual's emotional state as well as the cognitive data, wherein the negative adaptivity score is based on a negative emotional state and/or a negative cognitive score based on incorrect answers to the one or more instructional components and indicates a need to provide an alternative learning pathway relating to the one or more instructional components, and the positive adaptivity score is based on a positive emotional state and/or a positive cognitive score based on correct answers to the one or more instructional components and indicates that the individual is prepared for advancement to a higher level of learning;
- populating the learner profile with the adaptivity score;
- and
- generating supplemental learner profile data by combining the cognitive data and affective data and comparing the supplemental learner profile data to a normed learner population data to select an adaptive instruction to provide to the learner;
- populating the learner profile with the cognitive score to provide a learner profile containing learning modalities for the learner;
- and
- providing alternative remedial instructional components to the learner relating to the one or more instructional components in the event of a negative adaptivity score, and presenting advanced instructional components to the learner in the event of a positive adaptivity score, wherein the step of providing alternative remedial instructional components and presenting advanced instructional components further takes into account the supplemental learner profile data and the learning modalities for the learner.
8 more elements
A computer system for cognitive and affective based computer adaptive learning comprising:
- a memory for storing instructions;
- a webcam for capturing facial data;
- one or more processors attached to the memory wherein the one or more processors are configured to:
- present one or more instructional components to a learner;
- capture affective state data of the learner in response to the one or more instructional components, wherein the emotional state data includes facial data while the one or more instructional components are presented;
- infer emotional states, using one or more processors to analyze the facial data which was captured;
- capture cognitive data for the learner based on the learner's correct or incorrect answer to the one or more instructional components, wherein the cognitive data is indicative of the learner's performance in responding to the one or more instructional components;
- assign a positive or negative adaptivity score based on the individual's emotional state as well as the cognitive data, wherein the negative adaptivity score is based on a negative affective state and/or a negative cognitive score based on incorrect answers to the one or more instructional components and indicates a need to provide an alternative learning pathway relating to the one or more instructional components, and the positive adaptivity score is based on a positive emotional state and/or a positive cognitive score based on correct answers to the one or more instructional components and indicates that the individual is prepared for advancement to a higher level of learning;
- populate a learner profile with the adaptivity score;
- and
- provide alternative learning content to the learner relating to the one or more instructional components in the event of a negative adaptivity score, and presenting a higher level of learning to the learner in the event of a positive adaptivity score.
8 more elements
A computer implemented method for affect based ranking comprising:
- presenting one or more instructional component to a learner;
- capturing emotional state data of the learner in response to the one or more instructional component;
- inferring emotional states, using one or more processors, based on the emotional state data which was captured and analysis of the facial data, said emotional states comprising one or more of:
- disappointment, hesitation, cognitive overload, focusing, exploration, confidence, trust, delight, skepticism, satisfaction, fear, disgust, anger, surprise, comprehension, happiness, and sadness;
- capturing cognitive data for the learner based on a response of the learner to the one or more instructional component;
- assigning a positive or negative adaptivity score based on the individual's emotional state and cognitive data;
- populating a learner profile with the adaptivity score;
- and
- providing alternative learning relating to the one or more instructional components in the event of a negative adaptivity score, and presenting a higher level of learning to the learner in the event of a positive adaptivity score.
6 more elements
Dependencies are inferred from the claim text.