Method and system for classification of student progress in solving a complex problem

A computer implemented method of training a machine learning (ML) artificial intelligence system comprising an ML model, the method comprising:

• collecting a plurality of test solutions from first and second subjects, wherein the plurality of test solutions for each of the first and second subjects are test solutions to different test questions answered by the first and second subjects;
• creating solution graphs of the collected test solutions;
• clustering the solution graphs based on a graph-clustering criterion;
• building a path for the first and second subjects, wherein the path of the first and second subjects comprises a sequence of solution graph clusters;
• storing the paths of the first and second subjects in a nontransitory storage medium as a behavioral cluster:
• preparing a training dataset comprising the behavioral cluster:
• training the ML model using the training dataset;
• collecting a plurality of test solutions from a third subject:
• creating solution graphs of the plurality of test solutions from the third subject:
• clustering the plurality of test solutions from the third subject into test solution graph clusters using the trained ML model;
• and
• building a path for the test solution graph clusters from the third test subject and assigning the solution graph clusters from the third test subject to the behavioral cluster.

A system for training an artificial intelligence machine learning device for automatic classification of a first subject's progress corresponding to a test for which the first subject submits multiple solutions over a period of time, the system comprising:

• a processor coupled to a nontransitory storage medium for storing a training dataset:
• a training dataset stored in the nontransitory storage medium, the training dataset comprising solution graphs of test solutions for different questions given by the subject that have been clustered into behavioral clusters;
• a machine learning model under program control of the processor:
• wherein the machine learning model has been trained on the training dataset and wherein the machine learning model is configured for clustering the solution graphs from a second subject into behavioral clusters.