Method of evaluation fit of raw data to model data

A method for evaluating the fit of raw data to model data, the method comprising:

• receiving a plurality of associations, wherein each association pertains to a relationship between one of a plurality of assessment items for an assessment examination and one of a plurality of attributes;
• receiving a plurality of responses, wherein each response pertains to an answer by one of a plurality of examinees to one of the plurality of assessment items;
• receiving a plurality of mastery estimates, wherein each mastery estimate represents whether one of the plurality of examinees has mastered one of the plurality of attributes;
• receiving one or more parameters based on an expected assessment item performance;
• determining whether an item for an examinee falls into at least one of a plurality of item classes based upon the mastery estimates for the examinee and the associations for the assessment item;
• generating one or more statistics, wherein each statistic is based on one or more of the associations, responses, mastery estimates and parameters;
• and
• outputting at least one of the one or more statistics.

A method for evaluating the fit of raw data to model data, the method comprising:

• receiving a plurality of associations, wherein each association pertains to a relationship between one of a plurality of assessment items for an assessment examination and one of a plurality of attributes;
• receiving a plurality of responses, wherein each response pertains to an answer by one of a plurality of examinees to one of the plurality of assessment items;
• receiving a plurality of mastery estimates, wherein each mastery estimate represents whether one of the plurality of examinees has mastered one of the plurality of attributes;
• receiving a plurality of proficiency estimates for non-tested attributes for each examinee;
• receiving a plurality of item parameter estimates for each item;
• generating one or more statistics, wherein each of the statistics is based on one or more of the associations, responses, mastery probabilities, proficiency estimates, and item probabilities;
• and
• outputting at least one of the one or more statistics.

A method for evaluating the fit of raw data to model data, the method comprising:

• receiving a plurality of associations, wherein each association pertains to a relationship between one of a plurality of assessment items for an assessment examination and one of a plurality of attributes;
• receiving a plurality of responses, wherein each response pertains to an answer by one of a plurality of examinees to one of the plurality of assessment items;
• receiving a plurality of mastery estimates files, wherein each mastery estimate files contains a set of mastery estimates, wherein each mastery estimate represents whether one of the plurality of examinees has mastered one of the plurality of attributes;
• receiving a plurality of mastery parameters;
• determining whether each examinee falls into at least one of a plurality of examinee classes for an assessment item based upon the mastery probabilities for the examinee and the associations for the assessment item;
• optimizing a plurality of mastery thresholds;
• generating one or more statistics, wherein each statistic is based on one or more of the associations, responses, mastery probabilities and mastery parameters, wherein the one or more statistics comprise one or more mastery thresholds;
• and
• outputting at least one of the one or more statistics.

A system for evaluating the fit of raw data to model data, the system comprising:

• a processor;
• a computer-readable storage medium operably connected to the processor, wherein the computer-readable storage medium contains one or more programming instructions for performing a method for evaluating the fit of raw data to model data, the method comprising:
• receiving a plurality of associations, wherein each association pertains to a relationship between one of a plurality of assessment items for an assessment examination and one of a plurality of attributes,
• receiving a plurality of responses, wherein each response pertains to an answer by one of a plurality of examinees to one of the plurality of assessment items,
• receiving a plurality of mastery estimates, wherein each mastery estimate represents whether one of the plurality of examinees has mastered one of the plurality of attributes,
• determining whether an examinee falls into at least one of a plurality of examinee classes for an assessment item based upon the mastery estimates for the examinee and the associations for the assessment item,
• generating one or more statistics, wherein each statistic is based on one or more of the associations, responses and mastery estimates, and
• outputting at least one of the one or more statistics.

A system for evaluating the fit of raw data to model data, the system comprising:

• a processor;
• a computer-readable storage medium operably connected to the processor, wherein the computer-readable storage medium contains one or more programming instructions for performing a method for evaluating the fit of raw data to model data, the method comprising:
• receiving a plurality of associations, wherein each association pertains to a relationship between one of a plurality of assessment items for an assessment examination and one of a plurality of attributes,
• receiving a plurality of responses, wherein each response pertains to an answer by one of a plurality of examinees to one of the plurality of assessment items,
• receiving a plurality of mastery estimates, wherein each mastery estimate represents whether one of the plurality of examinees has mastered one of the plurality of attributes,
• receiving one or more parameters based on an expected assessment item performance,
• determining whether an item for an examinee falls into at least one of a plurality of item classes based upon the mastery estimates for the examinee and the associations for the assessment item,
• generating one or more statistics, wherein each statistic is based on one or more of the associations, responses, mastery estimates and parameters, and
• outputting at least one of the one or more statistics.

A system for evaluating the fit of raw data to model data, the system comprising:

• a processor;
• a computer-readable storage medium operably connected to the processor, wherein the computer-readable storage medium contains one or more programming instructions for performing a method for evaluating the fit of raw data to model data, the method comprising:
• receiving a plurality of associations, wherein each association pertains to a relationship between one of a plurality of assessment items for an assessment examination and one of a plurality of attributes,
• receiving a plurality of responses, wherein each response pertains to an answer by one of a plurality of examinees to one of the plurality of assessment items,
• receiving a plurality of mastery estimates, wherein each mastery estimate represents whether one of the plurality of examinees has mastered one of the plurality of attributes,
• receiving a plurality of proficiency estimates for non-tested attributes for each examinee,
• receiving a plurality of item parameter estimates for each item,
• generating one or more statistics, wherein each of the statistics is based on one or more of the associations, responses, mastery probabilities, proficiency estimates, and item probabilities, and
• outputting at least one of the one or more statistics.

A system for evaluating the fit of raw data to model data, the system comprising:

• a processor;
• a computer-readable storage medium operably connected to the processor, wherein the computer-readable storage medium contains one or more programming instructions for performing a method for evaluating the fit of raw data to model data, the method comprising:
• receiving a plurality of associations, wherein each association pertains to a relationship between one of a plurality of assessment items for an assessment examination and one of a plurality of attributes,
• receiving a plurality of responses, wherein each response pertains to an answer by one of a plurality of examinees to one of the plurality of assessment items,
• receiving a plurality of mastery estimates files, wherein each mastery estimate files contains a set of mastery estimates, wherein each mastery estimate represents whether one of the plurality of examinees has mastered one of the plurality of attributes,
• receiving a plurality of mastery parameters,
• determining whether each examinee falls into at least one of a plurality of examinee classes for an assessment item based upon the mastery probabilities for the examinee and the associations for the assessment item,
• optimizing a plurality of mastery thresholds,
• generating one or more statistics, wherein each statistic is based on one or more of the associations, responses, mastery probabilities and mastery parameters, wherein the one or more statistics comprise one or more mastery thresholds;
• and
• outputting at least one of the one or more statistics.