Method and system for computer-assisted test construction performing specification matching during test item selection

A computer system for constructing a test, comprising:

• a processor;
• a memory;
• and
• a display,
• the processor configured to execute steps comprising:
• receiving at a computer a selection for a test item for inclusion in a set of test items;
• updating with the computer a correlation value based on the set of test items including the selected test item, wherein the correlation value indicates an extent of correlation between the set of test items and a test specification, the test specification comprising one or more of an overall test difficulty rating, a correlation between a correct response for a selected test item and a particular cognitive or behavioral trait, an orientation of the presentation of questions and answers for the set of selected test items, a number of pages of text for a test, a mean point-biserial, a mean r-biserial, and an arrangement of the set of selected test items;
• determining with the computer whether the set of test items including the selected item satisfies the test specification;
• if the set of test items including the selected test item does not satisfy the test specification, receiving input at the computer revising the set of test items in order to satisfy the test specification.

An article of manufacture for constructing a test, the article comprising a computer-readable storage medium having instructions embodied therein for causing for a computer to execute steps including:

• receiving at the computer a selection for a test item for inclusion in a set of test items;
• updating with the computer a correlation value based on the set of test items including the selected test item, wherein the correlation value indicates an extent of correlation between the set of test items and a test specification, the test specification comprising one or more of an overall test difficulty rating, a correlation between a correct response for a selected test item and a particular cognitive or behavioral trait, an orientation of the presentation of questions and answers for the set of selected test items, a number of pages of text for a test, a mean point-biserial, a mean r-biserial, and an arrangement of the set of selected test items;
• determining with the computer whether the set of test items including the selected item satisfies the test specification;
• if the set of test items including the selected test item does not satisfy the test specification, receiving input at the computer revising the set of test items in order to satisfy the test specification.