US 2021/0343175 A1 · SYSTEMS AND METHODS FOR ADAPTIVE ASSESSMENT

Abstract

Systems and methods for adaptive assessment may utilize test deliver policies derived from a multi-armed bandit approach in combination with an item response theory model. A monotonic policy may involve defining a difficulty range according to which test items are selected for delivery during an assessment, where the difficulty range is updated following delivery of each test item based on test-taker performance. A multi-stage policy may implement several stages for test item delivery, with a different initial difficulty range for test item selection being defined for each stage and the difficulty ranges being updated based on test-taker performance within each respective stage. A probability matching policy may involve defining an item difficulty probability distribution according to which test items are selected for delivery to a test taker, where the probability distribution is initialized based on test taker skill level and updated based on test taker performance.

Claims20

Dependent claims

A system comprising:

a server that is in electronic communication with a user device associated with a user account, the server comprising:
a processor;
and
a memory device configured to store computer-readable instructions, which, when executed, cause the processor to:
initiate an assessment;
select a first test item from a test item bank based on first test item selection parameters;
cause a client device to deliver the first test item;
receive first response data from the client device;
perform analysis of the first response data;
produce second test item selection parameters by modifying the first test item selection parameters based on the analysis of the first response data;
select a second test item from the test item bank based on the second test item selection parameters;
cause the client device to deliver the second test item;
determine that an end condition has been met;
and
responsive to determining that the end condition has been met, end the assessment.

12 more elements

A system comprising:

a server that is in electronic communication with a user device associated with a user account, the server comprising:
a processor;
and
a memory device configured to store computer readable instructions, which, when executed, cause the processor to:
initiate an assessment;
generate a random number;
select a first test item based on test item selection parameters and the random number, the first test item selection parameters defining a first difficulty range, wherein the first test item has a first difficulty value that is within the difficulty range;
cause a client device to deliver the first test item;
receive first response data from the client device;
perform analysis of the first response data;
update the test item selection parameters by increasing the first difficulty range to a second difficulty range based on the analysis of the first response data;
generate a second random number;
select a second test item having a second difficulty value within the second difficulty range based on the second random number;
cause the client device to deliver the second test item;
determine that a first end condition has been met;
and
end the assessment.

14 more elements

A system comprising:

a server that is in electronic communication with a user device associated with a user account, the server comprising:
a processor;
and
a memory device configured to store computer-readable instructions, which, when executed, cause the processor to:
initiate an assessment;
select a first test item from a test item bank based on a first item difficulty probability distribution;
cause a client device to deliver the first test item to a user;
receive first response data from the client device corresponding to a first response submitted by the user;
generate a second item difficulty probability distribution based on the first response data;
select a second test item from the test item bank based on the second item difficulty probability distribution;
cause the client device to deliver the second test item to the user;
determine that an end condition has been met;
and
responsive to determining that the end condition has been met, end the assessment.

11 more elements

Dependencies are inferred from the claim text.

Systems and methods for adaptive assessment

Life of this patent

Systems and methods for adaptive assessment

Life of this patent

Abstract

Claims20