Systems and methods for automated document review and quality control

A system for automated document review and quality control, the system comprising:

• a division module, stored in memory, that divides a set of documents to be reviewed for relevancy into:
• a set of control documents;
• a set of training documents;
• a set of quality-control documents;
• and
• a set of review documents;
• a calculation module, stored in memory, that calculates;
• based on a set of reviews performed by a group of reviewers on the set of quality-control documents, an effective speed score for each reviewer in the group of reviewers, wherein the effective speed score indicates a reviewer's ability to accurately complete a review in a given time, wherein accuracy is determined by agreement between the reviewer and other reviewers;
• an assignment module, stored in memory, that assigns, based on the effective speed score, the set of control documents and the set of training documents to the group of reviewers;
• a training module, stored in memory, that trains a predictive model using a set of training reviews performed by the group of reviewers on both the set of training documents and the set of control documents;
• an evaluation module;
• stored in memory, that uses the predictive model to evaluate the set of review documents;
• and
• at least one processor that executes the division module, the calculation module, the assignment module, the training module, and the evaluation module.

A non-transitory computer-readable medium comprising one or more computer-executable instructions that, when executed by at least one processor of a computing device, cause the computing device to:

• divide a set of documents to be reviewed for relevancy into:
• a set of control documents;
• a set of training documents;
• a set of quality-control documents;
• and
• a set of review documents;
• calculate, based on a set of reviews performed by a group of reviewers on the set of quality-control documents, an effective speed score for each reviewer in the group of reviewers, wherein the effective speed score indicates a reviewer's ability to accurately complete a review in a given time, wherein accuracy is determined by agreement between the reviewer and other reviewers;
• assign, based on the effective speed score, the set of control documents and the set of training documents to the group of reviewers;
• train a predictive model using a set of training reviews performed by the group of reviewers on both the set of training documents and the set of control documents;
• and
• use the predictive model to evaluate the set of review documents.