Automated accuracy assessment in tasking system

A computer program product stored on a non-transitory computer-readable storage medium comprising stored executable computer program instructions for determining an accuracy of computerized tasks in a task batch, the computer program instructions when executed by a computer processor cause the computer processor to:

• receive, at an online system, a sourced task from an authoring user;
• calculate, by the online system, a probability that the sourced task is completed correctly based on a source accuracy of the authoring user from one or more factors calculated by a predictive model;
• compare the probability to a quality threshold of a customer;
• and
• execute, responsive to the probability not meeting or exceeding the quality threshold of the customer, instructions that further cause the processor to:
• calculate a number of reviews to assess an accuracy of the sourced task based on the source accuracy and a reviewer accuracy, the reviewer accuracy based on a true positive rate and a true negative rate of one or more reviewers of the task batch;
• transmit, by the online system, the sourced task to a same number of reviewers;
• receive, by the online system, the number of reviews from the reviewers, the number of received reviews indicating whether the sourced task passes review or does not pass review;
• and
• transmit the sourced task to the customer responsive to the number of received reviews indicating the sourced task passes review.

An online system configured for determining an accuracy of computerized tasks in a task batch, the online system configured to:

• receive a sourced task from an authoring user;
• calculate a probability that the sourced task is completed correctly based on a source accuracy of the authoring user from one or more factors calculated by a predictive model;
• compare the probability to a quality threshold of a customer;
• and
• responsive to the probability not meeting or exceeding the quality threshold of the customer:
• calculate a number of reviews to assess an accuracy of the sourced task based on the source accuracy and a reviewer accuracy, the reviewer accuracy based on a true positive rate and a true negative rate of one or more reviewers of the task batch;
• transmit the sourced task to a same number of reviewers;
• receive the number of reviews from the reviewers, the number of received reviews indicating whether the sourced task passes review or does not pass review;
• and
• transmit the sourced task to the customer responsive to the number of received reviews indicating the sourced task passes review.