Selection of individuals from a pool of candidates in a competition system

A method of ensuring fair and consistent evaluation comprising:

• providing an evaluation workstation for use by an evaluator;
• making available candidate applications from one or more candidates needing evaluation;
• matching said evaluator to one or more of said candidate applications;
• receiving a request from said evaluator to evaluate one of said one or more candidate applications;
• providing one or more eligibility questions to said evaluator;
• receiving responses to said eligibility questions;
• determining from said responses to said eligibility questions whether said evaluator is eligible to evaluate said one candidate application;
• preventing said evaluator from evaluating said candidate application responsive to said first determination indicating said evaluator is not eligible to evaluate said candidate application;
• providing one or more candidate eligibility questions to said evaluator;
• receiving responses to said candidate eligibility questions;
• determining from said responses to said candidate eligibility questions whether said candidate is eligible to be evaluated;
• preventing said evaluator from evaluating said candidate application responsive to said second determination indicating said candidate is not eligible to be evaluated;
• presenting in a substantially simultaneous manner, said candidate application, an evaluation rubric, and a scoring display to said evaluator;
• monitoring the evaluation of said candidate package by said evaluator by at least one of detecting whether the average time between question responses is less than a minimum time period, determining whether the average time between question responses is less than the average time period between question responses for said evaluator during past evaluations, determining whether the average evaluation score is above a maximum score, determining whether the average evaluation score is below a minimum score, and determining whether any evaluation score is inconsistent with information in said candidate application;
• and
• interacting with said evaluation responsive to the determination that said evaluation is unfair or inconsistent,
• wherein at least one of the foregoing steps comprises an automated decision step.

A method of monitoring the evaluation of individuals in a pool of candidates in a competition system comprising:

• receiving one or more evaluator responses for an evaluation from a first evaluator;
• analyzing said evaluation responses by comparing an average time between said evaluator responses given in said evaluation to an average time between evaluator responses for one or more evaluator responses given by a second evaluator;
• and
• determining whether said evaluation should be nullified based on said analysis, wherein at least one of the foregoing steps comprises an automated decision step.