System and method for rating of enterprise using crowdsourcing in combination with weighted evaluator ratings

A method for programmatically determining an overall rating of an evaluee, the method comprising:

• under control of a hardware processor:
• (a) outputting a user interface comprising a first interface element and configured to provide functionality for each one of a plurality of evaluators to provide a rating of the evaluee, the rating based on one or more desired attributes of the evaluee;
• (b) storing the rating by each one of the plurality of evaluators in a memory;
• (c) determining an initial quantitative measure for each evaluator;
• (d) programmatically applying a respective initial quantitative measure to the rating provided by each evaluator to generate, for each evaluator, an initial weighted rating of the evaluee;
• (e) programmatically combining the initial weighted rating of all evaluators to determine an initial weighted-average rating of the evaluee;
• (f) programmatically determining an updated quantitative measure for each evaluator representative of a differential between the initial rating of an evaluator and the initial weighted-average rating of the evaluee;
• (g) for each evaluator, programmatically applying a respective updated quantitative measure to each rating to generate an updated weighted rating;
• (h) programmatically combining the updated weighted rating of all evaluators to generate an updated weighted-average rating of the evaluee;
• (i) programmatically determining an updated quantitative measure for each evaluator representative of a differential between the rating of an evaluator and the updated weighted-average rating of the evaluee;
• (j) repeating steps (g) through (i) until the differential of step (i) is less than a predetermined value, or until steps (g) through (i) have been repeated a predetermined number of iterations;
• (k) when the differential of the step (i) is less than the predetermined value, combining a more recent updated weighted rating of all evaluators to generate the overall rating of the evaluee;
• (l) forming a data structure for each evaluee including a first field indicating an identifier for the evaluee and a second field indicating the overall rating of the evaluee.

A non-transitory machine-readable storage medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform a method for determining an overall rating of an evaluee based on a rating supplied by each one of a plurality of evaluators, the method comprising:

• (a) determining an initial quantitative weight for each evaluator;
• (b) applying a respective initial quantitative weight to the rating provided by each evaluator to generate, for each evaluator, an initial weighted rating of the evaluee;
• (c) combining the initial weighted rating of each evaluator to determine an initial weighted-average rating of the evaluee;
• (d) determining an updated quantitative weight for each evaluator representative of a differential between the initial rating by an evaluator and the initial weighted-average rating of the evaluee;
• (e) for each evaluator, applying a respective updated quantitative weight to each rating to generate an updated weighted rating;
• (f) combining the updated weighted rating of all evaluators to generate an updated weighted-average rating of the evaluee;
• (g) determining an updated quantitative measure for each evaluator representative of a differential between the rating of an evaluator and the updated weighted-average rating of the evaluee;
• (h) repeating steps (e) through (g) until the differential of step (g) is less than a predetermined value or until steps (e) through (g) have been repeated a predetermined number of iterations;
• and
• (i) when the differential of step (g) is less than the predetermined value or the steps (e) through (g) have been repeated the predetermined number of iterations, combining a most recent updated weighted rating of all evaluators to generate the overall rating of the evaluee.

An apparatus comprising:

• a display;
• at least one processor;
• and
• at least one memory including one or more sequences of instructions,
• the at least one memory and the one or more sequences of instructions operative with the at least one processor configured to cause the apparatus to perform at least the following:
• receive identifying criteria for each one of a plurality of evaluators;
• receive identifying criteria for an evaluee;
• receive a rating of the evaluee as supplied by each evaluator;
• receive an initial quantitative measure for each evaluator;
• for each evaluator, determine an initial weighted rating of the evaluee by applying a respective initial quantitative measure for each evaluator to the rating of the evaluee supplied by each evaluator;
• combine the initial weighted rating of the evaluee as supplied by each evaluator to determine an initial weighted-average rating;
• determine an updated quantitative measure for each evaluator representative of a differential between an initial rating by an evaluator, and an initial weighted-average rating of the evaluee;
• for each evaluator apply the respective updated quantitative measure to each rating to generate an updated weighted rating;
• and
• combine the updated weighted rating of each evaluator to determine an updated weighted-average rating.