Closed loop voting feedback
AssigneeAmazon Technologies, Inc.
InventorsMatthew Round, Aniruddha Gadre
Life of this patent
Estimating the term…
Abstract
Embodiments of the present invention provide a system and method for providing reviewer feedback identifying a correlation between a reviewer's past voting record and successful results. Based on a reviewer's past record, the reviewer may be assigned a power rating identifying the statistical accuracy of the reviewer's voting history. That power rating may be used to weight future votes, thereby increasing the likelihood that accurate decisions will be made.
Claims49
A method for determining a power rating for a user, the method comprising:
- receiving a reviewer's vote with respect to a decision to be made;
- following the decision, determining if the reviewer's vote is reflective of a desired outcome of the decision;
- and
- determining a power rating for the reviewer based at least in part on the determination of whether the reviewer's vote is reflective of the desired outcome.
A method for increasing the likelihood that decisions resulting in a desired outcome will be made, the method comprising:
- receiving from a plurality of reviewers a vote regarding a decision to be made;
- determining a power rating reflective of a likelihood of predicting outcomes on decisions for each of the reviewers from which a vote was received;
- weighting the votes based on the determined power ratings;
- and
- determining a group decision based on the weighted votes.
A method for providing feedback based on voting activity of a reviewer, the method comprising:
- receiving a reviewer's vote with respect to a decision to be made;
- determining a consistency of the reviewer's vote in relation to votes of other reviewers with respect to the decision to be made, wherein the consistency of the reviewer's vote provides feedback regarding the review's consistency with respect to votes of other reviewers.
A computer-accessible medium having instructions stored thereon that direct a computing system to:
- receive a first plurality of votes corresponding to a decision to be made with respect to an object, wherein at least one of the first plurality of votes corresponds to a first vote received from a reviewer;
- based on the first plurality of received votes, determine a first action to take with respect to the object;
- receive a second plurality of votes corresponding to the decision to be made with respect to the object, wherein at least one of the second plurality of votes corresponds to a second vote received from the reviewer;
- based on the second plurality of received votes, determine a second action to take with respect to the object;
- receive a performance review of the object;
- and
- determine a power rating of the reviewer based on a correlation between the performance review and the first vote and second vote received from the reviewer.
A method for determining a power rating of a reviewer, the method comprising:
- obtaining a performance review of an object;
- determining a voting result based on a comparison of the performance review of the object and an overall voting score;
- and
- determining the power rating of the reviewer based on the determined voting result.
A reviewer power rating system for rating reviewers of job candidates based on past performance, comprising:
- voting data for a reviewer representative of votes provided by a reviewer for job candidates;
- a power rating module for determining a power rating for the reviewer based on a performance of hired job candidates;
- and
- a comparison module for comparing the power rating of the reviewer with a power rating of a second reviewer.
Dependencies are inferred from the claim text.