Method, computer program, and computer-readable medium for detecting outlier evaluators in a decision-making process

A method for detecting the outlier evaluators in an evaluation process comprising steps of:

• a. collecting a data matrix Sij to a computer system using an automatic input interface, wherein the elements of the matrix Sij are the real numbers in a predefined range, wherein each of the elements of the matrix Sij represent a numerical evaluation provided by an evaluator j for an evaluated entity i,
• b. for each of the entity i calculating by the computer system an Initial Consensus in a form of a vector Mi using a robust measure of location,
• c. calculating by the computer system an Adjusted Distances EDj between each of the data matrix Sij provided by the evaluator j for the entity i and the Initial Consensus Mi,
• d. applying by the computer system a nonlinear transformation function ƒ to the Adjusted Distances EDj,
• E
• ⁢
• D
• j
• *
• =
• f
• ⁡
• (
• E
• ⁢
• D
• j
• )
• e. identifying by the computer system the outlier evaluators by detecting the transformed Adjusted Distances ED*j exceeding a robust upper-bound threshold.