Inter-reviewer conflict resolution

An apparatus, comprising:

• at least one processor;
• and
• a computer readable storage medium having computer readable program code embodied therewith and executable by the at least one processor, the computer readable program code comprising:
• computer readable program code configured to receive a plurality of review comments from each of a plurality of reviewers tasked with reviewing a document;
• computer readable program code configured to categorize, for each of the plurality of reviewers, each of the plurality of review comments into one of a plurality of review topics;
• computer readable program code configured to identify a plurality of conflicts, each of the plurality conflicts being between (a) a first review comment categorized into a review topic and provided by one of the plurality of reviewers and (b) a second review comment categorized into the same review topic and provided by another of the plurality of reviewers, wherein the identifying a conflict comprises (i) identifying a sentiment of the first review comment and a sentiment of the second review comment and (ii) determining that the sentiment of the first review comment and the sentiment of the second review comment are different;
• and
• computer readable program code configured to generate a plurality of question sets, each comprising a plurality of questions and each generated for one of the plurality of reviewers, the plurality of question sets being generated based upon the plurality of conflicts identified from the plurality of review comments, wherein a reviewer of the plurality of reviewers answering a question of the question set provided to the reviewer resolves a conflict related to the question;
• wherein each of the plurality of question sets comprises a minimal question set comprising a fewest number of questions that resolve the identified plurality of conflicts, wherein generating each of the minimal question sets comprises generating a first question set, determining, by validating the first question set against identified parameters, at least a subset of questions present in the first question set are irrelevant, identifying redundant questions within the first question set and across other first question sets generated for other of the plurality of reviewers, and removing the at least a subset of questions and the redundant questions to generate the minimal question set.

A computer program product, comprising:

• a computer readable storage medium having computer readable program code embodied therewith, the computer readable program code executable by a processor and comprising:
• computer readable program code configured to receive a plurality of review comments from each of a plurality of reviewers tasked with reviewing a document;
• computer readable program code configured to categorize, for each of the plurality of reviewers, each of the plurality of review comments into one of a plurality of review topics;
• computer readable program code configured to identify a plurality of conflicts, each of the plurality conflicts being between (a) a first review comment categorized into a review topic and provided by one of the plurality of reviewers and (b) a second review comment categorized into the same review topic and provided by another of the plurality of reviewers, wherein the identifying a conflict comprises (i) identifying a sentiment of the first review comment and a sentiment of the second review comment and (ii) determining that the sentiment of the first review comment and the sentiment of the second review comment are different;
• and
• computer readable program code configured to generate a plurality of question sets, each comprising a plurality of questions and each generated for one of the plurality of reviewers, the plurality of question sets being generated based upon the plurality of conflicts identified from the plurality of review comments, wherein a reviewer of the plurality of reviewers answering a question of the question set provided to the reviewer resolves a conflict related to the question;
• wherein each of the plurality of question sets comprises a minimal question set comprising a fewest number of questions that resolve the identified plurality of conflicts, wherein generating each of the minimal question sets comprises generating a first question set, determining, by validating the first question set against identified parameters, at least a subset of questions present in the first question set are irrelevant, identifying redundant questions within the first question set and across other first question sets generated for other of the plurality of reviewers, and removing the at least a subset of questions and the redundant questions to generate the minimal question set.

A method, comprising:

• obtaining a plurality of document evaluation comments from each of a plurality of evaluators corresponding to evaluation of a document;
• classifying each of the evaluation comments into one of a plurality of evaluation topics, wherein the classifying comprises extracting phrases from the evaluation comments and classifying the extracted phrases;
• detecting, for each of the evaluation topics, a plurality of disagreements, each of the plurality of disagreements being between a first evaluation comment provided by one of the plurality of reviewers and a second evaluation comment provided by another of the plurality of reviewers, wherein the detecting comprises detecting a contrasting sentiment between the first and second evaluation comments;
• generating, based upon the plurality of disagreements, a plurality of minimal question sets comprising a fewest number of questions that resolve the disagreement between the evaluation comments, each of the plurality of minimal question sets comprising a plurality of questions and each generated for one of the plurality of evaluators, wherein generating each of the plurality of minimal question sets comprises generating a first question set, determining, by validating the first question set against identified parameters, at least a subset of questions present in the first question set are irrelevant, identifying redundant questions within the first question set and across other first question sets generated for other of the plurality of evaluators, and removing the at least a subset of questions and the redundant questions to generate the minimal question set;
• and
• providing each of the minimal question sets to a corresponding evaluator.