Clustering subject matter experts based on question and answer ratings

A computer program product comprising a computer readable storage medium having stored thereon:

• program instructions to receive descriptive information associated with a domain expert;
• program instructions to receive a question and a corresponding candidate answer for the question, wherein the candidate answer is generated by a question answering system in response to receiving the question as input;
• program instructions to determine a set of scoring features to be used to evaluate the candidate answer, wherein the set of scoring features includes:
• (i) at least one scoring feature pertaining to the question, (ii) at least one scoring feature pertaining to the candidate answer, and (iii) at least one scoring feature pertaining to the descriptive information;
• program instructions to receive a score from the domain expert, wherein the score is based, at least in part, on the domain expert's evaluation of the candidate answer;
• program instructions to generate a feature vector based on the set of scoring features;
• program instructions to cross-correlate the feature vector with the score, resulting in a cross-correlation indicating how the domain expert weighed each of the scoring features;
• and
• program instructions to cluster the domain expert with one or more other domain experts according to the cross-correlation, thereby creating a first cluster.

A computer system comprising:

• a processor(s) set;
• and
• a computer readable storage medium;
• wherein:
• the processor set is structured, located, connected and/or programmed to run program instructions stored on the computer readable storage medium;
• and
• the program instructions include:
• program instructions to receive descriptive information associated with a domain expert;
• program instructions to receive a question and a corresponding candidate answer for the question, wherein the candidate answer is generated by a question answering system in response to receiving the question as input;
• program instructions to determine a set of scoring features to be used to evaluate the candidate answer, wherein the set of scoring features includes:
• (i) at least one scoring feature pertaining to the question, (ii) at least one scoring feature pertaining to the candidate answer, and (iii) at least one scoring feature pertaining to the descriptive information;
• program instructions to receive a score from the domain expert, wherein the score is based, at least in part, on the domain expert's evaluation of the candidate answer;
• program instructions to generate a feature vector based on the set of scoring features;
• program instructions to cross-correlate the feature vector with the score, resulting in a cross-correlation indicating how the domain expert weighed each of the scoring features;
• and
• program instructions to cluster the domain expert with one or more other domain experts according to the cross-correlation, thereby creating a first cluster.