Systems and Methods for Determining A Level of Expertise

A non-transitory computer-readable medium for determining a level of expertise, the computer-readable medium comprising instructions which, when executed by one or more computers, cause the one or more computers to implement a method, the method comprising:

• storing a set of queries, each query in the set of queries being associated with a subject and an operator who attempts to solve the query, the subject being one of a plurality of subjects, and the operator being one of a plurality of operators;
• determining, for each operator/subject combination wherein the operator attempted to solve at least one query associated with the subject, a non-normalized level of expertise of the operator for the subject, the non-normalized level of expertise being based on a number of queries associated with the subject solved by the operator and an amount of time the operator spent on at least one query associated with the subject solved by the operator;
• determining, for a first subject from the plurality of subjects, a difficulty level for the subject, the difficulty level being based on an average of non-normalized levels of expertise of operators who have solved one or more queries associated with the first subject;
• determining, for a first operator who has solved the one or more queries associated with the first subject, a normalized level of expertise of the first operator for the first subject, the normalized level of expertise being based on the difficulty level for the subject and a non-normalized level of expertise of the first operator for the first subject;
• and
• storing the normalized level of expertise of the first operator for the first subject.

A system for determining a level of expertise, the system comprising:

• processing hardware;
• and
• a memory comprising instructions which, when executed by the processing hardware, cause the processing hardware to implement a method, the method comprising:
• storing each query in the set of queries being associated with a subject and an operator who attempts to solve the query, the subject being one of a plurality of subjects, and the operator being one of a plurality of operators;
• determining, for each operator/subject combination wherein the operator attempted to solve at least one query associated with the subject, a non-normalized level of expertise of the operator for the subject, the non-normalized level of expertise being based on a number of queries associated with the subject solved by the operator and an amount of time the operator spent on at least one query associated with the subject solved by the operator;
• determining, for a first subject from the plurality of subjects, a difficulty level for the subject, the difficulty level being based on an average of non-normalized levels of expertise of operators who have solved one or more queries associated with the first subject;
• determining, for a first operator who has solved the one or more queries associated with the first subject, a normalized level of expertise of the first operator for the first subject, the normalized level of expertise being based on the difficulty level for the subject and a non-normalized level of expertise of the first operator for the first subject;
• and
• storing the normalized level of expertise of the first operator for the first subject.

A non-transitory computer-readable medium for determining a level of expertise, the computer-readable medium comprising instructions which, when executed by one or more computers, cause the one or more computers to implement a method, the method comprising:

• determining that levels of expertise for a first subject and for a second subject are correlated;
• determining a level of expertise of a first operator for the first subject;
• determining a level of expertise of a second operator for the first subject;
• determining that a difference between the level of expertise of the first operator for the first subject and the level of expertise of the second operator for the first subject is within an expertise difference range;
• determining a level of expertise of the first operator for the second subject;
• predicting, in response to the difference between the level of expertise of the first operator for the first subject and the level of expertise of the second operator for the first subject being within the expertise difference range and levels of expertise for the first subject and for the second subject being correlated, a level of expertise of the second operator for the second subject based on the level of expertise of the first operator for the second subject.