Generating reviews of medical image reports

A network device for reviewing exams over a network, comprising:

• a memory device that is arranged to store instructions;
• a processor device that is arranged to execute instructions that perform actions, including:
• modifying a plurality of exams to be anonymous, blinded and accessible as foil exams in a database;
• modifying an exam of interest (EOI) to be anonymous and blinded;
• selecting at least one foil exam based at least in part on the EOI;
• generating an exam set that includes the at least one foil exam and the modified EOI;
• providing the exam set to a reviewer, wherein based on the reviewer's review of the review set, the reviewer provides assessment metrics that include a range of graded values for each exam in the exam set which correspond to whether a determination included in the at least one foil exam and another determination included in the modified EOI each have met a community standard which is based on a variability in a comparison of each range of other graded values that are provided by a plurality of different reviewers for each of the foil exams;
• and
• generating a report for the exam set based on at least a quality of the assessment metrics provided by the reviewer in comparison to the community standard.

A system for reviewing exams over a network, comprising:

• a server device that includes:
• a memory device that stores instructions;
• a processor device that executes instructions that perform actions, comprising:
• modifying a plurality of exams to be anonymous, blinded and accessible as foil exams in a database;
• modifying an exam of interest (EOI) to be anonymous and blinded;
• selecting at least one foil exam based at least in part on the EOI;
• generating an exam set that includes the at least one foil exam and the modified EOI;
• and
• generating a report for the exam set based on at least assessment metrics provided by a reviewer;
• and
• a client device that includes:
• a memory device that stores instructions;
• and
• a processor device that executes instructions that provides the exam set to that reviewer, wherein based on the reviewer's review of the exam set, the reviewer provides assessment metrics that include a range of graded values for each exam in the exam set which correspond to whether a determination included in the at least one foil exam and another determination included in the modified EOI each have met a community standard which is based on a variability in a comparison of each range of other graded values that are provided by a plurality of different reviewers for each of the foil exams.