Collaborative and quality control scoring system and method
AssigneeNational Computer Systems, Inc.
InventorsJay V. Clark, William L. Bramlett, Jr., Judith Moyer
Life of this patent
Estimating the term…
Abstract
A method and system for managing resolvers of test answers to maintain consistent and efficient scoring of test answers. Collaborative scoring allows two test resolvers to score the same test answer and resolves potential discrepancies in the scores provided by the resolvers. Quality items monitor a test resolver's scoring performance against a known standard. A quality-control test item, having a known score, is transmitted to a test resolver. After receiving a score from the resolver, the known score is compared with the resolver's score and a quality profile is generated for the resolver.
Claims44
A system for verifying test answers between two or more test resolvers, the system comprising:
- a) first receive means for electronically receiving an answer to a test question;
- b) transmit means for electronically transmitting the answer to first and second test resolver terminals to be scored by first and second test resolvers;
- c) second receive means for electronically receiving first and second test scores for the answer, as determined by the first and second test resolvers, from the first and second test resolver terminals;
- and
- d) verification means for electronically comparing the first and second test scores and for selectively recording a value related to the first and second test scores if the first and second test scores did not contain a discrepancy based on predefined criteria.
A method for verifying test answers between two or more test resolvers, the method comprising the steps of:
- a) electronically receiving an answer to a test question;
- b) electronically transmitting the answer to first and second test resolver terminals to be scored by first and second test resolvers;
- c) electronically receiving first and second test scores for the answer, as determined by the first and second test resolvers, from the first and second test resolver terminals;
- and
- d) electronically comparing the first and second test scores and for selectively recording a value related to the first and second test scores if the first and second test scores did not contain a discrepancy based on predefined criteria.
A system for verifying test answers between two or more test resolvers, the system comprising:
- a) a receiving subsystem configured to electronically receive an answer to a test question;
- b) a transmit subsystem configured to electronically transmit the answer to first and second test resolver terminals to be scored by first and second test resolvers;
- c) a test score subsystem configured to electronically receive first and second test scores for the answer, as determined by the first and second test resolvers, from the first and second test resolver terminals;
- and
- d) a comparison subsystem configured to electronically compare the first and second test scores and to selectively recording a value related to the first and second test scores if the first and second test scores did not contain a discrepancy based on predefined criteria.
A computer-readable program storage medium tangibly embodying a data package and associated verification instructions executable by a computing system for verifying test answers between two or more test resolvers, the method comprising the steps of:
- a) electronically receiving an answer to a test question;
- b) electronically transmitting the answer to first and second test resolver terminals to be scored by first and second test resolvers;
- c) electronically receiving first and second test scores for the answer, as determined by the first and second test resolvers, from the first and second test resolver terminals;
- and
- d) electronically comparing the first and second test scores and for selectively recording a value related to the first and second test scores if the first and second test scores did not contain a discrepancy based on predefined criteria.
Dependencies are inferred from the claim text.