Apparatus and method for scoring nonobjective assessment materials through the application and use of captured images

A method of displaying images of handwritten nonobjective assessment materials to a human scorer and recording the scores recorded by the scorer, comprising the steps of:

• capturing digitized images for a plurality of assessment materials;
• storing the digitized images in a computer file;
• displaying a first subset of the digitized images on a computer screen for scoring by the scorer to train the scorer;
• displaying a second subset of the digitized images on a computer screen for scoring by the scorer to test the scorer's selection of scores;
• and
• displaying additional digitized images on a computer screen for scoring by the scorer to provide scores for the assessment materials represented by the additional images;
• and
• recording in an electronic file scores entered by the scorer for the digitized images.

An apparatus for displaying to a human scorer an image of handwritten assessment materials recorded by a test taker in an assessment area of an assessment form and for recording a score selected by the scorer, comprising:

• input means for capturing from the assessment form a digitized image of the assessment materials to be scored, said means for capturing a digitized image comprising:
• means for storing the digitized image in an electronic file;
• means for selectively displaying the digitized image on a computer screen for the scoring by the scorer;
• means for electronically recording a score entered by the scorer for the digitized image;
• means for identifying the form by OMR;
• means responsive to said means for identifying the form for determining the location of the assessment area;
• means for determining by OMR the presence of marks within the assessment area of assessment materials recorded by the test taker and the portion of the assessment area in which marks are present;
• and
• means for storing in digital electronic form as part of an image file an image of at least the portion of the assessment area in which assessment materials are present.

A method of displaying to a human scorer an image of handwritten nonobjective assessment materials recorded by a test taker in an assessment area of an assessment form, and recording a score entered by the scorer, comprising the steps of:

• providing an assessment form having thereon at least one assessment area;
• capturing a digitized image of said assessment materials recorded in at least one assessment area in digital form from the assessment form;
• storing said digitized image in a computer file;
• displaying said digitized image of the assessment materials on a computer screen for scoring by the scorer;
• and
• recording a score entered by the scorer for the digitized image of the assessment materials;
• said step of capturing a digitized image comprising the further steps of:
• identifying the form by OMR;
• determining the location of at least one assessment area on the form based on said step of identifying the form by OMR;
• determining by OMR whether marks are present within said at least one assessment area;
• determining by OMR the portion of said assessment area in which marks are present;
• and
• storing in digital form the image of the portion of the assessment area in which it was determined that marks are present.

A method of displaying no a human scorer images of handwritten nonobjective assessment materials recorded in an assessment area of an assessment form and recording scores recorded by the scorer, comprising the steps of:

• capturing digitized images for a plurality of assessment materials;
• storing the digitized images in a computer file;
• displaying a first subset of the digitized images on a computer screen for scoring by the scorer to train the scorer;
• displaying a second subset of the digitized images on the a computer screen for scoring by the scorer to test the scorer's selection of scores;
• and displaying additional digitized images on the computer screen for scoring by the scorer to provide scores for the assessment materials represented by the additional images;
• said step of capturing digitized images comprising the further steps of:
• determining by OMR the location of the assessment area on the assessment form, the presence within the assessment area of assessment materials and the location within the assessment area of said assessment materials;
• and
• storing in electronic form an image of at least said location within the assessment area in which said assessment materials are present.

An apparatus for electronically displaying to a human scorer an image of handwritten assessment materials recorded by a test taker in an assessment area of an assessment form and for recording a score selected by scorer, comprising:

• an electronic file for storing identifying information to identify the test taker;
• input means for capturing from the assessment form a digitized image of the assessment materials to be scored, said means for capturing a digitized image comprising:
• an electronic image file for storing the digitized image;
• means operatively connected to said image files for selectively displaying the digitized image but not the identifying information on a computer screen for scoring by the scorer;
• means for electronically recording a score entered by the scorer for the digitized image;
• said input means having means for identifying by electronic optical scanning the assessment form;
• means for determining by electronic optical scanning the location of the assessment area on the assessment form, the presence within the assessment area of assessment materials recorded by the test taker, and the location within the assessment area of said assessment materials;
• and
• means for storing in electronic form as part of said image file an image of at least said location within the assessment area in which said assessment materials recorded by the test taker are present.