US 2003/0224340 A1 · Constructed response scoring system

Abstract

According to a first preferred aspect of the instant invention, there is provided a method of test scoring, wherein a bi-tonal image of a constructed response test answer is transmitted to a scorer and, if requested by the scorer, a multi-tonal image of that same image is transmitted. In another preferred arrangement, while a scorer is reviewing a first transmitted test answer, a second image will be transmitted and stored as a hidden graphic on his or her computer, thereby making it possible to immediately display the second image when requested. According to still another preferred arrangement, a method is provided of transmitting to a scorer a portion of a test answer sheet that is larger than the Area of Interest for the assigned answer and then, after a predetermined time delay, automatically zooming the image view to include only the Area of Interest.

Claims40

Dependent claims

A method of scoring constructed response test questions, comprising the steps of:

(a) selecting an answer sheet having at least one test answer thereon;
(b) selecting a test answer from among said at least one test answers on said answer sheet;
(c) scanning at least a portion of said selected answer sheet containing said selected test answer, thereby producing a multi-tonal digital image;
(d) obtaining a bi-tonal digital image of said answer sheet at least approximately corresponding to said multi-tonal digital image, said bi-tonal image containing at least said selected test answer;
(e) transmitting at least a portion of said bi-tonal digital image containing said selected test answer to a scorer computer having a display device in electronic communication therewith;
(f) displaying at least a portion of said transmitted bi-tonal digital image on said display device to a scorer;
(g) receiving from the scorer a request to send at least a portion of said multi-tonal image corresponding to said displayed portion of said transmitted bi-tonal digital image;
(h) transmitting to said scorer computer at least a portion of said multi-tonal image according to the scorer's request;
(i) displaying on said display device at least a portion of said transmitted multi-tonal image containing said selected test answer to the scorer;
(j) reading a score for said selected answer from the scorer;
and,
(k) recording said score from the scorer.

9 more elements

A method of scoring constructed response test questions, wherein is provided a central server containing a plurality of digital test answer sheets stored therein, comprising the steps of:

(a) selecting a first test answer;
(b) selecting a first digital test answer sheet containing said first test answer from among said plurality of digital test answer sheets;
(c) transmitting at least a portion of said first digital test answer sheet containing said first test answer to a scorer computer having a display device in electronic communication therewith;
(e) displaying at least a portion of said transmitted first digital test answer sheet on said display device to a scorer;
(f) selecting a second digital test answer sheet, said second digital test answer sheet containing at least one test answer therein, at least one of said at least one test answers being one that will likely be selected next by the scorer;
(g) automatically transmitting at least a portion of said second digital test answer sheet to said scorer computer;
(h) loading at least a portion of said transmitted second digital test answer sheet on said scorer computer as a hidden graphic;
(i) reading a score for said first test answer from the scorer;
(j) transmitting said score to the central server;
(k) receiving a request from the scorer for a next test answer;
(l) if said next test answer is one of said at least one test answers, immediately displaying said second test answer using said hidden graphic;
and,
(m) if said next test answer is not one of said at least one test answers, transmitting a request to said central server for said next test answer.

10 more elements

A method of scoring constructed response test questions, wherein is provided a central server containing a plurality of images of constructed response test answers, comprising the steps of:

(a) selecting a first scorer and a second scorer;
(b) selecting an answer image from among said plurality of images of constructed response test answers;
(c) transmitting at least said answer image to a first scorer computer having a first display device in electronic communication therewith;
(d) displaying at least a portion of said transmitted answer image on said first display device to the first scorer;
(e) reading a first score for the answer image from the first scorer;
(f) transmitting at least said answer image to a second scorer computer having a second display device in electronic communication therewith;
(g) displaying at least a portion of said transmitted answer image on said second display device to the second scorer;
(h) reading a second score for the answer image from the second scorer;
(i) comparing said first score and said second score;
(j) determining based on said comparison of said first and second scores whether said scores are comparable;
(k) if said first and second scores are comparable, taking no further action with respect to scoring of said selected answer image;
and,
(l) if said first and second scores are not comparable,
(l1) selecting a third scorer,
(l2) transmitting at least said answer image to a third remote scorer computer having a third display device in electronic communication therewith,
(l3) displaying at least a portion of said transmitted answer image on said third display device to the third scorer,
(l4) reading a third score for the answer image from the third scorer, and,
(l5) reporting and recording said third scorer's score.

15 more elements

A method of determining the reliability of a scorer of constructed response test questions, wherein is provided a central server containing a plurality of actual constructed response answer images, and wherein is provided a plurality of control answer images, comprising the steps of:

(a) identifying the scorer;
(b) determining the scorer's experience level;
(c) receiving a request from the scorer for a next test answer;
(d) determining, based on said scorer's experience level, whether to transmit an actual constructed response answer image or a control answer image;
(e) if said determination is made to transmit one of said actual constructed response answer images,
(e1) selecting a constructed response answer image from among said plurality of actual constructed response test answer images,
(e2) transmitting said selected constructed response answer image to said scorer,
(e3) reading a score from said scorer associated with said transmitted selected constructed response answer image,
(e4) reporting said scorer's score;
and,
(f) if said determination is made to transmit one of said control answer images,
(f1) selecting a control answer image from among said plurality of control answer images,
(f2) transmitting said selected control answer image to said scorer,
(f3) reading a score from said scorer associated with said transmitted selected constructed response answer image, and,
(f4) recording said scorer's score.
(g) performing steps (c) through (f) as necessary to determine the reliability of the scorer.

13 more elements

A method of providing feedback to a scorer of constructed response test questions, wherein is provided a server containing a plurality of actual constructed response answer images, and wherein is provided a plurality of control answer images, each of said control answer images having a control score associated therewith comprising the steps of:

(a) receiving a request from the scorer for a next test answer;
(b) determining whether to transmit an actual constructed response answer image or a control answer image;
(c) if said determination is made to transmit one of said actual constructed response answer images,
(c1) selecting a constructed response answer image from among said plurality of actual constructed response test answer images,
(c2) transmitting said selected constructed response answer image to said scorer,
(c3) reading a score from said scorer associated with said transmitted selected constructed response answer image,
(c4) reporting said scorer's score;
and,
(d) if said determination is made to transmit one of said control answer images,
(d1) selecting a control answer image from among said plurality of control answer images, said selected control answer image having a selected control score associated therewith,
(d2) transmitting said selected control answer image to said scorer,
(d3) reading a score from said scorer associated with said transmitted selected constructed response answer image, and,
(d4) transmitting said selected control score to the scorer, thereby providing the scorer with feedback.

10 more elements

Dependencies are inferred from the claim text.

Constructed response scoring system

Life of this patent

Constructed response scoring system

Life of this patent

Abstract

Claims40