# US 6,772,081 B1 · Priority system and method for processing standardized tests

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 6,772,081 B1
- Document ID: US6772081B1
- Status: Granted
- Kind: B1
- Application number: 10/153,444
- Filed: 2002-05-21
- Granted: 2004-08-03
- Earliest claimed: 2002-05-21
- Assignees: Data Recognition Corporation
- Inventors: Mark Gedlinske; Doyle Kirkeby; Michelle Edenborg
- Web page: https://patentgrep.com/patent/US6772081B1

## CPC

- G09B 7/02: of the type wherein the student is expected to construct an answer to the question which is presented or wherein the machine gives an answer to the question presented by a student
- G09B 7/00: Electrically-operated teaching apparatus or devices working with questions and answers (mechanically operated G09B3/00; computing arrangements G06F)
- G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B)

## Abstract

Systems and methods are provided for prioritizing the processing of standardized tests. One aspect of the present subject matter relates to a method for processing completed standardized tests. In one embodiment, test-processing priority information is received, and is associated with machine-readable identifiers for standardized tests. Completed standardized tests are received, and are identified by reading machine-readable identifiers. The identified standardized tests are processed according to the associated test-processing priority information such that higher priority tests are automatically processed before lower priority tests. Other aspects are provided herein.

## Claims

### Claim 1

A method for processing completed standardized tests, comprising:
receiving test-processing priority information;
associating the test-processing priority information with machine-readable identifiers for standardized tests;
receiving completed standardized tests with the machine-readable identifiers;
identifying the received standardized tests by reading the machine-readable identifiers;
automatically prioritizing the identified standardized tests using the associated test-processing priority information; and
processing the identified standardized tests according to the associated test-processing priority information such that higher-priority tests are processed before lower-priority tests.

### Claim 2 (depends on 1)

The method of claim 1, wherein receiving test-processing priority information includes receiving customer-provided test-processing priority information.

### Claim 3 (depends on 2)

The method of claim 2, wherein receiving customer-provided test-processing priority information includes receiving test-processing priority information on-line.

### Claim 4 (depends on 1)

The method of claim 1, wherein receiving test-processing priority information includes receiving test-processing priority information from a test-processing center.

### Claim 5 (depends on 4)

The method of claim 4, wherein receiving test-processing priority information from a test-processing center includes receiving initial test-processing priority information for a test project.

### Claim 6 (depends on 4)

The method of claim 4, wherein receiving test-processing priority information from a test-processing center includes receiving test-processing priority information from test-processing feedback such that the identified standardized tests are dynamically prioritized.

### Claim 7 (depends on 6)

The method of claim 6, wherein receiving test-processing priority information from test-processing feedback includes receiving information regarding reader workload.

### Claim 8 (depends on 6)

The method of claim 6, wherein receiving test-processing priority information from test-processing feedback includes receiving status information for tests that are in process.

### Claim 9 (depends on 1)

The method of claim 1, wherein receiving test-processing information includes receiving three or more priority levels used to prioritize the processing of the identified standardized tests.

### Claim 10 (depends on 1)

The method of claim 1, wherein associating the test-processing priority information with machine-readable identifiers for standardized tests includes associating the test-processing priority information with bar codes.

### Claim 11 (depends on 1)

The method of claim 1, wherein:
associating the test-processing priority information with machine-readable identifiers for standardized tests includes associating the test-processing priority information with electronic identifiers for standardized tests; and
receiving completed standardized tests includes electronically receiving digital transmissions of completed standardized tests and the electronic identifiers for identifying the digitally-transmitted tests.

### Claim 12 (depends on 1)

The method of claim 1, wherein:
associating the test-processing priority information with machine-readable identifiers for standardized tests includes associating the test-processing information with machine-readable identifiers for boxes of standardized tests;
receiving completed standardized tests with the machine-readable identifiers includes receiving boxes of standardized tests; and
identifying the received standardized tests by reading the machine-readable identifiers includes identifying the received boxes of standardized tests by reading the machine-readable identifiers.

### Claim 13 (depends on 1)

The method of claim 1, wherein:
associating the test-processing priority information with machine-readable identifiers for standardized tests includes associating the test-processing information with machine-readable identifiers for standardized test documents;
receiving completed standardized tests with the machine-readable identifiers includes receiving standardized test documents; and
identifying the received standardized tests by reading the machine-readable identifiers includes identifying the received standardized test documents by reading the machine-readable identifiers.

### Claim 14 (depends on 1)

The method of claim 1, wherein:
associating the test-processing priority information with machine-readable identifiers for standardized tests includes associating the test-processing information with machine-readable identifiers for standardized test items;
receiving completed standardized tests with the machine-readable identifiers includes receiving standardized test items; and
identifying the received standardized tests by reading the machine-readable identifiers includes identifying the received standardized test items by reading the machine-readable identifiers.

### Claim 15 (depends on 1)

The method of claim 1, wherein processing the identified standardized tests according to the associated test-processing priority information includes:
cutting the test booklets to provide pages for scanning;
scanning the pages of the cut test booklets to provide scanned images of the pages;
editing the scanned images of the pages;
reconciling the scanned images of the pages; and
validating the scanned images of the pages.

### Claim 16 (depends on 1)

The method of claim 1, wherein processing the identified standardized tests according to the associated test-processing priority information includes scoring the identified standardized tests, including:
assigning a plurality of electronic test items to a plurality of readers, each reader having one or more credentials, comprising:
automatically applying scoring rules to each electronic test item, including:
qualifying potential readers for each electronic test item from the plurality of readers; and
determining a relative priority for an electronic test item; and
automatically assigning scoring tasks to qualified readers such that higher-priority electronic test items are evaluated before lower-priority electronic test items; and
receiving test scores for the plurality of electronic test items from the plurality of readers.

### Claim 17 (depends on 1)

The method of claim 1, further comprising processing the identified standardized tests according to the associated test-processing priority information includes scoring the identified standardized tests using optical mark recognition (OMR) logic.

### Claim 18 (depends on 1)

The method of claim 1, wherein reporting test results for the processed standardized tests according to the test-processing priority information.

### Claim 19

A method for processing completed standardized tests, comprising:
receiving test-processing priority information;
associating the test-processing information with machine-readable identifiers for boxes of standardized test documents and with machine readable identifiers for standardized test documents;
receiving boxes of standardized test documents;
identifying the received boxes of standardized test documents by reading machine-readable identifiers on the boxes;
automatically prioritizing the identified boxes using the associated test-processing priority information;
sorting the standardized test documents contained within the boxes;
identifying the standardized test documents by reading machine-readable identifiers on the standardized test documents;
automatically prioritizing the identified standardized test documents using the associated test-processing priority information; and
processing the identified standardized test documents according to the associated test-processing priority information such that higher-priority test documents are processed before lower-priority test documents.

### Claim 20 (depends on 19)

The method of claim 19, further comprising:
associating the test-processing information with machine-readable identifiers for standardized test items contained in the test documents; and
identifying the received standardized test items by reading the machine-readable identifiers.

### Claim 21 (depends on 19)

The method of claim 19, wherein the machine-readable identifiers include bar codes.

### Claim 22 (depends on 19)

The method of claim 19, wherein the machine-readable identifiers include electronic identifiers.

### Claim 23 (depends on 19)

The method of claim 19, wherein receiving test-processing priority information includes receiving customer-provided test-processing priority information.

### Claim 24 (depends on 19)

The method of claim 19, wherein receiving customer-provided test-processing priority information includes receiving test-processing priority information on-line.

### Claim 25 (depends on 19)

The method of claim 19, wherein receiving test-processing priority information includes receiving test-processing priority information from a test-processing center.

### Claim 26

A method for processing completed standardized tests, comprising:
receiving boxes of test booklets from a plurality of test-taking centers, and criteria for prioritizing processing of the test booklets;
reading bar codes for the received boxes to prioritize processing of the received boxes according to the received criteria;
reading bar codes for the test booklets contained within the processed boxes;
automatically prioritizing the test booklets according to the received criteria; and
processing the test booklets in preparation for scoring test items in the test booklets according to the received criteria such that higher-priority test booklets are processed before lower-priority test booklets.

### Claim 27 (depends on 26)

The method of claim 26, wherein processing the test booklets in preparation for scoring test items in the test booklets according to the received criteria includes:
cutting the test booklets to provide pages for scanning;
scanning the pages of the cut test booklets to provide scanned images of the pages;
editing the scanned images of the pages;
reconciling the scanned images of the pages to verify that, for each of the test booklets, the scanned images represent all pages of the test booklet; and
validating data represented by the bar codes.

### Claim 28 (depends on 26)

The method of claim 26, wherein scoring the test items according to the received criteria includes:
assigning a plurality of electronic test items to a plurality of readers, each reader having one or more credentials, comprising:
automatically applying scoring rules to each electronic test item, including:
qualifying potential readers for each electronic test item from the plurality of readers; and
determining a relative priority for an electronic test item; and
automatically assigning scoring tasks to qualified readers such that higher-priority electronic test items are evaluated before lower-priority electronic test items; and
receiving test scores for the plurality of electronic test items from the plurality of readers.

### Claim 29 (depends on 26)

The method of claim 26, wherein scoring the test items according to the criteria includes scoring the test items using optical mark recognition (OMR) logic.

### Claim 30 (depends on 26)

The method of claim 26, further comprising reporting scores for the test items according to the received criteria.

### Claim 31

A method for processing completed standardized tests, comprising:
electronically receiving a plurality of completed test items from a plurality of test-taking centers, and receiving criteria for prioritizing processing of the test items;
automatically prioritizing the received test items according to the received criteria;
processing the plurality of test items in preparation for scoring the test items according to the received criteria; and
scoring the test items according to the criteria.

### Claim 32 (depends on 31)

The method of claim 31, wherein electronically receiving a plurality of completed test items from a plurality of test-taking centers includes receiving the plurality of completed test items on-line.

### Claim 33 (depends on 31)

The method of claim 31, wherein scoring the test items according to the criteria includes:
assigning the plurality of electronic test items to a plurality of readers, each reader having one or more credentials, comprising:
automatically applying scoring rules to each electronic test item, including:
qualifying potential readers for each electronic test item from the plurality of readers; and
determining a relative priority for an electronic test item; and
automatically assigning scoring tasks to qualified readers such that higher-priority electronic test items are evaluated before lower-priority electronic test items; and
receiving test scores for the plurality of electronic test items from the plurality of readers.

### Claim 34 (depends on 31)

The method of claim 31, wherein scoring the test items according to the criteria includes scoring the test items using optical mark recognition (OMR) logic.

### Claim 35 (depends on 31)

The method of claim 31, further comprising reporting scores for the test items according to the criteria.

### Claim 36

A system for processing completed standardized tests, comprising:
one or more reading devices for machine-reading test identifiers for a plurality of tests; and
a server connected to the one or more reading devices, the server including:
a database module for associating test identifiers with test-processing priority information; and
at least one applications module for processing a plurality of standardized tests according to the test-processing priority information such that higher-priority tests are processed before lower-priority tests.

### Claim 37 (depends on 36)

The system of claim 36, wherein:
the database module includes:
a reader file that identifies the plurality of readers and credentials for the plurality of readers;
an image file that includes images of the plurality of tests and associates each image with one or more reader requirements and the test-processing priority information; and
a test-taker file that associates a test-taker with one or more images of the plurality of test items; and
the at least one applications module includes a dealer for distributing one or more images to one or more of the plurality of readers based on the credentials for the plurality or readers, and based on the one or more reader requirements and an associated priority for processing the image file.

### Claim 38 (depends on 36)

The system of claim 36, wherein the test-processing priority information includes customer-provided priority information.

### Claim 39 (depends on 36)

The system of claim 36, wherein the test-processing priority information includes priority information provided by a test-processing center.

### Claim 40 (depends on 36)

The system of claim 36, wherein the priority information provided by a test-processing center includes test-processing feedback information.

### Claim 41 (depends on 36)

The system of claim 36, wherein the server further includes a communication module for receiving customer-provided test-processing priority information.

### Claim 42 (depends on 36)

The system of claim 36, wherein the server further includes:
a box receipt module for identifying received boxes of test booklets by reading the test identifiers on the received boxes using the one or more reading devices, and for prioritizing the processing of the received boxes according to the test-processing priority information; and
a book receipt module for identifying received test booklets in the received boxes by reading the test identifiers on the received test booklets using the one or more reading devices, and for prioritizing the processing of the received test booklets according to the test-processing priority information.

### Claim 43 (depends on 36)

The system of claim 36, wherein the test identifiers include bar codes.

### Claim 44 (depends on 36)

The system of claim 36, wherein the test identifiers include electronic identifiers for identifying digitally-transmitted tests.

### Claim 45 (depends on 36)

The system of claim 36, wherein the test identifiers include test identifiers for boxes of standardized tests that are associated with priority information for processing the boxes of standardized tests.

### Claim 46 (depends on 36)

The system of claim 36, wherein the test identifiers include test identifiers for standardized test documents that are associated with priority information for processing the standardized test documents.

### Claim 47 (depends on 36)

The system of claim 36, wherein the test identifiers include:
box identifiers for boxes of standardized test documents that are associated with priority information for processing the boxes of standardized test documents; and
test document identifiers for standardized test documents that are associated with priority information for processing the standardized test documents.