Back to results
US 10,783,458 B2Granted
Systems and methods for screening submissions in production competitions
AssigneeTopCoder, Inc.
InventorsJavier Fernandez-Ivern, David Messinger, John M. Hughes
Life of this patent
Estimating the term…
Abstract
The invention relates to a system and method for screening submissions in a production contest system. In one embodiment, the method includes receiving a production competition submission from a contestant, automatically screening the submission with a screening system to verify that the submission meets predetermined requirements, and providing feedback to the contestant and a contest administrator regarding the results of whether the submission meets the predetermined requirements.
Claims17
A system for conducting a computer software production contest in which submissions are screened with an initial screening process prior to review by reviewers using a scorecard, the system comprising one or more computers each having at least one memory and at least one processor for executing instructions stored on the at least one memory, the system further comprising:
- configuration data for configuring a screening system with information specific to predetermined initial screening requirements of a computer software production contest;
- a configurable screening system comprising a plurality of validators, each validator for verifying that submissions meet a particular subset of the predetermined initial screening requirements and for verifying the subset in an automated fashion using validating rules associated with the respective validator and specified in configuration data prior to review of the submissions, wherein the screening system automatically screens contestants' submissions upon receipt of each submission using one or more of the validators and with the screening system configured with the configuration data to verify that the submissions meet the predetermined initial screening requirements prior to review by reviewers using a scorecard, wherein the screening system automatically attempts to correct one or more issues with a particular contestant's submission,
- wherein the configurable screening system comprises an XML-based validation subsystem in which a desired directory structure is specified in XML, wherein the XML-based validation subsystem is configured to validate a structure of a directory included in a particular submission using a directory rule validator, wherein the directory rule validator initiates file validators on files in the directory based on a configuration file that specifies which of the file validators are added to the directory rule validator, wherein the file validators determine the presence or absence of various properties associated with files;
- a pluggable framework for allowing one or more of the validators to be added and/or removed from the configurable screening system to create a set of validators to be applied to the submissions in the computer software production contest, wherein a first set of validators is plugged into the framework for the computer software production contest, and a second, different set of validators is plugged into the framework for a different computer software production contest, such that the configurable screening system does not require redevelopment between the computer software production contest and the different computer software production contest;
- a communication subsystem for communicating to contestants requirements for production of a submission and for receiving production competition submissions from some of the contestants;
- and
- a contest server for providing to submitting contestants results of whether their submission met the predetermined initial screening requirements and for facilitating a review by reviewers using a scorecard after the screening.
4 more elements
A production contest system comprising one or more computers each having at least one memory and at least one processor for executing instructions stored on the at least one memory, the production contest system further comprising:
- a receiver for receiving a production competition submission from a contestant;
- a configurable screening system for automatically screening the submission upon receipt of the submission using one or more validators to verify that the submission meets predetermined initial requirements that can be verified in an automated fashion prior to a review process by reviewers using a scorecard, wherein the screening system comprises a plurality of validators, each validator for automatically validating a particular subset of rules specified in configuration data, the configuration data for configuring the screening system for the requirements of a production competition, wherein the screening system automatically attempts to correct one or more issues with the contestant's submission,
- wherein the configurable screening system comprises an XML-based validation subsystem in which a desired directory structure is specified in XML, wherein the XML-based validation subsystem is configured to validate a structure of a directory included in a particular submission using a directory rule validator, wherein the directory rule validator initiates file validators on files in the directory based on a configuration file that specifies which of the file validators are added to the directory rule validator, wherein the file validators determine the presence or absence of various properties associated with files;
- a pluggable framework for allowing one or more of the validators to be added and/or removed from the configurable screening system to create a set of validators to be applied to the production competition submission, wherein a first set of validators is plugged into the framework for the production competition, and a second, different set of validators is plugged into the framework for a different production competition, such that the configurable screening system does not require redevelopment between the production competition and the different production competition;
- and
- a communication subsystem for providing to the contestant results of whether the submission meets the predetermined initial requirements based on the verification by the screening system and for facilitating a review by reviewers using a scorecard after the initial screening.
3 more elements
Dependencies are inferred from the claim text.