Method, apparatus, and computer program of providing reward-type practical training to practical training participant in crowdsourcing-based project

A method of providing reward-type practical training to a practical training participant in a crowdsourcing-based project (hereinafter, a project), performed by an apparatus, the method comprising:

• assigning a plurality of tasks of the project to a plurality of workers and requesting the plurality of workers to perform the tasks;
• receiving a plurality of work results from the plurality of workers;
• assigning a task corresponding to any one of the plurality of work results (hereinafter, a target work result) to a plurality of practical training participants and requesting the plurality of practical training participants to perform practical training;
• receiving a plurality of practical training results from the plurality of practical training participants;
• comparing the target work result by the worker with the plurality of practical training results by the plurality of practical training participants;
• determining whether or not to make an inspection request for the target work result, on the basis of the result of the comparing;
• processing payment of rewards and evaluation scores to the plurality of practical training participants, on the basis of whether or not to make the inspection request;
• assigning the plurality of work results to a plurality of inspectors and requesting the plurality of inspectors to perform inspection;
• receiving, from the plurality of inspectors, inspection passes or rejections as inspection results for the plurality of work results;
• and
• excluding, from a request for the performance of the practical training, a practical training participant who accumulates, for a certain period, an evaluation score that is given for each of the plurality of practical training participants to have the accumulated evaluation scores less than a second reference evaluation score,
• wherein the assigning the plurality of practical training participants the task corresponding to the target work result and requesting the plurality of practical training participants to perform the practical training includes,
• assigning a task corresponding to the target work result to a plurality of practical training participants as many as a greatest number of assignable practical training participants and requesting the plurality of practical training participants as many as the greatest number of assignable practical training participants to perform practical training,
• wherein the greatest number of assignable practical training participants is determined on the basis of an inspection cost allocated to the target work result, wherein the determining whether or not to make the inspection request on the basis of the result of the comparing includes,
• when more than half of the plurality of practical training results match the target work result, processing the target work result as inspection pass without requesting inspection from an inspector, and
• the processing the payment of the rewards and evaluation scores to the plurality of practical training participants on the basis of whether or not to make the inspection request includes
• giving a first evaluation score to each of the practical training participants who input practical training results matching the target work result, and proportionally dividing and paying an inspection cost allocated to the target work result that is processed as inspection pass,
• wherein the determining whether or not to make the inspection request for the target work result on the basis of the result of the comparison includes,
• when less than half of the plurality of practical training results match the target work result, assigning the target work result to the inspector and requesting the inspector to perform inspection,
• wherein the determining whether or not to make the inspection request for the target work result on the basis of the result of the comparison includes,
• when less than half of the plurality of practical training results match the target work result, assigning the target work result to the inspector and requesting the inspector to perform inspection,
• wherein the processing the payment of the rewards and evaluation scores to the plurality of practical training participants on the basis of whether or not to make the inspection request includes giving a second evaluation score higher than the first evaluation score to a practical training participant who inputs a practical training result matching the target work result that passes inspection as the target work result passes inspection, wherein an inspection cost allocated to the target work result that passes inspection is paid to an inspector.