System and method of tuning item classification

One or more non-transitory computer-readable media storing computer-executable instructions that, when executed on one or more processors, cause the one or more processors to perform acts comprising:

• receiving a classification request comprising a description of an item;
• determining an item type of the item using a plurality of classifiers wherein the plurality of classifiers comprises a rule-based classifier that implements a white-list rule and a blacklist rule for item classification, wherein the white-list rule defines that the item belongs to a first item type, and wherein the blacklist rule defines that the item does not belong to a second item type different from the first item type;
• generating information of item type determination corresponding to the item, the information of item type determination comprising the description of the item and the item type of the item;
• determining whether a confidence score associated with the item type of the item is less than a predetermined threshold;
• in response to the confidence score associated with the item type of the item and the predetermined threshold, submitting the information of item type determination to a crowdsourcing forum for a validation decision;
• and
• returning, from the crowdsourcing forum, the validation decision, wherein:
• when the crowdsourcing forum determines that the item type of the item is correct, the validation decision indicates that the item type of the item is correct;
• when the crowdsourcing forum determines that the item type of the item is not correct, the validation decision indicates that the item type of the item is not correct;
• and
• when the crowdsourcing forum determines that the information of item type determination is insufficient to accurately judge whether the item type of the item is correct, the validation decision indicates that the item type of the item is unclear.

An apparatus comprising:

• a memory configured to store data and one or more sets of instructions;
• and one or more processors coupled to the memory, the one or more processors configured to execute the one or more sets of instructions and perform operations comprising:
• receiving a classification request comprising a description of an item;
• determining an item type of the item using a plurality of classifiers;
• generating information of item type determination corresponding to the item, the information of item type determination comprising the description of the item and a determined item type, wherein the determined item type is the item type of the item determined using the plurality of classifiers;
• determining whether a confidence score associated with the determined item type is less than a predetermined threshold;
• in response to a determination that the confidence score associated with the determined item type is less than the predetermined threshold, providing the information of item type determination for analysis;
• and
• in response to a determination that the confidence score associated with the determined item type is not less than the predetermined threshold, providing the information of item type determination to a crowdsourcing forum for evaluation and a validation decision;
• and
• returning, from the crowdsourcing forum, the validation decision, wherein:
• when the crowdsourcing forum determines that the determined item type is correct, the validation decision indicates that the determined item type is correct;
• when the crowdsourcing forum determines that the determined item type is not correct, the validation decision indicates that the determined item type is not correct;
• and
• when the crowdsourcing forum determines that the information of item type determination is insufficient to accurately judge whether the determined item type is correct, the validation decision indicates that the determined item type is unclear.