Search system for providing web crawling query prioritization based on classification operation performance

One or more computer storage media having computer-executable instructions embodied thereon that, when executed, by one or more processors, cause the one or more processors to perform a method for processing web crawling queries, the method comprising:

• accessing a web crawling engine, the web crawling engine operates based on a web crawling query prioritization model that supports determining web crawling priority scores that indicate corresponding predicted performance improvements for classification operations executed with known data and web crawled data to be retrieved from executing a web crawling query operation;
• using the web crawling prioritization model, determining a web crawling priority score for a web crawling query for a corresponding classification operation associated with a performance improvement, wherein the predicted performance improvement for the classification operation is a predicted improvement of executing the classification operation with the known data and web crawled data to be retrieved by executing the web crawling query over the classification operation executed with only the known data, wherein the classification operation is associated with a product in a product listing platform and known data for the product;
• and
• based on the web crawling priority score, processing the web crawling query based on a web crawling query processing operation corresponding to the web crawling score.

A search system for processing web crawling queries, the system comprising:

• one or more processors;
• and
• one or more computer storage media storing computer-useable instructions that, when used by the one or more processors, cause the one or more processors to execute:
• a web crawling engine:
• access a web crawling query prioritization model that supports determining web crawling priority scores that indicate corresponding predicted performance improvements for classification operations executed with known data and web crawled data to be retrieved from executing a web crawling query operation;
• determine a web crawling priority score for a web crawling query for a corresponding classification operation associated with a performance improvement, wherein the predicted performance improvement for the classification operation is a predicted improvement of executing the classification operation with the known data and web crawled data to be retrieved by executing the web crawling query over the classification operation executed with only the known data, wherein the classification operation is associated with a product in a product listing platform and known data for the product;
• and
• based on the web crawling score, process the web crawling query based on a web crawling query processing operation corresponding to the web crawling priority score.