Efficient use of computational resources for interleaving

One or more computer-readable media storing computer-useable instructions that, when used by a computing device, cause the computing device to perform a method for facilitating an efficient interleaving process, the method comprising:

• receiving a search query;
• determining that the search query is involved in an interleaving experiment that uses a primary ranking system and a secondary ranking system;
• routing the search query to the primary ranking system and the secondary ranking system, wherein the secondary ranking system has additional logic incorporated therein so that it is aware that it is being used in the interleaving experiment;
• communicating to the secondary ranking system that it is being used in the interleaving experiment so that it knows to discontinue the processing of the search query if it determines that the search results will be identical to the search results of the primary ranking system;
• at the secondary ranking system during processing of the search query, determining that the search results of the secondary ranking system will be identical to the search results of the primary ranking system, wherein the determining further comprises,
• identifying one or more parameters used to rank documents that are different between the primary ranking system and the secondary ranking system, and
• determining that the search query is not associated with any of the one or more parameters;
• and
• discontinuing the processing of the search query in the secondary ranking system.

One or more computer-readable media storing computer-useable instructions that, when used by a computing device, cause the computing device to perform a method for facilitating an efficient interleaving process, the method comprising:

• determining that a search query is involved in an interleaving experiment;
• duplicating the search query such that the search query can be sent to a primary ranking system and a secondary ranking system;
• identifying one or more ranking components associated with the secondary ranking system that are used to produce a ranked list of search results;
• routing the search query through each standard component of the primary ranking system;
• routing the duplicate search query only through the one or more ranking components identified in the secondary ranking system;
• and
• prior to interleaving the search results from the primary ranking system and the secondary ranking system, determining whether primary search results associated with the primary ranking system and secondary search results associated with the secondary ranking system are identical such that,
• (1) if the primary search results are identical to the secondary search results, not running an interleaving algorithm that interleaves the search results, and
• (2) if the primary search results are not identical to the secondary search results, running the interleaving algorithm that interleaves the search results.