Interactive feedback for changes in search relevancy parameters

A system, comprising:

• one or more processors;
• and
• one or more memories having program instructions stored thereon that are executable by the one or more processors to perform operations comprising:
• receiving, via an administrator user interface of a search system, user input specifying adjustment of an internal relevancy parameter, wherein the internal relevancy parameter is not adjustable via a search user interface of the search system that accepts input from users performing search queries, and wherein the relevancy parameter is usable by a search system to determine ordering of results for search queries such that different values of the relevancy parameter result in different result orderings for a query with a given set of search terms;
• and
• accessing data associated with one or more prior search queries that were performed via the search user interface and re-performing the one or more prior search queries using the same set of search terms for each of the one or more prior search queries, wherein the re-performing is initiated without explicit user input requesting the re-performing, using the adjusted relevancy parameter instead of a prior relevancy parameter such that an ordering of results for the re-performing is different than an initial ordering of results for the one or more prior search queries;
• determining a value of a search metric based on:
• the ordering of results for the re-performed one or more prior search queries and prior user interaction with the initial ordering of results, wherein the search metric is a click rank metric;
• and
• causing information to be displayed that indicates the value of the search metric for the adjusted relevancy parameter.

A method, comprising:

• receiving, by a computing system via an administrator user interface of a search system, user input specifying adjustment of an internal relevancy parameter, wherein the internal relevancy parameter is not adjustable via a search user interface of the search system that accepts input from users performing search queries, and wherein the relevancy parameter is usable by a search system to determine ordering of results for search queries such that different values of the relevancy parameter result in different result orderings for a query with a given set of search terms;
• accessing, by the computing system, data associated with one or more prior search queries that were performed via the search user interface and re-performing the one or more prior search queries using the same set of search terms for each of the one or more prior search queries, wherein the re-performing is initiated without explicit user input requesting the re-performing, using the adjusted relevancy parameter instead of a prior relevancy parameter such that an ordering of results for the re-performing is different than an initial ordering of results for the one or more prior search queries;
• determining, by the computing system, a value of a search metric based on:
• the ordering of results for the re-performed one or more prior search queries and prior user interaction with the initial ordering of results, wherein the search metric is a click rank metric;
• and
• causing, by the computing system, information to be displayed that indicates the value of the search metric for the adjusted relevancy parameter.