Evaluating semantic interpretations of a search query

A non-transitory, computer-readable medium storing instructions operable when executed to cause at least one processor to perform operations comprising:

• obtaining a set of search results for a particular search query submitted to a search engine;
• obtaining a set of semantic interpretations for the particular search query, each semantic interpretation representing a candidate intent associated with the particular search query;
• obtaining, for each semantic interpretation of the set, a canonical search query;
• generating, for each semantic interpretation of the set, a modified search query based at least in part on the particular search query and the canonical search query for the semantic interpretation;
• obtaining, for each semantic interpretation of the set, a set of search results for the modified search query for the semantic interpretation;
• and
• determining, for each semantic interpretation of the set, a degree of similarity between (i) the set of search results of the modified search query for the semantic interpretation, and (ii) the set of search results for the particular search query.

A system comprising:

• memory for storing data;
• and
• one or more processors operable to perform operations comprising:
• obtaining a set of search results for a particular search query submitted to a search engine;
• obtaining a set of semantic interpretations for the particular search query, each semantic interpretation representing a candidate intent associated with the particular search query;
• obtaining, for each semantic interpretation of the set, a canonical search query;
• generating, for each semantic interpretation of the set, a modified search query based at least in part on the particular search query and the canonical search query for the semantic interpretation;
• obtaining, for each semantic interpretation of the set, a set of search results for the modified search query for the semantic interpretation;
• and
• determining, for each semantic interpretation of the set, a degree of similarity between (i) the set of search results of the modified search query for the semantic interpretation, and (ii) the set of search results for the particular search query.