Determining search relevance from user feedback
AssigneeAmazon Technologies, Inc.
InventorsKelly L. Wiggins, Llewellyn J. Mason, Olga I. Kuznetsova, Peter V. Commons
Life of this patent
Estimating the term…
Abstract
Disclosed are various embodiments for using relevance indications provided by a user in performing a search. Search results corresponding to a search query are provided to a user of a client computing device. The user provides a relevance indication corresponding to relevance of at least one of the search results. A subsequent search is performed which takes the relevance indication into account.
Claims20
A non-transitory computer-readable medium embodying a program executable in a computing device, the program comprising:
- code that performs a search using a search query received in a first search request from a client device to produce a first plurality of search results, the search being associated with a catalog and the first plurality of search results corresponding to items listed in the catalog;
- code that provides the first plurality of search results to the client device in response to the first search request;
- code that receives a plurality of relevance indications corresponding to an indication of a respective relevance of at least one of the first plurality of search results, wherein the respective relevance is associated with a relevance score based at least in part upon search behavior data associated with previous submissions of the search query;
- code that determines whether individual ones of the plurality of relevance indications meet a relevance threshold, the relevance threshold set dynamically as a point at which relevance scores associated with the first plurality of search results begin to decline by a predetermined number of score units;
- code that performs a subsequent search using the search query in response to receiving a second search request while excluding individual ones of the first plurality of search results that have a respective relevance score that fails to meet the relevance threshold to produce a second plurality of search results, the second plurality of search results corresponding to items listed in the catalog;
- code that provides the second plurality of search results to the client device in response to the second search request;
- and
- code that receives a sort criterion from the client device, wherein the sort criterion comprises at least one of a price of the items listed in the catalog or a popularity of the items listed in the catalog;
- code that sorts the second plurality of search results according to the sort criterion;
- and
- code that provides the sorted second plurality of search results to the client device.
A method, comprising:
- obtaining, via at least one of one or more computing devices, a plurality of relevance indications corresponding to an indication of a respective relevance of individual ones of a first plurality of search results corresponding to a search query, wherein the respective relevance is associated with a relevance score based at least in part upon search behavior data associated with previous submissions of the search query;
- determining, via at least one of the one or more computing devices, whether individual ones of the plurality of relevance indications meet a relevance threshold, where the relevance threshold is set dynamically as a point at which relevance scores associated with the first plurality of search results begin to decline by a predetermined number of score units;
- performing, via at least one of the one or more computing devices, a subsequent search to produce a second plurality of search results;
- excluding, via at least one of the one or more computing devices, search results that have a relevance score that fails to meet the relevance threshold from the second plurality of search results;
- receiving, via at least one of the one or more computing devices, a sort criterion from a client device, wherein the sort criterion comprises at least one of a price of items listed in a product catalog or a popularity of the items listed in the product catalog;
- sorting, via at least one of the one or more computing devices, the second plurality of search results according to the sort criterion;
- and
- providing, via at least one of the one or more computing devices, the sorted second plurality of search results to the client device.
A system, comprising:
- at least one computing device comprising a processor and a memory;
- and
- an application executable in the at least one computing device, the application comprising:
- logic that, in response to receiving a search query in a first search request from a client device, performs a search for the search query to produce a first plurality of search results, the search being associated with a product catalog and the first plurality of search results corresponding to items listed in the product catalog;
- logic that provides the first plurality of search results corresponding to the search query to the client device;
- logic that receives a plurality of relevance indications corresponding to an indication of a respective relevance of at least one of the first plurality of search results, wherein the respective relevance is associated with a relevance score based at least in part upon search behavior data associated with previous submissions of the search query;
- logic that determines whether individual ones of the plurality of relevance indications meet a relevance threshold, the relevance threshold set dynamically as a point at which relevance scores associated with the first plurality of search results begin to decline by a predetermined number of score units;
- logic that performs a subsequent search for the search query in response to a second search request to produce a second plurality of search results;
- logic that excludes search results that have a relevance score that fails to meet the relevance threshold from the second plurality of search results;
- logic that receives a sort criterion from the client device, wherein the sort criterion comprises at least one of a price of items listed in the product catalog or a popularity of the items listed in the product catalog;
- logic that sorts the second plurality of search results according to the sort criterion;
- and
- logic that provides the sorted second plurality of search results to the client device.
Dependencies are inferred from the claim text.