US 11,960,528 B1Granted

Systems for determining image-based search results

AssigneeAmazon Technologies, Inc.

InventorsAditya Deorha, Xiaofan Lin, Shashank Shekhar

Life of this patent

Estimating the term…

Loading patent…

Abstract

When a first search query including an image of an item is received to search for items associated with similar images, a second search query that includes text based on the image is generated. The text may be based on previous queries associated with the depicted item, visual features of the image, or text that is present in the image. The results from the first search query are scored based on their correspondence with the image of the item. Results having a score greater than a threshold are presented first in the output, followed by a selected number of results from the second search query. Results from the first search query that are associated with a score less than the threshold may be presented after the results from the second search query. This presentation increases the likelihood that items presented earlier in the output are relevant to the initial query.

Claims20

Dependent claims

A system comprising:

one or more non-transitory memories storing computer-executable instructions;
and
one or more hardware processors to execute the computer-executable instructions to:
receive a first search query comprising a first image of a first item;
determine, based at least in part on the first image, a second search query comprising text associated with the first image;
determine a first set of search results based on correspondence between the first image and image data that associates each of a plurality of items with at least one image, wherein the first set includes at least a first search result associated with a second image of a second item and a second search result associated with a third image of a third item;
determine a first score based on correspondence between the first image and the second image;
determine a second score based on correspondence between the first image and the third image;
determine that the first score is greater than or equal to a threshold value;
determine that the second score is less than the threshold value;
determine a second set of search results based on correspondence between the second search query and text data associated with the plurality of items, wherein the text data includes at least a third search result associated with a fourth item;
and
determine output data that includes:
data indicative of the second item;
data indicative of the third item;
and
data indicative of the fourth item;
wherein the data indicative of the second item is presented prior to the data indicative of the fourth item, and the data indicative of the fourth item is presented prior to the data indicative of the third item.

15 more elements

A system comprising:

one or more non-transitory memories storing computer-executable instructions;
and
one or more hardware processors to execute the computer-executable instructions to:
receive a first search query comprising a first image of a first item;
determine first result data based on the first search query, wherein the first result data comprises one or more first results;
determine, based at least in part on the first image, a second search query comprising text associated with the first image;
determine second result data based on the second search query, wherein the second result data comprises one or more second results;
determine a presentation order based on the first result data and the second result data;
and
determine output data based on the presentation order, wherein in response to the presentation order, the output data includes:
a first portion of the first result data presented before a portion of the second result data;
the portion of the second result data presented before a second portion of the first result data;
and
the second portion of the first result data presented after the portion of the second result data.

11 more elements

A system comprising:

one or more non-transitory memories storing computer-executable instructions;
and
one or more hardware processors to execute the computer-executable instructions to:
receive a first query comprising a first image of a first item;
determine first result data based on the first query, wherein the first result data comprises a plurality of first results;
determine, based at least in part on the first image, a second query comprising text;
determine second result data based on the second query, wherein the second result data comprises a plurality of second results;
determine a presentation order for one or more first results of the plurality of first results and one or more second results of the plurality of second results;
and
determine output data that includes:
the one or more first results of the plurality of first results;
and
the one or more second results of the plurality of second results;
wherein the one or more first results and the one or more second results are presented based on the presentation order.

11 more elements

Dependencies are inferred from the claim text.