Back to results
US 2019/0095466 A1Published application
Mixed type image based search results
AssigneePinterest, Inc.
InventorsAndrew Huan Zhai, Dmitry Olegovich Kislyuk, Maesen Churchill, Yue Li Du, Zhefei Yu, Kelei Xu
Life of this patent
Estimating the term…
Abstract
Described is a system and method for enabling visual search for information. With each selection of an object included in an image, additional images that include visually similar objects are determined and presented to the user.
Claims20
A computing system, comprising:
- one or more processors;
- and
- a memory storing program instructions that when executed by the one or more processors cause the one or more processors to at least:
- receive from a user device, an image of an object;
- process the image to determine the object represented in the image;
- determine that the object corresponds to a defined category;
- determine a first query type and a second query type based at least in part on the object or the defined category;
- generate a keyword corresponding to the object for use with the first query type;
- determine first results for the first query type based at least in part on the keyword;
- generate a feature vector representative of the object for use with the second query type;
- determine second results for the second query type based at least in part on the feature vector;
- blend the first results and the second results to produce blended results that include a first percentage of the first results and a second percentage of the second results;
- and
- present the blended results in response to the image of the object.
11 more elements
A computer-implemented method, comprising:
- receiving, from a user device, an image of an object;
- determining that the object corresponds to a defined category;
- determining a first query type and a second query type based at least in part on the defined category or the object;
- obtaining first query results for the first query type corresponding to the object;
- obtaining second query results for the second query type corresponding to the object;
- blending at least a first portion of the first query results with at least a second portion of the second query results to produce blended results;
- and
- sending for presentation by the user device and in response to the image of the object, the blended results.
5 more elements
A non-transitory computer-readable storage medium storing instructions that, when executed by at least one processor of a computing system, cause the computing system to at least:
- determine an object represented in an image;
- determine that the object corresponds to a defined category;
- determine a first query type and a second query type associated with the defined category;
- generate a keyword corresponding to the object for use with the first query type;
- generate a feature vector representative of the object;
- obtain first results for the first query type based at least in part on the keyword;
- obtain second results for the second query type based at least in part on the feature vector;
- and
- send instructions that cause a presentation of at least one result from the first results and at least one result from the second results.
6 more elements
Dependencies are inferred from the claim text.