Back to results
US 2019/0095467 A1Published application
Textual and image based search
AssigneePinterest, Inc.
InventorsDmitry Olegovich Kislyuk, Jeffrey Harris, Anton Herasymenko, Eric Kim, Yiming Jen
Life of this patent
Estimating the term…
Abstract
Described is a system and method for enabling visual search for information. With each selection of an object included in an image, additional images that include visually similar objects are determined and presented to the user.
Claims20
A computing system, comprising:
- one or more processors;
- and
- a memory storing program instructions that when executed by the one or more processors cause the one or more processors to at least:
- receive from a user device, a text query;
- determine and return a plurality of results corresponding to the text query;
- subsequent to receiving the text query, receive from the user device an image of an object;
- generate an object feature vector representative of the object;
- compare the object feature vector with a plurality of stored feature vectors corresponding to segments of images returned as the plurality of results;
- generate a ranked list of the plurality of results based at least in part on the comparison of the object feature vector with the plurality of stored feature vectors;
- and
- present the ranked list in response to the receipt of the image.
8 more elements
A computer-implemented method, comprising:
- receiving, from a user device, a query;
- determining a first plurality of images based at least in part on the query;
- subsequent to receiving the query, receiving an image of an object;
- comparing the image of the object with at least one image segment of each of the first plurality of images;
- determining a ranked list of at least a portion of the first plurality of images based at least in part on the comparison;
- and
- providing for presentation, according to the ranked list, the at least a portion of the first plurality of images.
4 more elements
A non-transitory computer-readable storage medium storing instructions that, when executed by at least one processor of a computing system, cause the computing system to at least:
- receive, at a user device, a query;
- determine that the query corresponds to a defined category;
- enable a visual refinement option on the user device;
- receive a streaming video from the user device as part of the visual refinement option;
- process at least a portion of the streaming video to identify an object type of one or more objects represented in the streaming video;
- present, on a display of the user device and concurrent with a presentation of the streaming video, the object type of the one or more objects;
- receive a selection of the object type;
- determine a plurality of stored images that correspond to both the query and the selected object type;
- and
- present on the display of the user device the plurality of stored images.
7 more elements
Dependencies are inferred from the claim text.