Back to results
US 11,775,844 B2Granted
Visual aspect localization presentation
AssigneeeBay Inc.
InventorsLicheng Yu, Mohammadhadi Kiapour, Ajinkya Gorakhnath Kale, Robinson Piramuthu
Life of this patent
Estimating the term…
Abstract
Various embodiments use a neural network to analyze images for aspects that characterize the images, to present locations of those aspects on the images, and, additionally, to permit a user to interact with those locations on the images. For example, a user may interact with a visual cue over one of those locations to modify, refine, or filter the results of a visual search, performed on a publication corpus, that uses an input image (e.g., one captured using a mobile device) as a search query.
Claims20
A method comprising:
- providing, by a hardware processor and as an input to a machine-learning system, an input image comprising an object, the object associated with a product category of an online marketplace;
- receiving, from the machine-learning system, aspect value data indicating a plurality of predicted aspect values corresponding to a plurality of aspects of the object, the aspect value data including, for each of the plurality of aspects, a set of locations on the input image that caused prediction of the plurality of predicted aspect values;
- generating, by the hardware processor and based on the aspect value data, a visual cue over the input image for a particular location in the set of locations, the visual cue selectable by user interaction on a display;
- presenting, by the hardware processor, a plurality of images, each of the plurality of images comprising another object of a plurality of other objects of a same product category as the object, each of the plurality of other objects representing a different aspect value;
- and
- filtering, by the hardware processor and responsive to user selection of a particular image of the plurality of images, results of a search for product listings of the online marketplace based on the input image.
3 more elements
A system comprising:
- a storage device storing instructions;
- and
- a hardware processor configured by the instructions to perform operations comprising:
- providing, as an input to a machine-learning system, an input image comprising an object, the object associated with a product category of an online marketplace;
- receiving, from the machine-learning system, aspect value data indicating a plurality of predicted aspect values corresponding to a plurality of aspects of the object, the aspect value data including, for each of the plurality of aspects, a set of locations on the input image that caused prediction of the plurality of predicted aspect values;
- generating, based on the aspect value data, a visual cue over the input image for a particular location in the set of locations, the visual cue selectable by user interaction on a display;
- presenting a plurality of images, each of the plurality of images comprising another object of a plurality of other objects of a same product category as the object, each of the plurality of other objects representing a different aspect value;
- and
- filtering, responsive to user selection of a particular image of the plurality of images, results of a search for product listings of the online marketplace based on the input image.
6 more elements
A non-transitory machine-readable storage medium storing instructions that, when executed by one or more hardware processors, cause the one or more hardware processors to perform operations comprising:
- providing, as an input to a machine-learning system, an input image comprising an object, the object associated with a product category of an online marketplace;
- receiving, from the machine-learning system, aspect value data indicating a plurality of predicted aspect values corresponding to a plurality of aspects of the object, the aspect value data including, for each of the plurality of aspects, a set of locations on the input image that caused prediction of the plurality of predicted aspect values;
- generating, based on the aspect value data, a visual cue over the input image for a particular location in the set of locations, the visual cue selectable by user interaction on a display;
- presenting a plurality of images, each of the plurality of images comprising another object of a plurality of other objects of a same product category as the object, each of the plurality of other objects representing a different aspect value;
- and
- filtering, responsive to user selection of a particular image of the plurality of images, results of a search for product listings of the online marketplace based on the input image.
3 more elements
Dependencies are inferred from the claim text.