US 12,002,083 B2 · Visual quality performance predictors

Abstract

A visual search recommendation engine utilizes an image quality indication model for a visual search recommendation. Specifically, the visual search recommendation engine receives a search image as a search query at a search engine. The visual search recommendation engine provides the search image as an input into the image quality indication model, which is trained to output an image quality indication based on image aspects of the search image. A plurality of images are identified from an image corpus. The visual search recommendation engine determines an image similarity based on a comparison between the plurality of images from the image corpus and the search image. The image quality indication and the image similarity indicate a search query performance for the search image. A first image exceeding the search query performance is identified. The first image is provided for display at the search engine.

Claims19

Dependent claims

One or more non-transitory computer storage media storing computer-readable instructions that when executed by a processor, cause the processor to perform operations for a visual search recommendation, the operations comprising:

receiving a search image as a search query at a search engine;
providing the search image as an input into an image quality indication model, the image quality indication model trained to output an image quality indication based on image aspects of the search image;
identifying a plurality of images from an image corpus;
determining a search query performance for the search query based on the image quality indication and an image similarity between each of the plurality of images and the search image;
identifying a first image exceeding the search query performance indicated by the image quality indication and the image similarity;
providing for display at the search engine, the first image as a recommendation for the search query;
receiving a selection of the first image recommended;
providing for display at the search engine, a set of search result images corresponding to the selection of the first image, the set of search result images exceeding the search query performance of the search image;
and
receiving a selection of one of the set of search result images.

7 more elements

A computer implemented method for a visual search recommendation, the method comprising:

training an image quality indication model to output image quality indications of input images based on one or more of an angle of view, blurriness, and background quality;
generating an image similarity determination model, wherein the image similarity determination model determines an image similarity between a search image and images of an image corpus based on image latent vectors;
generating an output engine configured to output a recommended image for recommendation as a search query, the recommended image based on identifying an image exceeding a search query performance for a search image determined based on an image quality indication of the recommended image determined using the trained image quality indication model and the image similarity determined using the image similarity determination model;
in response to receiving a first search image as a first search query, providing a first recommended image, via the output engine, for the recommendation as the first search query based on the first recommended image exceeding the search query performance determined based on providing the first search image to the trained image quality indication model and the image similarity determination model;
receiving an indication to use the first recommended image;
providing a set of the search result images in response to receiving the indication to use the first recommended image, each of the set of the search result images exceeding the search query performance for the first search query;
and
receiving a selection of one of the set of search result images.

5 more elements

A system for a visual search recommendation, the system comprising:

at least one processor;
and
one or more computer storage media storing computer-readable instructions that when executed by the at least one processor, cause the at least one processor to perform operations comprising:
providing a search image at a search engine;
receiving a recommended image as a selectable option from the search engine based on the search image, wherein the recommended image is determined based on the recommended image having a search query performance exceeding a search query performance of the search image, the search query performance of the recommended image and the search query performance of the search image determined from an image quality indication determined by a trained image quality indication model and an image similarity determined by a trained image similarity determination model;
selecting the recommended image for use as a search query at the search engine;
receiving from the search engine a search results page comprising search result images corresponding to the recommended image selected the search result images exceeding the search query performance of the search image, the search result images being presented as selectable options;
and
selecting one of the selectable options.

6 more elements

Dependencies are inferred from the claim text.

Visual quality performance predictors

Life of this patent

Visual quality performance predictors

Life of this patent

Abstract

Claims19