US 2018/0018390 A1 · CONTEXTUAL BASED IMAGE SEARCH RESULTS

Abstract

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium determining image relevance responsive to a search query. In one aspect, a method includes, for each resource in a plurality of resources, wherein each resource includes one or more images and text that is separate from each of the one or more images: determining, by a data processing apparatus, and from the text of the resource, resource topics described by the text of the resource. For each of the one or more images, processing the image to determine a set of image topics that describe topics to which content depicted in the image belongs. Determining, by the data process apparatus, one or more topic match scores, wherein each topic match score is a measure of relevance one or more of the image topics of the image to one or more of the resource topics of the resource.

Claims20

Dependent claims

A method performed by a data processing apparatus, comprising:

for each resource in a plurality of resources, wherein each resource includes one or more images and text that is separate from each of the one or more images:
determining, by a data processing apparatus, and from the text of the resource, resource topics described by the text of the resource;
for each of the one or more images,
processing, by the data processing apparatus, the image to determine a set of image topics that describe topics to which content depicted in the image belongs;
determining, by the data process apparatus, one or more topic match scores, wherein each topic match score is a measure of relevance of one or more of the image topics of the image to one or more of the resource topics of the resource;
storing in an index, by the data processing apparatus and for the image, data that describes the image topics for the image, resource topics for the resource, and the one or more topic match scores for the image.

3 more elements

A system, comprising:

a data processing apparatus;
and
software stored in non-transitory computer readable storage medium storing instructions executable by the data processing apparatus and that upon such execution cause the data processing apparatus to perform operations comprising:
for each resource in a plurality of resources, wherein each resource includes one or more images and text that is separate from each of the one or more images:
determining, by a data processing apparatus, and from the text of the resource, resource topics described by the text of the resource;
for each of the one the one or more images,
processing, by the data processing apparatus, the image to determine a set of image topics that describe topics to which content depicted in the image belongs;
determining, by the data process apparatus, one or topic match scores, wherein each topic match score is a measure of relevance of one or more of the image topics of the image to one or more of the resource topics of the resource;
storing in an index, by the data processing apparatus and for the image, data that describes the image topics for the image, resource topics for the resource, and the one or more topic match scores for the image.

6 more elements

Dependencies are inferred from the claim text.

Contextual based image search results

Life of this patent

Contextual based image search results

Life of this patent

Abstract

Claims20