US 8,799,257 B1Granted

Searching based on audio and/or visual features of documents

AssigneeGoogle Inc.

InventorCarl Fredrik Hubinette

Life of this patent

Estimating the term…

Loading patent…

Abstract

One or more computer devices may generate a keyword based on a visual feature or an audible feature of a document. The visual feature may include a color of a background of the document, a color of text in the document, a size of the text in the document, or a feature relating to a video in the document. The audible feature may relate to sound or music that is associated with the document. The one or more computer devices may further associate, in an index, the keyword with information identifying the document, receive a search query from a client, the search query including a term related to the keyword, identify documents based on the search query and using the index, the identified documents including the document, and provide a search results document to the client. The search results document may identify one or more of the identified documents.

Claims20

Dependent claims

A method comprising:

receiving, by one or more computer devices, a search query from a client,
the search query including a plurality of terms entered by a user of the client,
the plurality of terms including:
a first term related to a topic of a web page,
a second term related to a first keyword of a plurality of keywords,
a third term related to a second keyword of the plurality of keywords,
the plurality of keywords corresponding to a plurality of visual features,
the plurality of visual features including:
a color of a background of the web page,
a feature relating to an image in the web page, and
at least one of:
a color or a size of text in the web page, or
a feature relating to a video in the web page,
the first keyword relating to a first visual feature of the plurality of visual features,
the second keyword relating to a second visual feature of the plurality of visual features,
one of the first visual feature or the second visual feature including the color of the background of the web page, and
a fourth term to be searched in relation to the one of the first visual feature or the second visual feature,
an index associating the plurality of keywords with information identifying the web page;
converting, by the one or more computer devices, a format of the second term to a format of the first keyword in the index when the format of the second term does not match the format of the first keyword;
identifying, by the one or more computer devices, documents based on the search query and using the index,
the identified documents including the web page;
and
providing, by the one or more computer devices, a search results document to the client,
the search results document identifying one or more of the identified documents.

21 more elements

A system comprising:

one or more computer devices to:
receive a search query from a client,
the search query including a plurality of terms entered by a user of the client,
the plurality of terms including:
a first term related to a topic of a web page,
a second term related to a first keyword of a plurality of keywords,
a third term related to a second keyword of the plurality of keywords,
the plurality of keywords corresponding to a plurality of features of the web page,
the plurality of features including:
a color of a background of the web page,
a feature relating to an image in the web page, and
a feature relating to an audible feature of the web page,
the first keyword relating to a first feature of the plurality of features,
the second keyword relating to a second feature of the plurality of features, and
a fourth term to be searched in relation to one of the first feature or the second feature,
an index associating the plurality of keywords with information identifying the web page,
convert a format of the second term to a format of the first keyword in the index when the format of the second term does not match the format of the first keyword;
identify documents based on the search query and using the index,
the identified documents including the web page, and provide a search results document to the client,
the search results document identifying one or more documents of the identified documents,
the one or more documents including the web page.

18 more elements

A non-transitory computer-readable medium for storing instructions, the instructions comprising:

one or more instructions, which when executed by one or more processors, cause the one or more processors to:
receive a search query from a client,
the search query including a plurality of terms entered by a user of the client,
the plurality of terms including:
a first term related to a topic of a document,
a second term related to one of a plurality keywords,
the one of the plurality of keywords being generated based on one of a plurality of features,
the plurality of features including:
a color of a background of the document,
a feature relating to an image in the document, and
a feature relating to an audible feature of the document, and
a third term to be searched in relation to the one of the plurality of features,
an index associating the plurality of keywords with information identifying the document,
convert a format of the second term to a format of the one of the plurality of keywords in the index when the format of the second term does not match the format of the one of the plurality of keywords,
identify documents based on the search query and using the index,
the identified documents including the document, and provide a search results document to the client,
the search results document identifying one or more documents of the identified documents,
the one or more documents including the document.

15 more elements

Dependencies are inferred from the claim text.