Back to results
US 6,615,209 B1Granted
Detecting query-specific duplicate documents
AssigneeGoogle Inc.
InventorsBenedict Gomes, Benjamin Thomas Smith
Life of this patent
Estimating the term…
Abstract
An improved duplicate detection technique that uses query-relevant information to limit the portion(s) of documents to be compared for similarity is described. Before comparing two documents for similarity, the content of these documents may be condensed based on the query. In one embodiment, query-relevant information or text (also referred to as “snippets”) is extracted from the documents and only the extracted snippets, rather than the entire documents, are compared for purposes of determining similarity.
Claims38
A storage facility including at least one machine-readable medium storing information comprising:
- a) ranked query results;
- b) query-relevant parts of documents corresponding to the ranked query results;
- and
- c) a final set of query results,
- wherein the final set of query results is a sub-set of the ranked query results, and
- wherein the final set of query results does not include any two query results corresponding to documents that have similar query-relevant parts.
3 more elements
A method for processing search results generated based on a query, the method comprising:
- a) accepting the search results;
- b) accepting keyword information extracted from the query;
- c) generating a set of final search results from the accepted search results using the accepted keyword information,
- wherein the act of generating a set of final search results includes
- i) determining, using the accepted keyword information, whether or not a candidate search result is similar to a search result already in the set of final search results;
- and
- ii) if it is determined that the candidate search result is similar to a search result already in the set of final search results, then not adding the candidate search result to the set of final search results, and
- wherein the act of determining whether or not a candidate search result is similar to a search result already in the set of final search results includes
- A) extracting at least a part of the candidate search result that is relevant to the keyword information extracted from the query, thereby generating first query-relevant information;
- B) extracting at least a part of the search result already in the set of final search results that is relevant to the keyword information extracted from the query, thereby generating second query-relevant information;
- and
- C) determining whether or not the first query-relevant information is similar to the second query-relevant information,
- wherein, if the first query-relevant information is determined to be similar to the second query-relevant information, then determining the candidate search result to be similar to the search result already in the set of final search results, and
- wherein, if the first query-relevant information is determined not to be similar to the second query-relevant information, then determining the candidate search result not to be similar to the search result already in the set of final search results.
11 more elements
A machine-readable medium including machine executable instructions which, when executed by a machine, processes search results generated based on a query by:
- a) accepting the search results;
- b) accepting keyword information extracted from the query;
- c) generating a set of final search results from the accepted search results using the accepted keyword information,
- including further machine executable instructions which, when executed by a machine, generate the set of final search results by
- i) determining, using the accepted keyword information, whether or not a candidate search result is similar to a search result already in the set of final search results;
- and
- ii) adding the candidate search result to the set of final search results only if it is determined that the candidate search result is not similar to any search results already in the set of final search result, and
- including further machine executable instructions which, when executed by a machine determine whether or not a search result is similar to a search result already in the set of final search results by
- A) extracting at least a part of the search result that is relevant to the keyword information extracted from the query, thereby generating first query-relevant information;
- B) extracting at least a part of the search result already in the set of final search results that is relevant to the keyword information extracted from the query, thereby generating second query-relevant information;
- and
- C) determining whether or not the first query-relevant information is similar to the second query-relevant information,
- wherein, if the first query-relevant information is determined to be similar to the second query-relevant information, then determining the search results to be similar to the search result already in the set of final search results, and
- wherein, if the first query-relevant information is determined not to be similar to the second query-relevant information, then determining the search results not to be similar to the search result already in the set of final search results.
11 more elements
A method for processing search results generated based on a query, the method comprising:
- a) accepting the search results;
- b) accepting keyword information extracted from the query;
- c) generating a set of final search results from the accepted search results using the accepted keyword information,
- wherein the act of generating a set of final search results includes
- i) determining, using the accepted keyword information, whether or not a candidate search result is similar to a search result already in the set of final search results;
- and
- ii) adding the search results to the set of final search results only if it is determined that the candidate search result is not similar to any search results already in the set of final search result, and
- wherein the act of determining whether or not a candidate search result is similar to a search result already in the set of final search results includes
- A) extracting at least a part of the candidate search result that is relevant to the keyword information extracted from the query, thereby generating first query-relevant information;
- B) extracting at least a part of the search result already in the set of final search results that is relevant to the keyword information extracted from the query, thereby generating second query-relevant information;
- and
- C) determining whether or not the first query-relevant information is similar to the second query-relevant information,
- wherein, if the first query-relevant information is determined to be similar to the second query-relevant information, then determining the candidate search result to be similar to the search result already in the set of final search results, and
- wherein, if the first query-relevant information is determined not to be similar to the second query-relevant information, then determining the candidate search result not to be similar to the search result already in the set of final search results.
11 more elements
A method for determining whether or not a first document corresponding to a first search result is similar to a second document corresponding to a second search result, the method comprising:
- a) accepting a query that generated the first and second search results;
- b) extracting at least a part of the first document that is relevant to the information derived from the query, thereby generating first query-relevant information;
- c) extracting at least a part of the second document that is relevant to the information derived from the query, thereby generating second query-relevant information;
- and
- d) determining whether or not the first query-relevant information is similar to the second query-relevant information,
- wherein, if the first query-relevant information is determined to be similar to the second query-relevant information, then determining the first document to be similar to the second document, and
- wherein, if the first query-relevant information is determined not to be similar to the second query-relevant information, then determining the first document not to be similar to the second document.
4 more elements
An apparatus for processing search results generated based on a query, the apparatus comprising:
- a) a storage facility for storing the search results and for storing keyword information extracted from the query;
- and
- b) a final results generator for generating a set of final search results from the search results stored in the storage facility using the keyword information stored in the storage facility,
- wherein the final set generator includes
- i) a similarity determination facility for determining, using the accepted keyword information, whether or not a search result is similar to a search result already in the set of final search results;
- and
- ii) means for adding the search results to the set of final search results only if the similarity determination facility determines that the search result is not similar to any search results already in the set of final search result, and
- wherein the similarity determination facility includes
- A) a query-relevant extraction facility for extracting at least a part of the search result that is relevant to the keyword information extracted from the query, thereby generating first query-relevant information, and for extracting at least a part of the search result already in the set of final search results that is relevant to the keyword information extracted from the query, thereby generating second query-relevant information;
- and
- B) a query-relevant similarity determination facility for determining whether or not the first query-relevant information is similar to the second query-relevant information
- wherein, if the query-relevant similarity determination facility determines that the first query-relevant information is similar to the second query-relevant information, then the similarity determination facility determines the search result to be similar to the search result already in the set of final search results, and
- wherein, if the query-relevant similarity determination facility determines that the first query-relevant information is not similar to the second query-relevant information, then the similarity determination facility determines the search result not to be similar to the search result already in the set of final search results.
10 more elements
A method for processing search results generated based on a query, the method comprising:
- a) accepting the search results;
- b) accepting information derived from the query;
- c) accepting documents associated with the search results;
- d) extracting portions of the documents associated with the search results using the information derived from the query to generate query-relevant information for each of the documents;
- and
- e) generating a set of final search results from the accepted search results using the extracted portions of the documents,
- In accordance with 37 C.F.R. §1.121 (c)(1)(ii), separate sheets with the rewritten claims marked-up to show the changes made to the previous version of the claims, is filed herewith.
4 more elements
Dependencies are inferred from the claim text.