# US 8,543,572 B2 · Systems and methods for analyzing boilerplate > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 8,543,572 B2 - Document ID: US8543572B2 - Status: Granted - Kind: B2 - Application number: 13/232,929 - Filed: 2011-09-14 - Published: 2012-01-05 - Granted: 2013-09-24 - Earliest claimed: 2004-03-31 - Assignees: Google Inc. - Applicants: Stephen R. Lawrence - Inventors: Stephen R. Lawrence - Web page: https://patentgrep.com/patent/US8543572B2 ## CPC - G06F 16/26: Visual data mining; Browsing structured data - G06F 16/335: Filtering based on additional data, e.g. user or group profiles (filtering in web context G06F16/9535, G06F16/9536) - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract Systems and methods for analyzing boilerplate are described. In one described system, an indexer identifies a common element in a plurality of related articles. The indexer then classifies the common element as boilerplate. For example, the indexer may identify a copyright notice appearing in a plurality of related articles. The copyright notice in these articles is considered boilerplate. ## Claims ### Claim 1 A computer-implemented method comprising: identifying a common element in a plurality of articles comprising boilerplate elements and content elements; determining that the common element is a boilerplate element of the plurality of articles by analyzing a link associated with the common element in an article of the plurality of articles, wherein analyzing the link comprises analyzing an address to which the link refers, and determining that the common element is a boilerplate element based at least in part on the link; assigning a weight to the common element based at least in part on the determination that the common element is a boilerplate element, wherein a content element is given a higher weight than the boilerplate element; establishing a search result set including one or more of the plurality of articles in response to a search query; and ranking the articles included in the search result set responsive at least in part to the weight assigned to the common element. ### Claim 2 (depends on 1) The method of claim 1, wherein the common element comprises one or more terms common to the plurality of articles and wherein determining that the common element is a boilerplate element further comprises: analyzing a frequency of occurrence of the common terms; and determining that the common element is a boilerplate element responsive at least in part to the frequency of occurrence of the common terms. ### Claim 3 (depends on 2) The method of claim 2, wherein the common element is determined to be a boilerplate element responsive at least in part to the terms having a low inverse document frequency measure. ### Claim 4 (depends on 1) The method of claim 1, wherein determining that the common element is a boilerplate element further comprises: determining whether a term within the common element is within a predetermined list of terms; and determining that the common element is a boilerplate element responsive at least in part to the term being within the predetermined list of terms. ### Claim 5 A non-transitory computer-readable storage medium storing executable program code comprising code for: identifying a common element in a plurality of articles comprising boilerplate elements and content elements; determining that the common element is a boilerplate element of the plurality of articles by analyzing a link associated with the common element in an article of the plurality of articles, wherein analyzing the link comprises analyzing an address to which the link refers, and determining that the common element is a boilerplate element based at least in part on the link; assigning a weight to the common element based at least in part on the determination that the common element is a boilerplate element, wherein a content element is given a higher weight than the boilerplate element; establishing a search result set including one or more of the plurality of articles in response to a search query; and ranking the articles included in the search result set responsive at least in part to the weight assigned to the common element. ### Claim 6 (depends on 5) The computer-readable storage medium of claim 5, wherein the common element comprises one or more terms common to the plurality of articles and determining that the common element is a boilerplate element further comprises: analyzing a frequency of occurrence of the common terms; and determining that the common element is a boilerplate element responsive at least in part to the frequency of occurrence of the common terms. ### Claim 7 (depends on 6) The computer-readable storage medium of claim 6, wherein the element is determined to be a boilerplate element responsive at least in part to the terms having a low inverse document frequency measure. ### Claim 8 (depends on 5) The computer-readable storage medium of claim 5, wherein determining that the common element is a boilerplate element further comprises: determining whether a term within the common element is within a predetermined list of terms; and determining that the common element is a boilerplate element responsive at least in part to the term being within the predetermined list of terms. ### Claim 9 A computer system comprising: a non-transitory computer-readable storage medium storing executable program code comprising code for: identifying a common element in a plurality of articles comprising boilerplate elements and content elements; determining that the common element is a boilerplate element of the plurality of articles at least by analyzing a link associated with the common element in an article of the plurality of articles, wherein analyzing the link comprises analyzing an address to which the link refers, and determining that the common element is a boilerplate element based at least in part on the link; assigning a weight to the common element based at least in part on the determination that the common element is a boilerplate element, wherein a content element is given a higher weight than the boilerplate element; establishing a search result set including one or more of the plurality of articles in response to a search query; and ranking the articles included in the search result set responsive at least in part to the weight assigned to the common element; and a processor for executing the program code. ### Claim 10 (depends on 9) The computer system of claim 9, wherein the common element comprises one or more terms common to the plurality of articles and determining that the common element is a boilerplate element further comprises: analyzing a frequency of occurrence of the common terms; and determining that the common element is a boilerplate element responsive at least in part to the frequency of occurrence of the common terms. ### Claim 11 (depends on 10) The computer system of claim 10, wherein the common element is determined to be a boilerplate element responsive at least in part to the terms having a low inverse document frequency measure. ### Claim 12 (depends on 9) The computer system of claim 9, wherein determining that the common element is a boilerplate element further comprises: determining whether a term within the common element is within a predetermined list of terms; and determining that the common element is a boilerplate element responsive at least in part to the term being within the predetermined list of terms.