Unsupervised detection of web pages corresponding to a similarity class
AssigneeYahoo! Inc.
InventorMahesh TIYYAGURA
Life of this patent
Estimating the term…
Abstract
A method of detecting web pages belonging to at least one similarity class from a plurality of web pages includes determining clusters of the plurality of web pages based on characteristics of the content of the web pages. For each of the determined clusters, at least one metric is determined indicative of similarity among resource locators associated with the web pages of that cluster. A determination of web pages belonging to the at least one similarity class is based on the determined clusters and the determined similarity metrics.
Claims24
A method of detecting web pages belonging to at least one similarity class from a plurality of web pages, the method comprising:
- determining clusters of the plurality of web pages based on characteristics of the content of the web pages;
- determining, for each of the determined clusters, at least one metric indicative of similarity among resource locators associated with the web pages of that cluster;
- and
- determining the web pages belonging to the at least one similarity class based on the determined clusters and the determined similarity metrics.
A computer program product for detecting web pages belonging to at least one similarity class from a plurality of web pages, the computer program product comprising at least one computer-readable medium having computer program instructions stored therein which are operable to cause at least one computing device to:
- determine clusters of the plurality of web pages based on characteristics of the content of the web pages;
- determine, for each of the determined clusters, at least one metric indicative of similarity among resource locators associated with the web pages of that cluster;
- and
- determine the web pages belonging to the at least one similarity class based on the determined clusters and the determined similarity metrics.
A computing system including at least one computing device, configured to detecting web pages belonging to at least one similarity class from a plurality of web pages, the at least one computing device configured to:
- determine clusters of the plurality of web pages based on characteristics of the content of the web pages;
- determine, for each of the determined clusters, at least one metric indicative of similarity among resource locators associated with the web pages of that cluster;
- and
- determine the web pages belonging to the at least one similarity class based on the determined clusters and the determined similarity metrics.
Dependencies are inferred from the claim text.