Web page classification based on noise removal

A system for web page classification comprising:

• a non-transitory storage device having embodied therein one or more routines operable to facilitate categorization of content of a web page;
• and
• one or more processors coupled to the non-transitory storage device and operable to execute the one or more routines, wherein the one or more routines include:
• a Uniform Resource Locator (URL) receive module, which when executed by the one or more processors, receives a URL of a web page to be categorized;
• a URL tree construction module, which when executed by the one or more processors, constructs a tree for the web page, wherein the tree represents a layout and a hierarchy of a plurality of tags that are used to represent the web page;
• a tag based filtration module, which when executed by the one or more processors, filters out a first set of tags from the plurality of tags to obtain desired tags that are indicative of relevant and actual content displayed by or linked by the web page;
• a hyperlink list retrieval module, which when executed by the one or more processors, retrieves a list of hyperlinks that form part of the web page based on processing of the desired tags;
• a valid hyperlink list generation module, which when executed by the one or more processors, processes the list of hyperlinks to generate a valid hyperlink list based on rejection of any or a combination of irrelevant hyperlinks, stop hyperlinks, and hyperlinks having a distance from a valid hyperlink of greater than a defined threshold;
• and
• a valid hyperlink list based categorization module, which when executed by the one or more processors, processes the valid hyperlink list to associate a final category from a plurality of categories with the web page.