Keyword extraction from uniform resource locators (urls)

A computer-implemented process for extracting keywords from Uniform Resource Locator (URL) addresses, comprising:

• dividing a current URL of a current web page into four pre-defined URL components of authority, path, query and fragment;
• tokenizing the components separately based on specific delimiters and heuristic observations to obtain segments;
• performing text segmentation on the segments to convert the URL's text into natural language terms;
• extracting a first set of keywords from the segment terms based on a controlled vocabulary;
• generating a second set of keywords by forming combinations of terms from different segments of the URL from the first set of keywords based on the controlled vocabulary;
• scoring the first and second sets of keywords based on relevance in order to output an ordered set of scored keywords.

A system for generating keywords from the URL of a webpage, comprising:

• a general purpose computing device;
• a computer program comprising program modules executable by the general purpose computing device, wherein the computing device is directed by the program modules of the computer program to,
• divide a URL into multiple components based on URL structure;
• extract a first set of keywords from each component of the URL independently using a controlled vocabulary;
• extract a second set of keywords by forming combinations of terms from different components of the URL that was used to extract the first set of keywords;
• retain only keywords that are present in the controlled vocabulary;
• score the keywords based on the location in the URL from which the keywords were extracted.