Anchored match algorithm for matching with large sets of URL

A system for matching with indexed Uniform Resource Locator (URL) pattern sets, comprising:

• a pattern indexer executable on a processor, coupled to memory of a computing device, and configured to establish a hash map identifying a plurality of buckets, each bucket of the plurality of buckets including a plurality of patterns, each pattern of the plurality of patterns in each bucket sharing a same host prefix of a respective uniform resource locator (URL), each bucket of the plurality of buckets indexed via the hash map by a hash of the host prefix of the URL, at least one of the plurality of buckets indexed by a first hash of a first host prefix of a first URL, the first URL having the first host prefix, a first prefix, and a first suffix;
• a pattern matcher executable on the computing device configured to:
• identify a second URL to perform a match against the hash map, the second URL including a second host prefix, a second prefix, and a second suffix;
• calculate a second hash of the second host prefix of the second URL;
• determine that the second hash matches an index of the first hash,
• identify, from the plurality of buckets, a bucket corresponding to the index of the first hash determined to match the second hash;
• and
• search the plurality of patterns in the bucket using the second URL to identify a match of a pattern corresponding to the first URL based at least on the first suffix, and the second suffix, and a comparison between a first length of the first prefix and a second length of the second prefix;
• and
• a policy manager of the computing device, configured to apply a policy using the second URL based on the identification of the match between the first URL corresponding to the pattern and the second URL.