Video and digital multimedia aggregator remote content crawler

A method comprising:

• acquiring network resource data, wherein the network resource data comprises address data for content servers;
• acquiring crawling criteria, wherein the crawling criteria comprises a plurality of conditions and are used during a crawling operation to search for content, said plurality of conditions comprising content subject matter, content type, and a delivery method;
• crawling network resources via at least one processor in accordance with the crawling criteria;
• determining if a content provider data meets said plurality of conditions of said crawling criteria;
• providing said content provider data to a user terminal;
• and
• receiving content provider rankings from users of a network,
• wherein acquiring the crawling criteria comprises automatically acquiring the crawling criteria, and
• wherein automatically acquiring the crawling criteria, comprises:
• analyzing and importing metadata schemes for standardized and proprietary content formats;
• parsing metadata field names and descriptive terms;
• analyzing hypertext associated with desired hyperlinks;
• and
• analyzing text proximate to the desired hyperlinks, wherein analyzing hypertext identifies terms that relate to a data type or content category.

A method comprising:

• acquiring network resource data, wherein the network resource data comprises address data for content servers;
• acquiring crawling criteria, wherein the crawling criteria comprises a plurality of conditions and are used during a crawling operation to search for content, said plurality of conditions comprising content subject matter, content type, and a delivery method;
• crawling network resources via at least one processor in accordance with the crawling criteria;
• determining if a content provider data meets said plurality of conditions of said crawling criteria;
• providing said content provider data to a user terminal;
• receiving content provider rankings from users of a network;
• and
• updating the address data, wherein updating the address data, comprises:
• receiving hyperlinked domain names for the network resources;
• downloading domain name records from public and private domain name registration sources;
• synchronizing local Domain Name Service (DNS) databases with one or more DNS databases over one or more communications networks;
• performing reverse domain name resolution, comprising locating URLs associated with allowable IP address numbers;
• verifying DNS aliases and duplicate URLs against IP addresses;
• and
• eliminating any duplicate URLs identified by the verifying step.