Systems and methods for categorizing domains using artificial intelligence

A system for training a classifier comprising:

• at least one processor;
• and
• a computer-readable medium storing computer executable instructions stored therefore that when executed by the at least one processor cause the system to:
• receive a training set of webpages, wherein each webpage in the training set is labeled with a category of a first plurality of categories;
• retrieve a second plurality of categories stored on the system, wherein the second plurality of categories has fewer categories than the first plurality of categories;
• for each webpage of the training set of webpages that is labeled with a category that is in the first plurality of categories but not in the second plurality of categories, replacing the category that the webpage is labeled with using a category from the second plurality of categories;
• for each webpage of the training set of webpages, extract one or more features from the webpage, wherein the one or more features comprise script features;
• and
• for each webpage of the training set of webpages, train a neural network classifier using the one or more extracted features and the category that the webpage is labeled with.

A non-transitory computer-readable medium storing computer executable instructions stored therefore that when executed by at least one processor a system to:

• receive a training set of webpages, wherein each webpage in the training set is labeled with a category of a first plurality of categories;
• retrieve a second plurality of categories stored on the system, wherein the second plurality of categories has fewer categories than the first plurality of categories;
• for each webpage of the training set of webpages that is labeled with a category that is in the first plurality of categories but not in the second plurality of categories, replacing the category that the webpage is labeled with using a category from the second plurality of categories;
• for each webpage of the training set of webpages, extract one or more features from the webpage, wherein the one or more features comprise script features;
• and
• for each webpage of the training set of webpages, train a neural network classifier using the one or more extracted features and the category that the webpage is labeled with.