Web crawling for use in providing leads generation and engagement recommendations

A physical article of manufacture including one or more devices encoding computer-executable instructions for executing on a computer system a computer process, the computer process comprising:

• determining, using a computer, similarities between (a) fitness, engagement, and intent characteristics of a plurality of target clients and (b) fitness, engagement, and intent characteristics of an entity's existing clients;
• generating recommendations for engagement with the plurality of target clients, wherein components of the recommendations for engagement are based on determined similarities between (a) the fitness, engagement, and intent characteristics of the plurality of target clients and (b) the fitness, engagement, and intent characteristics of the entity's existing clients;
• generating a feature matrix for the target client and comparing one or more value of the feature matrix of the target client with one or more values of a feature matrix for the entity's existing clients to generate the recommendations of engagement;
• categorizing a plurality of web pages, hyperlinks, and link structures located over the Internet using a trained classifier that uses features from content and code on web pages;
• crawling, by a computer, a plurality of web pages, hyperlinks, and link structures based on the categorization of the plurality of web pages, hyperlinks, and link structures to collect third party unstructured text information.