Systems and methods for improved server-side contextual page analysis

A computer-implemented method comprising:

• receiving, at a server, a request to perform contextual analysis of a page, wherein the page is identified by a uniform resource identifier (URI);
• initiating execution of a headless content extractor by the server, wherein the headless content extractor is configured to extract content included in or referenced in the page, wherein the content includes text formatted in a HyperText Markup Language (HTML) format and one or more images, wherein at least a portion of the content extracted is not included in an initial file stored at the URI but is requested from an external system over a network based on at least one of (a) execution by the headless content extractor of code included in the initial file or (b) a reference in HTML of the initial file to an additional URI hosted by the external system;
• performing contextual analysis of the content extracted by the headless content extractor, wherein performing the contextual analysis comprises (c) analyzing text of the content using natural language processing and (d) analyzing the one or more images using one or more computer vision techniques;
• and
• storing, in a data store accessible to the server, keywords associated with the page determined from the results of the contextual analysis, wherein the keywords are based at least in part on the analyzing of the text and the analyzing of the one or more images, wherein the keywords are associated in the data store with the URI.

A computer-readable, non-transitory storage medium storing computer executable instructions that, when executed by one or more computer systems, configure the one or more computer systems to perform operations comprising:

• receiving a request to perform contextual analysis of a page, wherein the page is accessible over a network via a uniform resource identifier (URI);
• initiating execution of a headless content extractor, wherein the headless content extractor is configured to extract content included in or referenced in the page without causing display of the content, wherein the content includes text formatted in a HyperText Markup Language (HTML) format and one or more images, wherein at least a portion of the content extracted is not included in an initial file stored at the URI but is requested from an external system over the network based on each of (a) execution by the headless content extractor of code included in the initial file and (b) a reference in HTML of the initial file to an additional URI hosted by the external system;
• performing contextual analysis of the content extracted by the headless content extractor, wherein performing the contextual analysis comprises (c) analyzing text of the content using natural language processing and (d) analyzing the one or more images using one or more computer vision techniques;
• and
• storing, in an electronic data store, keywords associated with the page determined from the results of the contextual analysis, wherein the keywords are based at least in part on the analyzing of the text and the analyzing of the one or more images, wherein storing the keywords includes associating the keywords with the URI in the electronic data store.