# US 2019/0171767 A1 · Machine Learning and Automated Persistent Internet Domain Monitoring

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0171767 A1
- Document ID: US20190171767A1
- Status: Published application
- Kind: A1
- Application number: 15/830,940
- Filed: 2017-12-04
- Published: 2019-06-06
- Earliest claimed: 2017-12-04
- Assignees: Paypal, Inc.
- Applicants: Paypal, Inc.
- Inventors: Raja Ashok Bolla; Giselle Katrina Nevada; Kenneth Raymond Logan
- Web page: https://patentgrep.com/patent/US20190171767A1

## CPC

- G06F 16/9535: Search customisation based on user profiles and personalisation
- G06F 16/951: Indexing; Web crawling techniques
- G06N 20/00: Machine learning
- H04L 43/062: related to network traffic
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

Machine learning techniques are used to improve internet website and domain monitoring technology by classifying content using a trained algorithm. Based on crawling the web pages of a site, a machine learning classifier can be used to determine a composite content score for the website. Changes in the composite content score can be evaluated over time via multiple samplings of the website using the trained machine learning classifier. Additional weighting information can also be used as a factor in measuring website content change over time. Various change thresholds can be used with output of a machine learning classifier to determine content shifts over time.

## Claims

### Claim 1

A machine learning-based method for monitoring internet domain changes using a trained classifier, comprising:
crawling an internet domain, including accessing a first plurality of web pages;
parsing, by a computer system, the first plurality of web pages to obtain an initial composite content signature, wherein content of each of the first plurality of web pages is assessed by a machine learning classifier relative to a plurality of particular categories, and wherein each of the first plurality of web pages is assigned a weighting used to contribute to the initial composite content signature;
after a period of time has passed since first crawling the internet domain, re-crawling the internet domain including accessing a second plurality of web pages;
parsing the second plurality of web pages to obtain a second composite content signature; and
comparing the initial composite content signature to the second composite content signature to determine if a threshold change has occurred for content of the internet domain.

### Claim 2 (depends on 1)

The method of claim 1, wherein the machine learning classifier is a logistic regression classifier.

### Claim 3 (depends on 1)

The method of claim 1, wherein the machine learning classifier is trained using a set of training data comprising web pages that have been ranked by humans relative to the plurality of particular categories.

### Claim 4 (depends on 1)

The method of claim 1, wherein the comparing includes determining if a score for one of the plurality of categories has changed by a threshold amount for a same web page between the crawling and the re-crawling.

### Claim 5 (depends on 1)

The method of claim 1, further comprising:
weighting each of the first plurality of web pages according to a level of depth of the web pages from a starting location on the domain.

### Claim 6 (depends on 1)

The method of claim 1, further comprising:
weighting each of the first plurality of web pages according to monitored traffic on those web pages.

### Claim 7 (depends on 1)

The method of claim 1, further comprising:
weighting each of the first plurality of web pages according to electronic payment transaction purchases originated from individual ones of those web pages.

### Claim 8 (depends on 7)

The method of claim 7, wherein a weighting for a particular one of the first plurality of web pages is based on a shift in a transaction pattern for purchases originating from the particular web page.

### Claim 9 (depends on 1)

The method of claim 1, further comprising:
responsive to determining that the threshold change has occurred for content of the internet domain, flagging the internet domain for human evaluation with respect to an acceptable use policy (AUP) of an electronic service provider.

### Claim 10 (depends on 1)

The method of claim 1, wherein the first plurality of web pages are the same as the second plurality of web pages.

### Claim 11

A non-transitory computer-readable medium having stored thereon instructions that are executable by a computer system to cause the computer system to perform operations comprising:
accessing a first plurality of web pages obtained by crawling an internet domain;
parsing the first plurality of web pages to obtain an initial composite content signature, wherein content of each of the first plurality of web pages is assessed by a machine learning classifier relative to a plurality of particular categories, and wherein each of the first plurality of web pages is assigned a weighting used to contribute to the initial composite content signature;
after a period of time has passed since first crawling the internet domain, accessing a second plurality of web pages obtained by re-crawling the internet domain;
parsing the second plurality of web pages to obtain a second composite content signature; and
comparing the initial composite content signature to the second composite content signature to determine if a threshold change has occurred for content of the internet domain.

### Claim 12 (depends on 11)

The non-transitory computer-readable medium of claim 11, wherein the machine learning classifier is based on gradient boosting trees.

### Claim 13 (depends on 11)

The non-transitory computer-readable medium of claim 11, wherein the comparing includes determining if a score for one of the plurality of categories has changed by a particular percentage for the entire domain between the crawling and the re-crawling.

### Claim 14 (depends on 11)

The non-transitory computer-readable medium of claim 11, wherein the comparing includes determining if a cumulative change in score for two or more of the plurality of categories has occurred between the crawling and the re-crawling.

### Claim 15 (depends on 11)

The non-transitory computer-readable medium of claim 11, wherein the operations further comprise: using a transaction purchase pattern as a factor in determining if an acceptable use policy (AUP) may have been violated.

### Claim 16

A system, comprising:
a processor; and
a non-transitory computer-readable medium having stored thereon instructions that are executable by the system to cause the system to perform operations comprising:
accessing a first plurality of web pages obtained by crawling an internet domain;
parsing the first plurality of web pages to obtain an initial composite content signature, wherein content of each of the first plurality of web pages is assessed by a machine learning classifier relative to a plurality of particular categories, and wherein each of the first plurality of web pages is assigned a weighting used to contribute to the initial composite content signature;
after a period of time has passed since first crawling the internet domain, accessing a second plurality of web pages obtained by re-crawling the internet domain;
parsing the second plurality of web pages to obtain a second composite content signature; and
comparing the initial composite content signature to the second composite content signature to determine if a threshold change has occurred for content of the internet domain.

### Claim 17 (depends on 16)

The system of claim 16, wherein the operations further comprise:
weighting each of the first plurality of web pages according to monitored traffic on those web pages.

### Claim 18 (depends on 16)

The system of claim 16, wherein the operations further comprise:
weighting each of the first plurality of web pages according to electronic payment transaction purchases originated from individual ones of those web pages.

### Claim 19 (depends on 18)

The system of claim 18, wherein a weighting for a particular one of the first plurality of web pages is based on a shift in a transaction pattern for purchases originating from the particular web page.

### Claim 20 (depends on 1)

The system of claim 1, further comprising:
responsive to determining that the threshold change has occurred for content of the internet domain, flagging the internet domain for human evaluation with respect to an acceptable use policy (AUP) of an electronic service provider.
