Website classification via containment queries
AssigneeMcAfee, Inc.
InventorGerman Lancioni
Life of this patent
Estimating the term…
Abstract
There is disclosed a computer-implemented system and method for categorizing unclassified websites, including computing a data sketch of an unclassified website, wherein the data sketch is a probabilistic data structure that represents text of the unclassified website; computing an intersection value between the data sketch and a comparison set, wherein the comparison set comprises data sketches of known, classified websites; assigning matches for a subset of websites from the comparison set, wherein the subset includes intersections above an intersection threshold; classifying the website into a category of a website from the subset; and performing web traffic management based on the classification.
Claims20
A computer-implemented method of categorizing unclassified websites, comprising:
- computing a data sketch of an unclassified website, wherein the data sketch comprises a probabilistic data structure that represents text of the unclassified website;
- computing an intersection value between the data sketch and a comparison set, wherein the comparison set comprises data sketches of known, classified websites, wherein computing the intersection comprises computing a containment query wherein the containment query is computed according to an intersection of the data sketch and known, categorized websites in the comparison set, divided by a size of the comparison set;
- assigning matches for a subset of websites from the comparison set, wherein the subset includes intersections above an intersection threshold;
- classifying the website into a category of a website from the subset;
- and
- performing web traffic management based on the classification.
One or more tangible, nontransitory computer-readable storage media having stored thereon executable instructions to:
- compute a data sketch of an unclassified website, wherein the data sketch comprises a probabilistic data structure that represents text of the unclassified website;
- compute an intersection value between the data sketch and a comparison set, wherein the comparison set comprises data sketches of known, classified websites, and wherein computing the intersection comprises computing a containment query, wherein the containment query is computed according to an intersection of the data sketch and known, categorized websites in the comparison set, divided by a size of the comparison set;
- assign matches for a subset of websites from the comparison set, wherein the subset includes intersections above an intersection threshold;
- classify the website into a category of a website from the subset;
- and
- perform web traffic management based on the classifying.
A computing apparatus, comprising:
- a hardware platform comprising a processor circuit and a memory;
- and
- instructions encoded within the memory to instruct the processor circuit to:
- compute a data sketch of an unclassified website, wherein the data sketch comprises a probabilistic data structure that represents text of the unclassified website;
- compute an intersection value between the data sketch and a comparison set, wherein the comparison set comprises data sketches of known, classified websites, and wherein computing the intersection comprises computing a containment query, wherein the containment query is computed according to an intersection of the data sketch and known, categorized websites in the comparison set, divided by a size of the comparison set;
- assign matches for a subset of websites from the comparison set, wherein the subset includes intersections above an intersection threshold;
- classify the website into a category of a website from the subset;
- and
- perform web traffic management based on the classifying.
Dependencies are inferred from the claim text.