# US 2010/0076957 A1 · Method and apparatus for detecting sensitive content in a document

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2010/0076957 A1
- Document ID: US20100076957A1
- Status: Published application
- Kind: A1
- Application number: 12/208,091
- Filed: 2008-09-10
- Published: 2010-03-25
- Earliest claimed: 2008-09-10
- Assignees: Palo Alto Research Center Incorporated
- Inventors: Jessica N. Staddon; Richard Chow; Valeria de Paiva; Philippe J.P. Golle; Ji Fang; Tracy Holloway King
- Web page: https://patentgrep.com/patent/US20100076957A1

## CPC

- G06F 16/313: {Selection or weighting of terms for indexing}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

One embodiment of the present invention provides a system that detects sensitive content in a document. In doing so, the system receives a document, identifies a set of terms in the document that are candidate sensitive terms, and generates a combination of terms based on the identified terms that is associated with a semantic meaning. Next, the system performs searches through a corpus based on the combination of terms and determines hit counts returned for each term in the combination and for the combination. The system then determines whether the combination of terms is sensitive based on the hit count for the combination and the hit counts for the individual terms in the combination, and generates a result that indicates portions of the document which contain sensitive combinations.

## Claims

### Claim 1

A computer-executed method for detecting sensitive content in a document, the method comprising:
receiving a document;
identifying a set of terms in the document that are candidate sensitive terms;
generating a combination of terms, based on the identified terms, that is associated with a semantic meaning;
performing searches through a corpus based on the combination of terms and determining hit counts returned for each term in the combination and for the combination;
determining whether the combination of terms is sensitive based on the hit count for the combination and the hit counts for the individual terms in the combination; and
generating a result that indicates portions of the document which contain sensitive combinations.

### Claim 2 (depends on 1)

The method of claim 1, wherein identifying the set of terms in the document that are candidate sensitive terms comprises processing the document with a part-of-speech (POS) tagger to identify words that belong to a predetermined set of word classes.

### Claim 3 (depends on 1)

The method of claim 1, further comprising determining a relationship between the identified terms by processing the document with a syntactic parser to determine relationships between the terms.

### Claim 4 (depends on 3)

The method of claim 3, wherein determining the relationship between the identified terms further comprises scoring a respective relationship based on a determined relevance to the document and a likelihood of being sensitive.

### Claim 5 (depends on 1)

The method of claim 1, wherein determining whether the combination of terms is sensitive comprises:
for a respective term, T1, in the combination of k terms, determining a number, qi, of public documents that include the respective term Ti; and
computing an occurrence ratio, r, as the ratio between a predetermined function, ƒ, of Ti, and a predetermined function, g, of qi:
r
=
f

(
T
1
,
T
2
,
…

,
T
k
)
g

(
q
1
,
q
2
,
…

,
q
k
)
.

### Claim 6 (depends on 1)

The method of claim 1, further comprising disregarding the combination if the combination is not associated with sensitive information by determining that the respective combination can be inferred from public information.

### Claim 7 (depends on 6)

The method of claim 6, wherein determining that the combination can be inferred from public information comprises:
for a respective term in the combination, gathering supplemental information related to the term based on corpus searches and/or synonym/hypernym databases;
determining a degree of separation between two terms in the combination by determining the relationship between a first term in the combination and the supplemental information associated with a second term in the combination; and
determining whether the degree of separation between the two terms in the combination is below a predetermined threshold.

### Claim 8

A computer-readable storage medium storing instructions that when executed by a computer cause the computer to perform a method for detecting sensitive content in a document, the method comprising:
receiving a document;
identifying a set of terms in the document that are candidate sensitive terms;
generating a combination of terms, based on the identified terms, that is associated with a semantic meaning;
performing searches through a corpus based on the combination of terms and determining hit counts returned for each term in the combination and for the combination;
determining whether the combination of terms is sensitive based on the hit count for the combination and the hit counts for the individual terms in the combination; and
generating a result that indicates portions of the document which contain sensitive combinations.

### Claim 9 (depends on 8)

The computer-readable storage medium of claim 8, wherein identifying the set of terms in the document that are candidate sensitive terms comprises processing the document with a part-of-speech (POS) tagger to identify words that belong to a predetermined set of word classes.

### Claim 10 (depends on 8)

The computer-readable storage medium of claim 8, further comprising determining a relationship between the identified terms by processing the document with a syntactic parser to determine relationships between the terms.

### Claim 11 (depends on 10)

The computer-readable storage medium of claim 10, wherein determining the relationship between the identified terms further comprises scoring a respective relationship based on a determined relevance to the document and a likelihood of being sensitive.

### Claim 12 (depends on 8)

The computer-readable storage medium of claim 8, wherein determining whether the combination of terms is sensitive comprises:
for a respective term, T1, in the combination of k terms, determining a number, qi, of public documents that include the respective term Ti; and
computing an occurrence ratio, r, as the ratio between a predetermined function, ƒ, of Ti, and a predetermined function, g, of qi:
r
=
f

(
T
1
,
T
2
,
…

,
T
k
)
g

(
q
1
,
q
2
,
…

,
q
k
)
.

### Claim 13 (depends on 8)

The computer-readable storage medium of claim 8, wherein the method further comprises disregarding the combination if the combination is not associated with sensitive information by determining that the respective combination can be inferred from public information.

### Claim 14 (depends on 13)

The computer-readable storage medium of claim 13, wherein determining that the combination can be inferred from public information comprises:
for a respective term in the combination, gathering supplemental information related to the term based on corpus searches and/or synonym/hypernym databases;
determining a degree of separation between two terms in the combination by determining the relationship between a first term in the combination and the supplemental information associated with a second term in the combination; and
determining whether the degree of separation between the two terms in the combination is below a predetermined threshold.

### Claim 15

An apparatus for detecting sensitive content in a document, comprising:
a receiving mechanism configured to receive a document;
an analysis mechanism configured to:
identify a set of terms in the document that are candidate sensitive terms; and
generate a combination of terms, based on the identified terms, that is associated with a semantic meaning; and
a search engine interface configured to perform searches through a corpus based on the combination of terms and determining hit counts returned for each term in the combination and for the combination;
wherein the analysis mechanism is further configured to:
determine whether the combination of terms is sensitive based on the hit count for the combination and the hit counts for the individual terms in the combination; and
generate a result that indicates portions of the document which contain sensitive combinations.

### Claim 16 (depends on 15)

The apparatus of claim 15, wherein while identifying the set of terms in the document that are candidate sensitive terms, the analysis mechanism is further configured to process the document with a part-of-speech (POS) tagger to identify words that belong to a predetermined set of word classes.

### Claim 17 (depends on 15)

The apparatus of claim 15, wherein the analysis mechanism is further configured to determine a relationship between the identified terms by processing the document with a syntactic parser to determine relationships between the terms.

### Claim 18 (depends on 17)

The apparatus of claim 17, wherein while determining the relationship between the identified terms, the analysis mechanism is further configured to score a respective relationship based on a determined relevance to the document and a likelihood of being sensitive.

### Claim 19 (depends on 15)

The apparatus of claim 15, wherein while determining whether the combination of terms is sensitive, the analysis mechanism is configured to:
for a respective term, Ti, in the combination of k terms, determine a number, qi, of public documents that include the respective term Ti; and
compute an occurrence ratio, r, as the ratio between a predetermined function, ƒ, of Ti, and a predetermined function, g, of qi:
r
=
f

(
T
1
,
T
2
,
…

,
T
k
)
g

(
q
1
,
q
2
,
…

,
q
k
)
.

### Claim 20 (depends on 15)

The apparatus of claim 15, wherein the analysis mechanism is further configured to disregard the combination if the combination is not associated with sensitive information by determining that the respective combination can be inferred from public information.

### Claim 21 (depends on 20)

The apparatus of claim 20, wherein while determining that the combination can be inferred from public information, the analysis mechanism is configured to:
for a respective term in the combination, gather supplemental information related to the term based on corpus searches and/or synonym/hypernym databases;
determine a degree of separation between two terms in the combination by determining the relationship between a first term in the combination and the supplemental information associated with a second term in the combination; and
determine whether the degree of separation between the two terms in the combination is below a predetermined threshold.
