Machine learning system and methods for determining confidence levels of personal information findings
AssigneeBigID Inc.
InventorsYehoshua Enuka, Nimrod Vax, Eyal Sacharov, Itamar Apel
Life of this patent
Estimating the term…
Abstract
The disclosed privacy management platforms are adapted to scan any number of data sources in order to provide users with visibility into stored personal information, risk associated with storing such information and/or usage activity relating to such information. The platforms may correlate personal information findings to specific data subjects and may employ machine learning models to classify findings as corresponding to a particular personal information attribute to provide an indexed inventory across multiple data sources.
Claims20
A computer-implemented method of finding and classifying personal information in a data source, the method comprising:
- determining, by a computer, a plurality of personal information findings in a scanned data source comprising a first scanned field associated with first scanned values, the plurality of personal information findings comprising:
- a first set of personal information findings determined by comparing the first scanned values to first attribute values associated with a first attribute field in an identity data source;
- and
- a second set of personal information findings determined by comparing the first scanned values to second attribute values associated with a second attribute field in the identity data source;
- creating, by the computer, a plurality of personal information records from some or all of the plurality of personal information findings, there plurality of personal information records comprising:
- a first set of personal information records created from some or all of the first set of personal information findings;
- and
- a second set of personal information records created from some or all of the second set of personal information findings;
- calculating, by the computer, a first confidence level for the first scanned field and the first attribute field, said calculating based on one or more:
- a count of the first scanned values, a count of the first set of personal information findings, a count of the first set of personal information records, and a sum of the count of the first set of personal information records and a count of the second set of personal information records;
- calculating, by the computer, a second confidence level for the first scanned field and the second attribute field, said calculating based on one or more:
- the count of the first scanned values, a count of the second set of personal information findings, a count of the second set of personal information records, and the sum of the count of the first set of personal information records and the count of the second set of personal information records;
- upon determining that the first confidence level is greater than or equal to a minimum confidence threshold and that the second confidence level is less than the minimum confidence threshold, associating, by the computer, the first attribute field, but not the second attribute field, with the first scanned field in a database.
A system comprising one or more computers and one or more storage devices storing instructions that when executed by the one or more computers cause the one or more computers to perform operations comprising:
- determining a plurality of personal information findings in a scanned data source comprising a first scanned field associated with first scanned values, the plurality of personal information findings comprising:
- a first set of personal information findings determined by comparing the first scanned values to a first attribute values associated with a first attribute field in an identity data source;
- and
- second set of personal information findings determined by comparing the first scanned values to second attribute values associated with a second attribute field in the identity data source for a different identity data source;
- creating a plurality of personal information records from some or all of the plurality of personal information findings, the plurality of personal information records comprising:
- a first set of personal information records created from some or all of the first set of personal information findings;
- and
- a second set of personal information records created from some or all of the second set of personal information findings;
- calculating a first confidence level for the first scanned field and the first attribute field, said calculating based on one or more:
- a count of the first scanned values, a count of the first set of personal information findings, a count of the first set of personal information records, and a sum of the count of the first set of personal information records and a count of the second set of personal information records;
- calculating a second confidence level for the first scanned field and the second attribute field, said calculating based on one or more:
- the count of the first scanned values, a count of the second set of personal information findings, a count of the second set of personal information records, and the sum of the count of the first set of personal information records and the count of the second set of personal information records;
- and
- upon determining that the first confidence level is greater than or equal to a minimum confidence threshold and that the second confidence level is less than the minimum confidence threshold, associating the first attribute field, but not the second attribute field, with the first scanned field in a database.
Dependencies are inferred from the claim text.