Machine Learning System and Methods for Determining Confidence Levels of Personal Information Findings
AssigneeBigID Inc.
InventorsYehoshua Enuka, Nimrod Vax, Eyal Sacharov, Itamar Apel
Life of this patent
Estimating the term…
Abstract
The disclosed privacy management platforms are adapted to scan any number of data sources in order to provide users with visibility into stored personal information, risk associated with storing such information and/or usage activity relating to such information. The platforms may correlate personal information findings to specific data subjects and may employ machine learning models to classify findings as corresponding to a particular personal information attribute to provide an indexed inventory across multiple data sources.
Claims20
A computer-implemented method of finding and classifying personal information in a data source, the method comprising:
- receiving, by a computer, an identity data source comprising:
- a first attribute field associated with first attribute values;
- and
- a second attribute field associated with second attribute values;
- receiving, by the computer, a scanned data source comprising a first scanned field associated with first scanned values;
- determining, by the computer, a plurality of personal information findings comprising:
- a first set of personal information findings determined by comparing the first attribute values to the first scanned values;
- and
- a second set of personal information findings determined by comparing the second attribute values to the first scanned values;
- creating, by the computer, a plurality of personal information records from some or all of the plurality of personal information findings, the plurality of personal information records comprising:
- a first set of personal information records created from some or all of the first set of personal information findings;
- and
- a second set of personal information records created from some or all of the second set of personal information findings;
- calculating, by the computer, a first confidence level for the first scanned field and the first attribute field, said calculating based on a plurality of:
- a count of the first scanned values, a count of the first set of personal information findings, a count of the first set of personal information records, and a sum of the count of the first set of personal information records and a count of the second set of personal information records;
- calculating, by the computer, a second confidence level for the first scanned field and the second attribute field, said calculating based on a plurality of:
- the count of the first scanned values, a count of the second set of personal information findings, a count of the second set of personal information records, and the sum of the count of the first set of personal information records and the count of the second set of personal information records;
- upon determining that the first confidence level is greater than or equal to a minimum confidence threshold and that the second confidence level is less than the minimum confidence threshold, associating, by the computer, the first attribute field, but not the second attribute field, with the first scanned field in a report;
- and
- providing the report to a user device.
A system comprising one or more computers and one or more storage devices storing instructions that when executed by the one or more computers cause the one or more computers to perform operations comprising:
- receiving an identity data source comprising:
- a first attribute field associated with first attribute values;
- and
- a second attribute field associated with second attribute values;
- receiving a scanned data source comprising a first scanned field associated with first scanned values;
- determining a plurality of personal information findings comprising:
- a first set of personal information findings determined by comparing the first attribute values to the first scanned values;
- and
- second set of personal information findings determined by comparing the second attribute values to the first scanned values;
- creating a plurality of personal information records from some or all of the plurality of personal information findings, the plurality of personal information records comprising:
- a first set of personal information records created from some or all of the first set of personal information findings;
- and
- a second set of personal information records created from some or all of the second set of personal information findings;
- calculating a first confidence level for the first scanned field and the first attribute field, said calculating based on a plurality of:
- a count of the first scanned values, a count of the first set of personal information findings, a count of the first set of personal information records, and a sum of the count of the first set of personal information records and a count of the second set of personal information records;
- calculating a second confidence level for the first scanned field and the second attribute field, said calculating based on a plurality of:
- the count of the first scanned values, a count of the second set of personal information findings, a count of the second set of personal information records, and the sum of the count of the first set of personal information records and the count of the second set of personal information records;
- upon determining that the first confidence level is greater than or equal to a minimum confidence threshold and that the second confidence level is less than the minimum confidence threshold, associating the first attribute field, but not the second attribute field, with the first scanned field in a report;
- and
- providing the report to a user device.
Dependencies are inferred from the claim text.