# US 2024/0202357 A1 · Differentially Private Synthetic Data

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0202357 A1
- Document ID: US20240202357A1
- Status: Published application
- Kind: A1
- Application number: 18/066,939
- Filed: 2022-12-15
- Published: 2024-06-20
- Earliest claimed: 2022-12-15
- Assignees: Oracle International Corporation
- Applicants: Oracle International Corporation
- Inventors: Daniel Wyde Peterson
- Web page: https://patentgrep.com/patent/US20240202357A1

## CPC

- G06F 21/6245: {Protecting personal data, e.g. for financial or medical purposes}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Methods, techniques and systems are described for limiting privacy loss in machine learning systems. A machine learning system may produce a generative model through machine learning training using a real data set that includes information identifying one or more sources and differential privacy guarantees for data in the real data set are not ensured. The generative model may therefore model data including identifiable data for particular individuals or sources contributing to the real data set. An estimate of training sensitivity for the training of the generative model with respect to the real data set may then be made, then the machine learning system may generate a synthetic data set according to sampling of the trained generative model, where the sampling is determined by the estimate of training sensitivity and a desired level of privacy guarantee to ensure differential privacy of the data in the real data set.

## Claims

### Claim 1

A computer-implemented method, comprising:
training a generative model using a real data set, the real data set comprising a plurality of real data records and information identifying one or more sources of the plurality of real data records;
generating a synthetic data set according to the trained generative model, wherein the synthetic data set comprises a plurality of computer-generated data records different from the real data records; and
sampling the generated synthetic data set to ensure differential privacy of the data in the real data set, wherein the sampled synthetic data set excludes the information identifying one or more sources of the real data records.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
training a differentially-private machine learning model according to the sampled synthetic data.

### Claim 3 (depends on 1)

The computer-implemented method of claim 1, wherein the synthetic data set comprises information identifying the one or more sources of the plurality of real data records.

### Claim 4 (depends on 1)

The computer-implemented method of claim 1, wherein the plurality of real data records are usable to train the generative model to make inferences, and wherein the plurality of computer-generated data records are usable to train another model to make the inferences.

### Claim 5 (depends on 1)

The computer-implemented method of claim 1, further comprising:
estimating a training sensitivity for the generative model according to the real data set;
wherein sampling the generated synthetic data set to ensure differential privacy of the data in the real data set is performed according to the estimated training sensitivity.

### Claim 6 (depends on 5)

The computer-implemented method of claim 5, wherein the estimating is based at least in part on a Hessian of a loss function of the real data set.

### Claim 7 (depends on 5)

The computer-implemented method of claim 5, wherein a number of samples of the sampled generated synthetic data set is determined according to specified amount of differential privacy and the estimated training sensitivity.

### Claim 8

One or more non-transitory computer-accessible storage media storing program instructions that when executed on or across one or more computing devices cause the one or more computing devices to implement:
generating a differentially private data set, comprising:
training a machine learning model to produce a generative model according to a real data set, the real data set comprising a plurality of real data records and information identifying one or more sources of the real data;
generating synthetic data according to the trained generative model, wherein the synthetic data comprises a plurality of synthetic data records different from the real data records; and
sampling the generated synthetic data to ensure differential privacy of the data in the real data set, wherein the sampled synthetic data excludes the information identifying one or more sources of the real data.

### Claim 9 (depends on 8)

The one or more non-transitory computer-accessible storage media of claim 8, further comprising:
training a differentially-private machine learning model according to the sampled synthetic data.

### Claim 10 (depends on 8)

The one or more non-transitory computer-accessible storage media of claim 8, wherein the synthetic data set comprises information identifying the one or more sources of the plurality of real data records.

### Claim 11 (depends on 8)

The one or more non-transitory computer-accessible storage media of claim 8, wherein the plurality of real data records are usable to train the generative model to make inferences, and wherein the plurality of computer-generated data records are usable to train another model to make the inferences.

### Claim 12 (depends on 8)

The one or more non-transitory computer-accessible storage media of claim 8, further comprising:
estimating a training sensitivity for the generative model according to the real data set;
wherein sampling the generated synthetic data set to ensure differential privacy of the data in the real data set is performed according to the estimated training sensitivity.

### Claim 13 (depends on 12)

The one or more non-transitory computer-accessible storage media of claim 12, wherein the estimating is based at least in part on a Hessian of a loss function of the real data set.

### Claim 14 (depends on 12)

The one or more non-transitory computer-accessible storage media of claim 12, wherein a number of samples of the sampled generated synthetic data set is determined according to specified amount of differential privacy and the estimated training sensitivity.

### Claim 15

A system, comprising:
one or more processors; and
a memory storing program instructions that when executed by the one or more processors cause the one or more processors to implement a differentially private data set generator, configured to:
train a machine learning model to produce a generative model according to a real data set, the real data set comprising a plurality of real data records and information identifying one or more sources of the real data;
generate synthetic data according to the trained generative model, wherein the synthetic data comprises a plurality of synthetic data records different from the real data records; and
sample the generated synthetic data to ensure differential privacy of the data in the real data set, wherein the sampled synthetic data excludes the information identifying one or more sources of the real data.

### Claim 16 (depends on 15)

The system of claim 15, wherein the differentially private data set generator is configured to:
train a differentially-private machine learning model according to the sampled synthetic data.

### Claim 17 (depends on 15)

The system of claim 15, wherein the synthetic data set comprises information identifying the one or more sources of the plurality of real data records.

### Claim 18 (depends on 15)

The system of claim 15, wherein the plurality of real data records are usable to train the generative model to make inferences, and wherein the plurality of computer-generated data records are usable to train another model to make the inferences.

### Claim 19 (depends on 15)

The system of claim 15, wherein the differentially private data set generator is configured to:
estimate a training sensitivity for the generative model according to the real data set;
wherein sampling the generated synthetic data set to ensure differential privacy of the data in the real data set is performed according to the estimated training sensitivity.

### Claim 20 (depends on 19)

The system of claim 19, wherein the estimating is based at least in part on a Hessian of a loss function of the real data set.
