# US 2024/0202518 A1 · Privacy-preserving generation of synthesized training data

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0202518 A1
- Document ID: US20240202518A1
- Status: Published application
- Kind: A1
- Application number: 18/321,460
- Filed: 2023-05-22
- Published: 2024-06-20
- Earliest claimed: 2022-12-19
- Assignees: Microsoft Technology Licensing, LLC
- Applicants: Microsoft Technology Licensing, LLC
- Inventors: Jason Michael EISNER; Eui Chul SHIN; Fatemehsadat MIRESHGHALLAH; Tatsunori Benjamin HASHIMOTO; Yu SU
- Web page: https://patentgrep.com/patent/US20240202518A1

## CPC

- G06N 3/08: Learning methods
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

Examples are disclosed that related to synthesizing a dataset of utterances in an automated manner using a computer while preserving user privacy. The synthesized dataset of utterances is usable to train a machine learning model. In one example, a differentially private parse tree generation model is trained based at least on private parse trees of a private utterance-parse tree dataset. A differentially private parse-to-utterance model is trained based at least on private utterances and corresponding private parse trees of the private utterance-parse tree dataset. A synthesized parse tree dataset is generated. The synthesized parse tree dataset includes synthesized parse trees sampled at random from the trained differentially private parse tree generation model. A synthesized utterance dataset is generated, via the trained differentially private parse-to-utterance model. The synthesized utterance dataset includes synthesized utterances that are generated based at least on the synthesized parse trees of the synthesized parse tree dataset.

## Claims

### Claim 1

A computing system comprising:
one or more processors configured to execute instructions stored in memory to:
train a differentially private parse tree generation model based at least on private parse trees of a private utterance-parse tree dataset;
train a differentially private parse-to-utterance model based at least on private utterances and corresponding private parse trees of the private utterance-parse tree dataset;
generate a synthesized parse tree dataset including synthesized parse trees sampled at random from the trained differentially private parse tree generation model; and
generate, via the trained differentially private parse-to-utterance model, a synthesized utterance dataset including synthesized utterances based at least on the synthesized parse trees of the synthesized parse tree dataset.

### Claim 2 (depends on 1)

The computing system of claim 1, wherein the private parse trees of the private utterance-parse tree dataset are generated by a semantic parser model based at least on the private utterances of the private utterance-parse tree dataset, wherein the semantic parser model is trained based at least on public training data.

### Claim 3 (depends on 1)

The computing system of claim 1, wherein the differentially private parse tree generation model and the differentially private parse-to-utterance model are algorithm.

### Claim 4 (depends on 3)

The computing system of claim 3, wherein training the differentially private parse tree generation model includes fine-tuning a pre-trained language model based at least on the parse trees of the private utterance-parse tree dataset using the DP-SGD training algorithm, wherein the pre-trained language model is trained using public training data, wherein training the differentially private parse-to-utterance model includes fine-tuning a pre-trained parse-to-utterance model based at least on the private user utterances and the parse trees of the private utterance-parse tree dataset using the DP-SGD training algorithm, and wherein the pre-trained parse-to-utterance model is trained using public training data.

### Claim 5 (depends on 1)

The computing system of claim 1, wherein the one or more processors are configured to execute instructions stored in the memory to:
annotate the synthesized utterances of the synthesized utterance dataset with corresponding expert-generated parse trees to generate an annotated synthesized utterance dataset; and
re-train the differentially private parse-to-utterance model based at least on the annotated synthesized utterance dataset.

### Claim 6 (depends on 1)

The computing system of claim 1, wherein the differentially private parse tree generation model and the differentially private parse-to-utterance model are trained independent of one another and in parallel.

### Claim 7 (depends on 1)

The computing system of claim 1, wherein the differentially private parse tree generation model and the differentially private parse-to-utterance model are trained using a same noise multiplier parameter value and a same clipping threshold parameter value.

### Claim 8 (depends on 1)

The computing system of claim 1, wherein a task-oriented natural language dialogue model is trained based at least on the synthesized utterance dataset, wherein a task-oriented natural language dialogue application generates a dialogue including actual user utterances and responses to the actual user utterances generated via the trained task-oriented natural language dialogue model.

### Claim 9

A computer-implemented method for synthesizing a dataset of utterances while preserving user privacy, the computer-implemented method comprising:
training a differentially private parse tree generation model based at least on private parse trees of a private utterance-parse tree dataset;
training a differentially private parse-to-utterance model based at least on private utterances and corresponding private parse trees of the private utterance-parse tree dataset;
generating a synthesized parse tree dataset including synthesized parse trees sampled at random from the trained differentially private parse tree generation model; and
generating, via the trained differentially private parse-to-utterance model, a synthesized utterance dataset including synthesized utterances based at least on the synthesized parse trees of the synthesized parse tree dataset.

### Claim 10 (depends on 9)

The computer-implemented method of claim 9, wherein the private parse trees of the private utterance-parse tree dataset are generated by a semantic parser model based at least on the private utterances of the private utterance-parse tree dataset, wherein the semantic parser model is trained based at least on public training data.

### Claim 11 (depends on 9)

The computer-implemented method of claim 9, wherein the differentially private parse tree generation model and the differentially private parse-to-utterance model are trained using a differentially private stochastic gradient descent (DP-SGD) training algorithm.

### Claim 12 (depends on 11)

The computer-implemented method of claim 11, wherein training the differentially private parse tree generation model includes fine-tuning a pre-trained language model based at least on the parse trees of the private utterance-parse tree dataset using the DP-SGD training algorithm, wherein the pretrained language model is trained using public training data, wherein training the differentially private parse-to-utterance model includes fine-tuning a pre-trained parse-to-utterance model based at least on the private user utterances and the parse trees of the private utterance-parse tree dataset using the DP-SGD training algorithm, and wherein the pre-trained parse-to-utterance model is trained using public training data.

### Claim 13 (depends on 11)

The computer-implemented method of claim 11, further comprising:
annotating the synthesized utterances of the synthesized utterance dataset with corresponding expert-generated parse trees to generate an annotated synthesized utterance dataset; and
re-training the differentially private parse-to-utterance model based at least on the annotated synthesized utterance dataset.

### Claim 14 (depends on 9)

The computer-implemented method of claim 9, wherein the differentially private parse tree generation model and the differentially private parse-to-utterance model are trained independent of one another and in parallel.

### Claim 15 (depends on 9)

The computer-implemented method of claim 9, wherein the differentially private parse tree generation model and the differentially private parse-to-utterance model are trained using a same noise multiplier parameter value and a same clipping threshold parameter value.

### Claim 16 (depends on 9)

The computer-implemented method of claim 9, wherein a task-oriented natural language dialogue model is trained based at least on the synthesized utterance dataset, wherein a task-oriented natural language dialogue application generates a dialogue including actual user utterances and responses to the actual user utterances generated via the trained task-oriented natural language dialogue model.

### Claim 17

A computing system comprising:
one or more processors configured to execute instructions stored in memory to:
train a differentially private parse tree generation model based at least on private parse trees of a private utterance-parse tree dataset;
train a differentially private parse-to-utterance model based at least on private utterances and corresponding private parse trees of the private utterance-parse tree dataset;
generate a synthesized parse tree dataset including synthesized parse trees sampled at random from the trained differentially private parse tree generation model;
generate, via the trained differentially private parse-to-utterance model, a synthesized utterance dataset including synthesized utterances based at least on the synthesized parse trees of the synthesized parse tree dataset;
annotate the synthesized utterances of the synthesized utterance dataset with corresponding expert-generated parse trees; and
re-train the differentially private parse-to-utterance model based at least on the annotated synthesized utterance dataset.

### Claim 18 (depends on 17)

The computing system of claim 17, wherein the private parse trees of the private utterance-parse tree dataset are generated by a semantic parser model based at least on the private utterances of the private utterance-parse tree dataset, wherein the semantic parser model is trained based at least on public training data.

### Claim 19 (depends on 17)

The computing system of claim 17, wherein the differentially private parse tree generation model and the differentially private parse-to-utterance model are algorithm.

### Claim 20 (depends on 19)

The computing system of claim 19, wherein training the differentially private parse tree generation model includes fine-tuning a pre-trained language model based at least on the parse trees of the private utterance-parse tree dataset using the DP-SGD training algorithm, wherein the pre-trained language model is trained using public training data, wherein training the differentially private parse-to-utterance model includes fine-tuning a pre-trained parse-to-utterance model based at least on the private user utterances and the parse trees of the private utterance-parse tree dataset using the DP-SGD training algorithm, and wherein the pre-trained parse-to-utterance model is trained using public training data.
