# US 2023/0267371 A1 · Apparatus, method and computer program for generating de-identified training data for conversational service

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0267371 A1
- Document ID: US20230267371A1
- Status: Published application
- Kind: A1
- Application number: 18/111,049
- Filed: 2023-02-17
- Published: 2023-08-24
- Earliest claimed: 2022-02-18
- Assignees: TUNiB Inc.
- Applicants: TUNiB Inc.
- Inventors: Kyu Byong PARK
- Web page: https://patentgrep.com/patent/US20230267371A1

## CPC

- G06N 20/00: Machine learning
- G06F 21/6254: {by anonymising data, e.g. decorrelating personal data from the owner's identification}
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

An apparatus for generating de-identified training data for conversational service includes a sentence detection unit configured to detect at least one sentence including personal information in a conversation between a user device and a chatbot; a de-identification target sentence detection unit configured to input conversational data including the at least one sentence into a personal information identification model and detect a de-identification target sentence through the personal information identification model; a search unit configured to search a predefined de-identification target token from the conversational data when a de-identification target sentence is detected from the conversational data; and a training data generation unit configured to generate training data on the conversational data by de-identifying text corresponding to the searched de-identification target token.

## Claims

### Claim 1

An apparatus for generating de-identified training data for conversational service, comprising:
a sentence detection unit configured to detect at least one sentence including personal information in a conversation between a user device and a chatbot;
a de-identification target sentence detection unit configured to input conversational data including the at least one sentence into a personal information identification model and detect a de-identification target sentence through the personal information identification model;
a search unit configured to search a predefined de-identification target token from the conversational data when a de-identification target sentence is detected from the conversational data; and
a training data generation unit configured to generate training data on the conversational data by de-identifying text corresponding to the searched de-identification target token.

### Claim 2 (depends on 1)

The apparatus for generating de-identified training data for conversational service of claim 1,
wherein sentences in the conversation are stored sequentially in a buffer, and
the sentence detection unit is configured to understand intention of the sentences based on context of the sentences stored sequentially in the buffer and detect the at least one sentence.

### Claim 3 (depends on 1)

The apparatus for generating de-identified training data for conversational service of claim 1,
wherein the sentence detection unit is configured to calculate a first probability that the at least one sentence will include the personal information.

### Claim 4 (depends on 3)

The apparatus for generating de-identified training data for conversational service of claim 3,
wherein a second probability that each sentence will include the personal information is output from the personal information identification model, and
the de-identification target sentence detection unit is configured to detect the de-identification target sentence using the first probability and the second probability.

### Claim 5 (depends on 1)

The apparatus for generating de-identified training data for conversational service of claim 1,
wherein the training data generation unit is configured to generate the training data by de-identifying the text corresponding to the de-identification target token, such as deleting the text or replacing the text with a special character.

### Claim 6 (depends on 1)

The apparatus for generating de-identified training data for conversational service of claim 1,
wherein the training data generation unit is configured to generate the training data by de-identifying first text corresponding to the de-identification target token, such as replacing the first text with second text included in the same tag set as the first text.

### Claim 7 (depends on 1)

The apparatus for generating de-identified training data for conversational service of claim 1,
wherein the training data generation unit is configured to generate tag information based on attribute information of the text corresponding to the de-identification target token, and generate the training data by de-identifying the text, such as replacing the text with the tag information.

### Claim 8 (depends on 1)

The apparatus for generating de-identified training data for conversational service of claim 1,
wherein the training data generation unit is configured to generate different training data for each conversational service by de-identifying the text corresponding to the de-identification target token in a different format based on type of the conversational service.

### Claim 9 (depends on 1)

The apparatus for generating de-identified training data for conversational service of claim 1,
wherein the personal information identification model is trained based on a dataset including the conversational data and a labelling of the de-identification target sentence.

### Claim 10

A method for generating de-identified training data for conversational service, which is performed by a training data generation apparatus, comprising:
detecting at least one sentence including personal information in a conversation between a user device and a chatbot;
inputting conversational data including the at least one sentence into a personal information identification model and detecting a de-identification target sentence through the personal information identification model;
searching a predefined de-identification target token from the conversational data when a de-identification target sentence is detected from the conversational data; and
generating training data on the conversational data by de-identifying text corresponding to the searched de-identification target token.

### Claim 11 (depends on 10)

The method for generating de-identified training data for conversational service of claim 10,
wherein sentences in the conversation are stored sequentially in a buffer, and
the detecting at least one sentence includes:
understanding intention of the sentences based on context of the sentences stored sequentially in the buffer and detecting the at least one sentence.

### Claim 12 (depends on 10)

The method for generating de-identified training data for conversational service of claim 10,
wherein the detecting at least one sentence includes:
calculating a first probability that the at least one sentence will include the personal information.

### Claim 13 (depends on 12)

The method for generating de-identified training data for conversational service of claim 12,
wherein a second probability that each sentence will include the personal information is output from the personal information identification model, and
the detecting a de-identification target sentence includes:
detecting the de-identification target sentence using the first probability and the second probability.

### Claim 14 (depends on 10)

The method for generating de-identified training data for conversational service of claim 10,
wherein the generating training data includes:
generating the training data by de-identifying the text corresponding to the de-identification target token, such as deleting the text or replacing the text with a special character.

### Claim 15 (depends on 10)

The method for generating de-identified training data for conversational service of claim 10,
wherein the generating training data includes:
generating the training data by de-identifying first text corresponding to the de-identification target token, such as replacing the first text with second text included in the same tag set as the first text.

### Claim 16 (depends on 10)

The method for generating de-identified training data for conversational service of claim 10,
wherein the generating training data includes:
generating tag information based on attribute information of the text corresponding to the de-identification target token; and
generating the training data by de-identifying the text, such as replacing the text with the tag information

### Claim 17 (depends on 10)

The method for generating de-identified training data for conversational service of claim 10,
wherein the generating training data includes:
generating different training data for each conversational service by de-identifying the text corresponding to the de-identification target token in a different format based on type of the conversational service.

### Claim 18 (depends on 10)

The method for generating de-identified training data for conversational service of claim 10,
wherein the personal information identification model is trained based on a dataset including the conversational data and a labelling of the de-identification target sentence.

### Claim 19

A non-transitory computer-readable storage medium storing a computer program including a sequence of instructions to generate de-identified training data for conversational service,
wherein the computer program includes a sequence of instructions that, when executed by a computing device, cause the computing device to:
detect at least one sentence including personal information in a conversation between a user device and a chatbot;
input conversational data including the at least one sentence into a personal information identification model, and detect a de-identification target sentence through the personal information identification model;
search a predefined de-identification target token from the conversational data when a de-identification target sentence is detected from the conversational data; and
generate training data on the conversational data by de-identifying text corresponding to the searched de-identification target token.
