# US 12,008,330 B2 · Apparatus and method for augmenting textual data

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,008,330 B2
- Document ID: US12008330B2
- Status: Granted
- Kind: B2
- Application number: 17/510,640
- Filed: 2021-10-26
- Published: 2022-04-28
- Granted: 2024-06-11
- Earliest claimed: 2020-10-26
- Assignees: Samsung Sds Co., Ltd.
- Applicants: Samsung Sds Co., Ltd.
- Inventors: Na Un Kang; Geon Yi; Min Young Lee; Min Soo Kim
- Web page: https://patentgrep.com/patent/US12008330B2

## CPC

- G06F 40/279: Recognition of textual entities
- G06F 40/40: Processing or translation of natural language (natural language analysis G06F40/20; semantic analysis G06F40/30)
- G06F 18/2193: {based on specific statistical tests}
- G06F 40/284: Lexical analysis, e.g. tokenisation or collocates
- G06N 20/00: Machine learning
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

An apparatus for augmenting textual data according to an embodiment includes a data augmenter configured to generate augmented data by augmenting input textual data according to a data augmentation scheme decided based on a type of natural language processing task of the input textual data and a data classifier configured to classify the augmented data into a positive sample or a negative sample by determining whether or not the augmented data maintains label information of the input textual data based on one or more data classification criteria.

## Claims

### Claim 1

An apparatus for augmenting textual data, the apparatus comprising:
a data augmenter configured to generate augmented data by augmenting input textual data according to a data augmentation scheme decided based on a type of natural language processing task of the input textual data; and
a data classifier configured to classify the augmented data into a positive sample or a negative sample by determining whether or not the augmented data maintains label information of the input textual data based on one or more data classification criteria,
wherein the data classifier comprises at least one of:
a first analyzer configured to decide whether or not the augmented data is the positive sample or the negative sample using a mapping table preset according to the data augmentation scheme and the type of natural language processing task of the input textual data;
a second analyzer configured to analyze whether or not the augmented data satisfies grammar to decide whether or not the augmented data is the positive sample or the negative sample; or
a third analyzer configured to compare a predicted value of user input label with a label of the augmented data to decide whether or not the augmented data is the positive sample or the negative sample.

### Claim 2 (depends on 1)

The apparatus of claim 1, further comprising:
a consistency determinator configured to decide whether or not to use the augmented data based on a result classified according the one or more data classification criteria.

### Claim 3 (depends on 2)

The apparatus of claim 2, wherein the consistency determinator is further configured to decide whether or not to use the augmented data based on a ratio or number of results decided as positive samples among the results of at least one of the first analyzer, the second analyzer, or the third analyzer.

### Claim 4 (depends on 2)

The apparatus of claim 2, wherein the consistency determinator is further configured to:
decide to use the augmented data when it is determined that the augmented data is the positive sample based on results classified according to the one or more data classification criteria; and
decide not to use the augmented data when it is determined that the augmented data is the negative sample based on the result classified according to the one or more data classification criteria.

### Claim 5 (depends on 4)

The apparatus of claim 4, wherein the consistency determinator is further configured to decide whether or not to use the augmented data further based on the type of natural language processing task of the input textual data when it is determined that the augmented data is the negative sample based on the result classified according to the one or more data classification criteria.

### Claim 6 (depends on 1)

The apparatus of claim 1, wherein the data augmenter is further configured to decide an augmentation scale based on at least one of the type of natural language processing task, the data augmentation scheme, whether or not it is a key sentence, or a type of the input textual data.

### Claim 7 (depends on 1)

The apparatus of claim 1, further comprising:
a preprocessor configured to preprocess the input textual data using at least one of tokenization, stopword removing, stemming, or lemmatization and transmit the preprocessed input textual data to the data augmenter.

### Claim 8 (depends on 1)

The apparatus of claim 1, further comprising:
an input data analyzer configured to decide at least one of whether or not the input textual data satisfies a predetermined requirement for data augmentation; a type of a dominant language of the input textual data; whether or not the input textual data corresponds to any one of a single sentence, a single document, and a corpus; or the type of natural language processing task corresponding to the input textual data.

### Claim 9 (depends on 8)

The apparatus of claim 8, wherein the input data analyzer is further configured to decide that the input textual data satisfies the predetermined requirement for data augmentation when the input textual data includes one or more sentences in which one or more sentence elements are combined.

### Claim 10 (depends on 8)

The apparatus of claim 8, wherein the input data analyzer is further configured to decide the type of the dominant language of the input textual data based on Unicode for each language.

### Claim 11 (depends on 8)

The apparatus of claim 8, wherein the input data analyzer is further configured to decide the type of natural language processing task based on the label of the input textual data.

### Claim 12

A method for augmenting textual data comprising:
generating augmented data by augmenting input textual data according to a data augmentation scheme decided based on a type of natural language processing task of the input textual data; and
classifying the augmented data into a positive sample or a negative sample by determining whether or not the augmented data maintains label information of the input textual data based on one or more data classification criteria,
wherein the classifying of the augmented data comprises classifying the augmented data using at least one of:
a first analysis method for deciding whether or not the augmented data is the positive sample or the negative sample using a mapping table preset according to the data augmentation scheme and the type of natural language processing task of the input textual data;
a second analysis method for analyzing whether or not the augmented data satisfies grammar to decide whether or not the augmented data is the positive sample or the negative sample; or
a third analysis method for comparing a predicted value of user input label with a label of the augmented data to decide whether or not the augmented data is the positive sample or the negative sample.

### Claim 13 (depends on 12)

The method of claim 12, further comprising:
deciding whether or not to use the augmented data based on a result classified according to the one or more data classification criteria.

### Claim 14 (depends on 13)

The method of claim 13, wherein the deciding whether or not to use the augmented data comprises deciding whether or not to use the augmented data based on a ratio or number of results decided as positive samples among the results of at least one of the first analysis method, the second analysis method, or the third analysis method.

### Claim 15 (depends on 13)

The method of claim 13, wherein the deciding whether or not to use the augmented data comprises:
deciding to use the augmented data when it is determined that the augmented data is the positive sample based on the result classified according to the one or more data classification criteria; and
deciding not to use the augmented data when it is determined that the augmented data is the negative sample based on the result classified according to the one or more data classification criteria.

### Claim 16 (depends on 15)

The method of claim 15, wherein the deciding whether or not to use the augmented data comprises deciding whether or not to use the augmented data further based on the type of natural language processing task of the input textual data when it is determined that the augmented data is the negative sample based on the result classified according to the one or more data classification criteria.

### Claim 17 (depends on 12)

The method of claim 12, wherein the generating of the augmented data comprises deciding an augmentation scale based on at least one of the type of natural language processing task, the data augmentation scheme, whether or not it is a key sentence, or a type of the input textual data.

### Claim 18 (depends on 12)

The method of claim 12, further comprising:
preprocessing the input textual data using at least one of tokenization, stopword removing, stemming, or lemmatization.

### Claim 19 (depends on 12)

The method of claim 12, further comprising:
deciding at least one of whether or not the input textual data satisfies a predetermined requirement for data augmentation; a type of a dominant language of the input textual data; whether or not the input textual data corresponds to any one of a single sentence, a single document, and a corpus; or the type of natural language processing task corresponding to the input textual data.

### Claim 20 (depends on 19)

The method of claim 19, wherein the deciding comprises deciding that the input textual data satisfies the predetermined requirement for data augmentation when the input textual data includes one or more sentences in which one or more sentence elements are combined.

### Claim 21 (depends on 19)

The method of claim 19, wherein the deciding comprises deciding the type of the dominant language of the input textual data based on Unicode for each language.

### Claim 22 (depends on 19)

The method of claim 19, wherein the deciding comprises deciding the type of natural language processing task based on the label of the input textual data.
