# US 2022/0036212 A1 · Dynamic augmentation based on data sample hardness

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0036212 A1
- Document ID: US20220036212A1
- Status: Published application
- Kind: A1
- Application number: 16/942,997
- Filed: 2020-07-30
- Published: 2022-02-03
- Earliest claimed: 2020-07-30
- Assignees: International Business Machines Corporation
- Applicants: International Business Machines Corporation
- Inventors: Lior Ness; Yoel Shoshan
- Web page: https://patentgrep.com/patent/US20220036212A1

## CPC

- G06N 5/04: Inference or reasoning models
- G06N 20/00: Machine learning
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

In an approach for dynamic augmentation based on data sample hardness for training a learning model, a processor defines one or more augmentations for a dataset for training the learning model. A processor applies the one or more augmentations to the dataset. A processor trains the learning model with the one or more augmentations. A processor measures hardness of one or more data samples in the dataset. A processor adjusts the one or more augmentations for the one or more data samples based on corresponding hardness of the one or more data samples. A processor applies the adjusted one or more augmentations to the dataset. A processor trains the learning model with the adjusted one or more augmentations applied to the dataset.

## Claims

### Claim 1

A computer-implemented method comprising:
defining, by one or more processors, one or more augmentations for a dataset for training a learning model;
applying, by one or more processors, the one or more augmentations to the dataset;
training, by one or more processors, the learning model with the one or more augmentations;
measuring, by one or more processors, hardness of one or more data samples in the dataset;
adjusting, by one or more processors, the one or more augmentations for the one or more data samples based on corresponding hardness of the one or more data samples;
applying, by one or more processors, the adjusted one or more augmentations to the dataset; and
training, by one or more processors, the learning model with the adjusted one or more augmentations applied to the dataset.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1, wherein the hardness is one minus an estimated probability of the one or more data samples with a ground truth label being one.

### Claim 3 (depends on 1)

The computer-implemented method of claim 1, wherein the hardness is an estimated probability of the one or more data samples with a ground truth label being zero.

### Claim 4 (depends on 1)

The computer-implemented method of claim 1, wherein measuring the hardness includes measuring the hardness of each data sample in the dataset.

### Claim 5 (depends on 4)

The computer-implemented method of claim 4, wherein adjusting the one or more augmentations includes adjusting the one or more augmentations for each data sample based on corresponding hardness of each data sample in the dataset.

### Claim 6 (depends on 1)

The computer-implemented method of claim 1, wherein adjusting the one or more augmentations includes defining an augmentation strength, the augmentation strength being a single scalar parameter that defines an amount of augmentations applied in the dataset.

### Claim 7 (depends on 6)

The computer-implemented method of claim 6, wherein adjusting the one or more augmentations includes adjusting sampling ranges of the one or more augmentations, based on the augmentation strength, by scaling upper and lower random sampling bounds of the sampling ranges.

### Claim 8

A computer program product comprising:
one or more computer readable storage media, and program instructions collectively stored on the one or more computer readable storage media, the program instructions comprising:
program instructions to define one or more augmentations for a dataset for training a learning model;
program instructions to apply the one or more augmentations to the dataset;
program instructions to train the learning model with the one or more augmentations;
program instructions to measure hardness of one or more data samples in the dataset;
program instructions to adjust the one or more augmentations for the one or more data samples based on corresponding hardness of the one or more data samples;
program instructions to apply the adjusted one or more augmentations to the dataset; and
program instructions to train the learning model with the adjusted one or more augmentations applied to the dataset.

### Claim 9 (depends on 8)

The computer program product of claim 8, wherein the hardness is one minus an estimated probability of the one or more data samples with a ground truth label being one.

### Claim 10 (depends on 8)

The computer program product of claim 8, wherein the hardness is an estimated probability of the one or more data samples with a ground truth label being zero.

### Claim 11 (depends on 8)

The computer program product of claim 8, wherein program instructions to measure the hardness include program instructions to measure the hardness of each data sample in the dataset.

### Claim 12 (depends on 11)

The computer program product of claim 11, wherein program instructions to adjust the one or more augmentations include program instructions to adjust the one or more augmentations for each data sample based on corresponding hardness of each data sample in the dataset.

### Claim 13 (depends on 8)

The computer program product of claim 8, wherein program instructions to adjust the one or more augmentations include program instructions to define an augmentation strength, the augmentation strength being a single scalar parameter that defines an amount of augmentations applied in the dataset.

### Claim 14 (depends on 13)

The computer program product of claim 13, wherein program instructions to adjust the one or more augmentations include program instructions to adjust sampling ranges of the one or more augmentations, based on the augmentation strength, by scaling upper and lower random sampling bounds of the sampling ranges.

### Claim 15

A computer system comprising:
one or more computer processors, one or more computer readable storage media, and program instructions stored on the one or more computer readable storage media for execution by at least one of the one or more computer processors, the program instructions comprising:
program instructions to define one or more augmentations for a dataset for training a learning model;
program instructions to apply the one or more augmentations to the dataset;
program instructions to train the learning model with the one or more augmentations;
program instructions to measure hardness of one or more data samples in the dataset;
program instructions to adjust the one or more augmentations for the one or more data samples based on corresponding hardness of the one or more data samples;
program instructions to apply the adjusted one or more augmentations to the dataset; and
program instructions to train the learning model with the adjusted one or more augmentations applied to the dataset.

### Claim 16 (depends on 15)

The computer system of claim 15, wherein the hardness is one minus an estimated probability of the one or more data samples with a ground truth label being one.

### Claim 17 (depends on 15)

The computer system of claim 15, wherein the hardness is an estimated probability of the one or more data samples with a ground truth label being zero.

### Claim 18 (depends on 15)

The computer system of claim 15, wherein program instructions to measure the hardness include program instructions to measure the hardness of each data sample in the dataset.

### Claim 19 (depends on 18)

The computer system of claim 18, wherein program instructions to adjust the one or more augmentations include program instructions to adjust the one or more augmentations for each data sample based on corresponding hardness of each data sample in the dataset.

### Claim 20 (depends on 15)

The computer system of claim 15, wherein program instructions to adjust the one or more augmentations include:
program instructions to define an augmentation strength, the augmentation strength being a single scalar parameter that defines an amount of augmentations applied in the dataset, and
program instructions to adjust sampling ranges of the one or more augmentations, based on the augmentation strength, by scaling upper and lower random sampling bounds of the sampling ranges.
