# US 2019/0318272 A1 · Learning etl rules by example

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0318272 A1
- Document ID: US20190318272A1
- Status: Published application
- Kind: A1
- Application number: 15/953,873
- Filed: 2018-04-16
- Published: 2019-10-17
- Earliest claimed: 2018-04-16
- Assignees: Oracle International Corporation
- Applicants: Oracle International Corporation
- Inventors: Michael SASSIN
- Web page: https://patentgrep.com/patent/US20190318272A1

## CPC

- G06N 20/00: Machine learning
- G06F 16/211: {Schema design and management}
- G06F 16/254: {Extract, transform and load [ETL] procedures, e.g. ETL data flows in data warehouses}
- G06N 5/025: Extracting rules from data
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Embodiments provide systems and methods for learning extract, transform, and load mappings by example. A plurality of features can be extracted from a source schema and a target schema. Example ETL mappings can be provided to a machine learning algorithm that comprise definitions for extracting data from source tables and loading the extracted data into target tables. Using the machine learning algorithm and based on the source schema, target schema, and extracted features, one or more ETL rules can be predicted that define logic for extracting data from the source schema and loading the extracted data into the target schema. Additional ETL mappings can be generated based on the predicted ETL rules, the additional ETL mappings providing additional definitions for extracting data from the source schema and loading the extracted data into the target schema.

## Claims

### Claim 1

A method for learning extract, transform, and load (“ETL”) mappings by example, the method comprising:
extracting a plurality of features from a source schema and a target schema, the features comprising at least columns of a plurality of tables of the source schema and the target schema;
providing example ETL mappings to a machine learning algorithm, wherein the example ETL mappings comprise definitions for extracting data from one or more tables of the source schema and loading the extracted data into one or more tables of the target schema;
predicting, using the machine learning algorithm and based on the source schema, target schema, and extracted features, one or more ETL rules that define logic for extracting data from the source schema and loading the extracted data into the target schema; and
generating additional ETL mappings based on the predicted ETL rules, the source schema, the target schema, and the extracted features, the additional ETL mappings providing additional definitions for extracting data from one or more tables of the source schema and loading the extracted data into one or more tables of the target schema.

### Claim 2 (depends on 1)

The method of claim 1, wherein the example ETL mappings and additional ETL mappings comprise mapping expressions that define a relationship between one or more source columns of a source table and a target column of a target table.

### Claim 3 (depends on 1)

The method of claim 1, wherein the example ETL mappings include a mapping expression that implements at least one of a column name post-fix or a column name pre-fix.

### Claim 4 (depends on 1)

The method of claim 1, wherein the example ETL mappings include a mapping expression that implements one or more functions applied to a source column of the mapping expression.

### Claim 5 (depends on 4)

The method of claim 4, wherein
the example ETL mappings include a mapping expression that implements a first type of function applied to a column of the source schema for loading a first column of the target schema, and
the additional ETL mappings include a mapping expression that implements the first type of function applied to the column of the source schema for loading a second column of the target schema.

### Claim 6 (depends on 1)

The method of claim 1, wherein the predicted ETL rules define logic represented by the example ETL mappings.

### Claim 7 (depends on 6)

The method of claim 6, wherein,
the example ETL mappings represent relationships between the source schema and a first set of columns of the target schema, and
the predicted ETL rules define logic for relationships between the source schema and a second set of columns of the target schema, and the second set of columns is different from the first set of columns.

### Claim 8 (depends on 7)

The method of claim 7, wherein the additional ETL mappings include mapping expressions for the second set of columns of the target schema based on the predicted ETL rules.

### Claim 9 (depends on 1)

The method of claim 1, wherein the plurality features comprise foreign keys for tables of the source schema and the target schema.

### Claim 10 (depends on 1)

The method of claim 1, wherein the plurality features comprise metadata for columns of the source schema, the metadata indicating relationships between columns of the source schema.

### Claim 11

A non-transitory computer readable medium having instructions stored thereon that, when executed by a processor, cause the processor to learn extract, transform, and load (“ETL”) mappings by example, the learning comprising:
extracting a plurality of features from a source schema and a target schema, the features comprising at least columns of a plurality of tables of the source schema and the target schema;
providing example ETL mappings to a machine learning algorithm, wherein the example ETL mappings comprise definitions for extracting data from one or more tables of the source schema and loading the extracted data into one or more tables of the target schema;
predicting, using the machine learning algorithm and based on the source schema, target schema, and extracted features, one or more ETL rules that define logic for extracting data from the source schema and loading the extracted data into the target schema; and
generating additional ETL mappings based on the predicted ETL rules, the source schema, the target schema, and the extracted features, the additional ETL mappings providing additional definitions for extracting data from one or more tables of the source schema and loading the extracted data into one or more tables of the target schema.

### Claim 12 (depends on 11)

The computer readable medium of claim 11, wherein the example ETL mappings include a mapping expression that implements at least one of a column name post-fix or a column name pre-fix.

### Claim 13 (depends on 11)

The computer readable medium of claim 11, wherein the example ETL mappings include a mapping expression that implements one or more functions applied to a source column of the mapping expression.

### Claim 14 (depends on 13)

The computer readable medium of claim 13, wherein
the example ETL mappings include a mapping expression that implements a first type of function applied to a column of the source schema for loading a first column of the target schema, and
the additional ETL mappings include a mapping expression that implements the first type of function applied to the column of the source schema for loading a second column of the target schema.

### Claim 15 (depends on 11)

The computer readable medium of claim 11, wherein the predicted ETL rules define logic represented by the example ETL mappings.

### Claim 16 (depends on 16)

The computer readable medium of claim 16, wherein,
the example ETL mappings represent relationships between the source schema and a first set of columns of the target schema, and
the predicted ETL rules define logic for relationships between the source schema and a second set of columns of the target schema, and the second set of columns is different from the first set of columns.

### Claim 17 (depends on 16)

The computer readable medium of claim 16, wherein the additional ETL mappings include mapping expressions for the second set of columns of the target schema based on the predicted ETL rules.

### Claim 18

A system comprising:
a processing device in communication with a memory device, the processing device configured to learn extract, transform, and load (“ETL”) mappings by example, the learning comprising:
extracting a plurality of features from a source schema and a target schema, the features comprising at least columns of a plurality of tables of the source schema and the target schema;
providing example ETL mappings to a machine learning algorithm, wherein the example ETL mappings comprise definitions for extracting data from one or more tables of the source schema and loading the extracted data into one or more tables of the target schema;
predicting, using the machine learning algorithm and based on the source schema, target schema, and extracted features, one or more ETL rules that define logic for extracting data from the source schema and loading the extracted data into the target schema; and
generating additional ETL mappings based on the predicted ETL rules, the source schema, the target schema, and the extracted features, the additional ETL mappings providing additional definitions for extracting data from one or more tables of the source schema and loading the extracted data into one or more tables of the target schema.

### Claim 19 (depends on 11)

The system of claim 11, wherein the example ETL mappings include a mapping expression that implements one or more functions applied to a source column of the mapping expression.

### Claim 20 (depends on 13)

The system of claim 13, wherein
the example ETL mappings include a mapping expression that implements a first type of function applied to a column of the source schema for loading a first column of the target schema, and
the additional ETL mappings include a mapping expression that implements the first type of function applied to the column of the source schema for loading a second column of the target schema.
