# US 2019/0102263 A1 · System and method for implementing data manipulation language (dml) on hadoop

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0102263 A1
- Document ID: US20190102263A1
- Status: Published application
- Kind: A1
- Application number: 16/148,052
- Filed: 2018-10-01
- Published: 2019-04-04
- Earliest claimed: 2017-09-29
- Assignees: JPMorgan Chase Bank, N.A.
- Applicants: JPMorgan Chase Bank, N.A.
- Inventors: Jagmohan SINGH; Prasad V. PONDICHERRY; Bharaneedaran SARAVANAN
- Web page: https://patentgrep.com/patent/US20190102263A1

## CPC

- G06F 11/1469: {Backup restoration techniques}
- G06F 11/1446: Point-in-time backing up or restoration of persistent data
- G06F 16/13: File access structures, e.g. distributed indices (arrangements of input from, or output to, record carriers G06F3/06)
- G06F 16/168: {Details of user interfaces specifically adapted to file systems, e.g. browsing and visualisation, 2d or 3d GUIs (query results presentation G06F16/156)}
- G06F 2201/84: Using snapshots, i.e. a logical point-in-time copy of the data
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

An embodiment of the present invention is directed to creating a re-usable code component that may be used with the data manipulation and transformation tool to natively support DML functionality. In addition to Insert, Update, and Delete, an addition function directed to “DeDup” may be implemented as it is used frequently in data transformation processes. An embodiment of the present invention is directed to capability to roll-back to a prior version of the original dataset. Any number of versions as required may be maintained.

## Claims

### Claim 1

A system that implements data manipulation language on Hadoop execution procedures, the system comprising:
an user interface that receives user input;
a memory component that stores data manipulation data; and
a computer server coupled to the user interface and the memory, the computer server comprising a programmed computer processor configured to perform the steps of:
receiving, via the user interface, an input parameter file that identifies an action to be performed on a target data structure;
identifying a corresponding file from a Hadoop Distributed File System based on a file name mapping to obfuscated file names and responsive to the target data structure;
providing a rollback option after execution, in case of failures; and
enabling, via the user interface, the user to perform one or more data manipulation language (DML) operations in a single iteration on the corresponding file.

### Claim 2 (depends on 1)

The system of claim 1, wherein the data manipulation language enables one or more actions to be performed, wherein the one or more actions comprise Insert, Update, Delete, and De-Dup.

### Claim 3 (depends on 1)

The system of claim 1, wherein the one or more data manipulation language operations are provided natively on Hadoop.

### Claim 4 (depends on 1)

The system of claim 1, wherein the rollback option creates a backup of an original dataset with versioning data.

### Claim 5 (depends on 4)

The system of claim 4, wherein the backup is stored at the HDFS.

### Claim 6 (depends on 1)

The system of claim 1, wherein the file name mapping is stored and maintained at a metadata repository.

### Claim 7 (depends on 1)

The system of claim 1, wherein the obfuscated file names are stored at the HDFS.

### Claim 8 (depends on 1)

The system of claim 1, wherein the input parameter file further comprises transformation logic to perform a DML operation.

### Claim 9 (depends on 1)

The system of claim 1, wherein the input parameter file comprises current business day snapshot data and previous business day snapshot data.

### Claim 10 (depends on 1)

The system of claim 1, wherein the input parameter file comprises reference data, filter data and one or more DML actions.

### Claim 11

A method that implements data manipulation language on Hadoop execution procedures, the method comprising the steps of:
receiving, via an user interface, an input parameter file that identifies an action to be performed on a target data structure;
identifying a corresponding file from a Hadoop Distributed File System based on a file name mapping to obfuscated file names and responsive to the target data structure;
providing a rollback option after execution, in case of failures; and
enabling, via the user interface, the user to perform one or more data manipulation language (DML) operations in a single iteration on the corresponding file.

### Claim 12 (depends on 11)

The method of claim 11, wherein the data manipulation language enables one or more actions to be performed, wherein the one or more actions comprise Insert, Update, Delete, and De-Dup.

### Claim 13 (depends on 11)

The method of claim 11, wherein the one or more data manipulation language operations are provided natively on Hadoop.

### Claim 14 (depends on 11)

The method of claim 11, wherein the rollback option creates a backup of an original dataset with versioning data.

### Claim 15 (depends on 14)

The method of claim 14, wherein the backup is stored at the HDFS.

### Claim 16 (depends on 11)

The method of claim 11, wherein the file name mapping is stored and maintained at a metadata repository.

### Claim 17 (depends on 11)

The method of claim 11, wherein the obfuscated file names are stored at the RDFS.

### Claim 18 (depends on 11)

The method of claim 11, wherein the input parameter file further comprises transformation logic to perform a DML operation.

### Claim 19 (depends on 11)

The method of claim 11, wherein the input parameter file comprises current business day snapshot data and previous business day snapshot data.

### Claim 20 (depends on 11)

The method of claim 11, wherein the input parameter file comprises reference data, filter data and one or more DML actions.
