System and method for implementing data manipulation language (dml) on hadoop
AssigneeJPMorgan Chase Bank, N.A.
InventorsJagmohan SINGH, Prasad V. PONDICHERRY, Bharaneedaran SARAVANAN
Life of this patent
Estimating the term…
Abstract
An embodiment of the present invention is directed to creating a re-usable code component that may be used with the data manipulation and transformation tool to natively support DML functionality. In addition to Insert, Update, and Delete, an addition function directed to “DeDup” may be implemented as it is used frequently in data transformation processes. An embodiment of the present invention is directed to capability to roll-back to a prior version of the original dataset. Any number of versions as required may be maintained.
Claims20
A system that implements data manipulation language on Hadoop execution procedures, the system comprising:
- an user interface that receives user input;
- a memory component that stores data manipulation data;
- and
- a computer server coupled to the user interface and the memory, the computer server comprising a programmed computer processor configured to perform the steps of:
- receiving, via the user interface, an input parameter file that identifies an action to be performed on a target data structure;
- identifying a corresponding file from a Hadoop Distributed File System based on a file name mapping to obfuscated file names and responsive to the target data structure;
- providing a rollback option after execution, in case of failures;
- and
- enabling, via the user interface, the user to perform one or more data manipulation language (DML) operations in a single iteration on the corresponding file.
A method that implements data manipulation language on Hadoop execution procedures, the method comprising the steps of:
- receiving, via an user interface, an input parameter file that identifies an action to be performed on a target data structure;
- identifying a corresponding file from a Hadoop Distributed File System based on a file name mapping to obfuscated file names and responsive to the target data structure;
- providing a rollback option after execution, in case of failures;
- and
- enabling, via the user interface, the user to perform one or more data manipulation language (DML) operations in a single iteration on the corresponding file.
Dependencies are inferred from the claim text.