User-defined loading of data onto a database

#Data is commonly loaded onto databases from a number of different types of sources. Examples of various types of sources include a local storage location, a file transfer protocol (FTP) site, and Hadoop™ (e.g., stored within the Hadoop™ File system, which is also known as HDFS) In addition, the data that is loaded onto the databases often comprise various types of formats. Examples of various formats include Javascript object notation (JSON) files, extensible markup language (XML) files, custom binary formats, tarballs, and 7-Zip files.

#Features of the present disclosure are illustrated by way of example and not limited in the following figure(s), in which like numerals indicate like elements, in which:

#FIG. 1 shows a block diagram of a network environment, according to an example of the present disclosure:

#FIG. 2 illustrates a block diagram of a database machine, according to an example of the present disclosure;

#For simplicity and illustrative purposes, the present disclosure is described by referring mainly to an example thereof. In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present disclosure. It will be readily apparent however, that the present disclosure may be practiced without limitation to these specific details. In other instances, some methods and structures have not been described in detail so as not to unnecessarily obscure the present disclosure. In the present disclosure, the term “includes” means includes but not limited thereto, the term “including” means including but not limited thereto. The term “based on” means based at least in part on. In addition, the terms “a” and “an” are intended to denote at least one of a particular element.

#As used throughout the present disclosure, the term “data” is generally intended to encompass electronic data, such as electronic mail (e-mail), word processing documents, spreadsheet documents, webpages, computer aided drawing documents, electronic file folders, database records, logs, sales information, patient information, etc.

#Disclosed herein is a method for managing loading of data from a source onto a database. Also disclosed herein are an apparatus for implementing the method and a non-transitory computer readable medium on which is stored machine readable instructions that implement the method. As discussed herein, the method for managing loading of data from a source onto a database comprises providing an interface through which a user is to define logic related to the loading of the data onto the database, in which the user-defined logic pertains to a user-defined location identification of the source and retrieval of data from the source, a user-defined filter to be applied on the data, and a parsing operation to be performed on the data to convert the data into an appropriate format for the database. The method also includes receiving the user-defined logic and implementing the user-defined logic to load the data onto the database.