Direct data loading of middleware-generated records

A non-transitory computer-readable storage medium comprising a computer-readable program executed on a processor for reducing data loading overhead of middleware to facilitate direct data loading to a database management system (DBMS), wherein the computer-readable program when executed on the processor causes a computer to perform the steps of:

• while data loading:
• sending external-writes to a memory-based DBMS if corresponding internal-writes are for vertices;
• exporting all the external-writes to a disk-based DBMS as an export file;
• and
• sending an external-read for vertices to an in-memory DBMS if the middleware requests data;
• and
• at the end of data loading:
• generating files for raw data of the disk-based DBMS from the export file;
• and
• sending the generated raw files to the disk-based DBMS.

A system for reducing data loading overhead of middleware to facilitate direct data loading to a database management system (DBMS), the system comprising:

• a memory;
• and
• one or more processors in communication with the memory configured to:
• while data loading:
• send external-writes to a memory-based DBMS if corresponding internal-writes are for vertices;
• export all the external-writes to a disk-based DBMS as an export file;
• and
• send an external-read for vertices to an in-memory DBMS if the middleware requests data;
• and
• at the end of data loading:
• generate files for raw data of the disk-based DBMS from the export file;
• and
• send the generated raw files to the disk-based DBMS.

A computer-implemented method executed on a processor for reducing data loading overhead of middleware to facilitate direct data loading to a database management system (DBMS), the method comprising:

• receiving an internal-write in an export extension of the middleware;
• determining whether the internal-write is for vertices;
• sending the internal-write to an in-memory DBMS when the internal write is for vertices;
• and
• appending the internal-write to a recovery file.

A computer-implemented method executed on a processor for reducing data loading overhead of middleware to facilitate direct data loading to a database management system (DBMS), the method comprising:

• receiving an internal-read in an export extension of the middleware;
• sending the internal-read to an in-memory DBMS to receive a result;
• determining whether the result includes a record;
• and
• if the result is free of a record, sending the internal-read to a disk-based DBMS.