Systems and methods for a self-services data file configuration with various data sources

A computer-based system, comprising:

• a processor;
• a tangible, non-transitory memory configured to communicate with the processor, the tangible, non-transitory memory having instructions stored thereon that, in response to execution by the processor, cause the computer-based system to perform operations comprising:
• receiving, by the processor, a preselected schema that identifies a plurality of columns from a plurality of data sources for inclusion in an output data file;
• reading, by the processor, data from the data sources to generate a data file containing a big data table;
• monitoring, by the processor, the plurality of data sources to detect that the data sources have been ingested into a data storage system;
• reading, by the processor, the data file and filtering a column from the data file in response to the preselected schema excluding the column to generate the output data file;
• and
• transferring, by the processor, the output data file to a client device.

An article of manufacture including a non-transitory, tangible computer readable storage medium having instructions stored thereon that, in response to execution by a computer-based system, cause the computer-based system to perform operations comprising:

• receiving, by the computer-based system, a preselected schema that identifies a plurality of columns from a plurality of data sources for inclusion in an output data file;
• reading, by the computer-based system, data from the data sources to generate a data file containing a big data table;
• monitoring, by the computer-based system, the plurality of data sources to detect that the data sources have been ingested into a data storage system;
• reading, by the computer-based system, the data file and filtering a column from the data file in response to the preselected schema excluding the column to generate the output data file;
• and
• transferring, by the computer-based system, the output data file to a client device.