Declarative external data source importation, exportation, and metadata reflection utilizing HTTP and HDFS protocols

A data enrichment system comprising:

• a plurality of data sources;
• a data repository system;
• and
• a cloud computing infrastructure system comprising:
• one or more processors communicatively coupled to the plurality of data sources over at least one communication network;
• and
• a memory coupled to the one or more processors, the memory storing instructions to provide a data enrichment service, wherein the instructions, when executed by the one or more processors, cause the one or more processors to:
• receive a request to access a data source of the plurality of data sources, wherein the request includes identification information of the data source and a source type of the data source;
• determine, using the identification information, that the data enrichment system does not have connection parameters for establishing a connection to the data source;
• in response to determining that the data enrichment system does not have the connection parameters for establishing the connection to the data source, render a user interface to receive connection information for the data source, the connection information based on the source type;
• receive, via the user interface, a set of connection parameters, the set of connection parameters including a connection name, a connection type, a data source location, and credential information;
• store the set of connection parameters in the data repository system accessible to the data enrichment system;
• establish, using the set of connection parameters, the connection between the data enrichment system and the data source;
• and
• generate a profile for a data set accessed from the data source via the connection.

A non-transitory computer readable storage medium including instructions stored thereon which, when executed by one or more processors, cause the one or more processors to:

• receive, by a computing system of a data enrichment system, a request to access a data source from the data enrichment system, wherein the request includes identification information of the data source and a source type of the data source;
• determine, by the computing system, using the identification information, that the data enrichment system does not have connection parameters for establishing a connection to the data source;
• in response to determining that the data enrichment system does not have the connection parameters for establishing the connection to the data source, render a user interface to receive connection information for the data source, the connection information based on the source type;
• receive, by the computing system, via the user interface, a set of connection parameters, the set of connection parameters including a connection name, a connection type, a data source location, and credential information;
• store the set of connection parameters in a data repository system accessible to the data enrichment system;
• establish, by the computing system, using the set of connection parameters received via the user interface, a connection between the data enrichment system and the data source;
• and
• generate, by the computing system, a profile for a data set accessed from the data source via the connection.