Data ingestion to generate layered dataset interrelations to form a system of networked collaborative datasets

A system comprising:

• a memory including executable instructions;
• and
• a processor responsive to executing instructions, is configured to:
• receive data into a dataset ingestion controller configured to form a collaborative dataset, the data representing a set of data having an initial data format;
• characterize the set of data to classify a plurality of subsets of data including same or equivalent data;
• compress the plurality of subsets of data to form compressed representations of the plurality of subsets of data;
• filter probabilistically a particular subset of data in the plurality of subsets of data to determine the particular subset of data is in the set of data;
• adapt the initial data format of the set of data to form a dataset having a first data format;
• form a multiple layer data file to link other data in a second data format to the dataset in the first data format;
• analyze the particular subset of the data to determine a dataset attribute, wherein a machine learning algorithm is configured to automatically predict a data value as the dataset attribute;
• generate descriptor data based on the dataset attribute associated with the particular subset of the data;
• convert the dataset from the first data format using a format converter configured to form an atomized dataset in a first graph data arrangement, the atomized dataset comprising the collaborative dataset;
• associate a unit of the descriptor data with a unit of supra-descriptor data to form an association, the supra-descriptor data being enhanced to include one or more additional units of descriptor data derived from the set of data having the initial data format, the one or more additional units of descriptor data comprising one or more additional dataset attributes of the set of data having the initial data format;
• and
• form a second graph data arrangement including the supra-descriptor data and the association with the descriptor data.

A non-transitory computer readable medium having one or more computer program instructions configured to perform a method, the method comprising:

• receiving data into a dataset ingestion controller configured to form a collaborative dataset, the data representing a set of data having an initial data format;
• characterizing the set of data to classify a plurality of subsets of data including same or equivalent data;
• compressing the plurality of subsets of data to form compressed representations of the plurality of subsets of data;
• filtering probabilistically a particular subset of data in the plurality of subsets of data to determine the particular subset of data is in the set of data;
• adapting the initial data format of the set of data to form a dataset having a first data format;
• forming a multiple layer data file to link other data in a second data format to the dataset in the first data format;
• analyzing the particular subset of the data to determine a dataset attribute, wherein a machine learning algorithm is configured to automatically predict a data value as the dataset attribute;
• generating descriptor data based on the dataset attribute associated with the particular subset of the data;
• converting the dataset from the first data format using a format converter configured to form an atomized dataset in a first graph data arrangement, the atomized dataset comprising the collaborative dataset;
• associating a unit of the descriptor data with a unit of supra-descriptor data to form an association, the supra-descriptor data being enhanced to include one or more additional units of descriptor data derived from the set of data having the initial data format, the one or more additional units of descriptor data comprising one or more additional dataset attributes of the set of data having the initial data format;
• and
• forming a second graph data arrangement including the supra-descriptor data and the association with the descriptor data.