Distributed data set task selection

An apparatus comprising a processor and a storage to store instructions that, when executed by the processor, cause the processor to perform operations comprising:

• retrieve node data, from a node device, wherein the node data is descriptive of at least one characteristic of an execution environment of the node device;
• generate a current data set model, wherein the current data set model is descriptive of at least one characteristic of a current data set;
• compare the current data set model to at least one previously generated data set model of at least one previously analyzed data set to detect a match in the at least one characteristic that meets a similarity threshold, wherein the at least one previously generated data set model is descriptive of the at least one characteristic of the at least one previously analyzed data set;
• in response to detection of a match that meets the similarity threshold between the at least one characteristic described in the current data set model and the at least one characteristic described in the at least one previously generated data set model;
• retrieve an indication from a correlation database of at least one previously performed action previously performed on the at least one previously analyzed data set, wherein the at least one previously performed action comprises at least one of normalization, a transform or a task performed on the at least one previously analyzed data set;
• select a computer language based on the node data;
• generate node instructions, in the selected computer language and based on at least the current data set model, to cause the node device to perform the at least one previously performed action on at least a portion of the current data set;
• and
• transmit the node instructions to the node device;
• in response to detection of a lack of a match that meets the similarity threshold between the at least one characteristic described in the current data set model and the at least one characteristic described in the at least one previously generated data set model, present a request for input indicative of a current action to perform on the current data set, wherein the current action comprises at least one of normalization, a transform or a task to be performed on the current data set;
• and
• in response to the detection of a lack of a match that meets the similarity threshold between the at least one characteristic described in the current data set model and the at least one characteristic described in the at least one previously generated data set model:
• select a predetermined quantity of previously generated data set models in which the at least one characteristic described in each of the previously generated data set models is more similar to the at least one characteristic described in the current data set model than all other previously generated data set models among multiple previously generated data set models that are included in the correlation database;
• for each selected previously generated data set model, retrieve an indication of a corresponding previously performed action previously performed on a corresponding previously analyzed data set correlated to the selected previously generated data set model by the correlation database;
• and
• present the request for input along with a listing of the corresponding previously performed action previously performed on each of the corresponding previously analyzed data sets correlated by the correlation database to one of the selected previously generated data set models in an order based on a degree of similarity in the at least one characteristic of each of the selected previously generated data set models to the at least one characteristic of the current data set model.

An apparatus comprising a processor and a storage to store instructions that, when executed by the processor, cause the processor to perform operations comprising:

• retrieve node data, from a node device, wherein the node data is descriptive of at least one characteristic of an execution environment of the node device;
• generate a current data set model, wherein the current data set model is descriptive of at least one characteristic of a current data set;
• compare the current data set model to at least one previously generated data set model of at least one previously analyzed data set to detect a match in the at least one characteristic that meets a similarity threshold, wherein the at least one previously generated data set model is descriptive of the at least one characteristic of the at least one previously analyzed data set;
• in response to detection of a match that meets the similarity threshold between the at least one characteristic described in the current data set model and the at least one characteristic described in the at least one previously generated data set model:
• retrieve an indication from a correlation database of at least one previously performed action previously performed on the at least one previously analyzed data set, wherein the at least one previously performed action comprises at least one of normalization, a transform or a task performed on the at least one previously analyzed data set;
• select a computer language based on the node data;
• generate node instructions, in the selected computer language and based on at least the current data set model, to cause the node device to perform the at least one previously performed action on at least a portion of the current data set;
• and
• transmit the node instructions to the node device;
• in response to detection of a lack of a match that meets the similarity threshold between the at least one characteristic described in the current data set model and the at least one characteristic described in the at least one previously generated data set model, present a request for input indicative of a current action to perform on the current data set, wherein the current action comprises at least one of normalization, a transform or a task to be performed on the current data set;
• retrieve multiple instances of descriptive data from multiple node devices, wherein the multiple node devices comprises the node device, and each instance of descriptive data is descriptive of at least one characteristic of a portion of the current data set that is stored by a corresponding one of the multiple node devices;
• combine the multiple instances of descriptive data to generate an annotated metadata, wherein the annotated metadata comprises an indication of at least one of a label by which the current data set is organized, a delimiter used to separate two data items within the current data set, or a format of data item within the current data set;
• and
• generate the current data set model from the annotated metadata, wherein the at least one characteristic of the current data set comprises at least one of a quantity of rows into which the current data set is organized, a quantity of data items that employ a specified format, a degree of sparseness of the current data set, or a degree of cardinality of the current data set.

A computer-program product tangibly embodied in a non-transitory machine-readable storage medium, the computer-program product including instructions operable to cause a processor to perform operations comprising:

• retrieve node data, from a node device, wherein the node data is descriptive of at least one characteristic of an execution environment of the node device;
• generate a current data set model, wherein the current data set model is descriptive of at least one characteristic of a current data set;
• compare the current data set model to at least one previously generated data set model of at least one previously analyzed data set to detect a match in the at least one characteristic that meets a similarity threshold, wherein the at least one previously generated data set model is descriptive of the at least one characteristic of the at least one previously analyzed data set;
• in response to detection of a match that meets the similarity threshold between the at least one characteristic described in the current data set model and the at least one characteristic described in the at least one previously generated data set model:
• retrieve an indication from a correlation database of at least one previously performed action previously performed on the at least one previously analyzed data set, wherein the at least one previously performed action comprises at least one of normalization, a transform or a task performed on the at least one previously analyzed data set;
• select a computer language based on the node data;
• generate node instructions, in the selected computer language and based on at least the current data set model, to cause the node device to perform the at least one previously performed action on at least a portion of the current data set;
• and
• transmit the node instructions to the node device;
• in response to detection of a lack of a match that meets the similarity threshold between the at least one characteristic described in the current data set model and the at least one characteristic described in the at least one previously generated data set model present a request for input indicative of a current action to perform on the current data set, wherein the current action comprises at least one of normalization, a transform or a task to be performed on the current data set;
• monitor previously performed actions performed on each previously analyzed data set of the at least one previously analyzed data set;
• for each previously analyzed data set of the at least one previously analyzed data set, store previously generated data set model that corresponds to the previously analyzed data set correlated to an indication of a previously performed action performed on the previously analyzed data set in the correlation database;
• derive a correlation between the at least one characteristic and the at least one previously performed action from the correlation database;
• and
• determine the at least one previously performed action to cause the node device to perform on the current data set based on the correlation.

A computer-program product tangibly embodied in a non-transitory machine-readable storage medium, the computer-program product including instructions operable to cause a processor to perform operations comprising:

• retrieve node data, from a node device, wherein the node data is descriptive of at least one characteristic of an execution environment of the node device;
• generate a current data set model, wherein the current data set model is descriptive of at least one characteristic of a current data set;
• compare the current data set model to at least one previously generated data set model of at least one previously analyzed data set to detect a match in the at least one characteristic that meets a similarity threshold, wherein the at least one previously generated data set model is descriptive of the at least one characteristic of the at least one previously analyzed data set;
• in response to detection of a match that meets the similarity threshold between the at least one characteristic described in the current data set model and the at least one characteristic described in the at least one previously generated data set model:
• retrieve an indication from a correlation database of at least one previously performed action previously performed on the at least one previously analyzed data set, wherein the at least one previously performed action comprises at least one of normalization, a transform or a task performed on the at least one previously analyzed data set;
• select a computer language based on the node data;
• generate node instructions, in the selected computer language and based on at least the current data set model, to cause the node device to perform the at least one previously performed action on at least a portion of the current data set;
• and
• transmit the node instructions to the node device;
• in response to detection of a lack of a match that meets the similarity threshold between the at least one characteristic described in the current data set model and the at least one characteristic described in the at least one previously generated data set model present a request for input indicative of a current action to perform on the current data set, wherein the current action comprises at least one of normalization, a transform or a task to be performed on the current data set;
• and
• in response to the detection of a lack of a match that meets the similarity threshold between the at least one characteristic described in the current data set model and the at least one characteristic described in the at least one previously generated data set model, is caused to perform operations comprising:
• select a predetermined quantity of previously generated data set models in which the at least one characteristic described in each of the previously generated data set models is more similar to the at least one characteristic described in the current data set model than all other previously generated data set models among multiple previously generated data set models that are included in the correlation database;
• for each selected previously generated data set model, retrieve an indication of a corresponding previously performed action previously performed on a corresponding previously analyzed data set correlated to the selected previously generated data set model by the correlation database;
• and
• present the request for input along with a listing of the corresponding previously performed action previously performed on each of the corresponding previously analyzed data sets correlated by the correlation database to one of the selected previously generated data set models in an order based on a degree of similarity in the at least one characteristic of each of the selected previously generated data set models to the at least one characteristic of the current data set model.

A computer-program product tangibly embodied in a non-transitory machine-readable storage medium, the computer-program product including instructions operable to cause a processor to perform operations comprising:

• retrieve node data, from a node device, wherein the node data is descriptive of at least one characteristic of an execution environment of the node device;
• generate a current data set model, wherein the current data set model is descriptive of at least one characteristic of a current data set;
• compare the current data set model to at least one previously generated data set model of at least one previously analyzed data set to detect a match in the at least one characteristic that meets a similarity threshold, wherein the at least one previously generated data set model is descriptive of the at least one characteristic of the at least one previously analyzed data set;
• in response to detection of a match that meets the similarity threshold between the at least one characteristic described in the current data set model and the at least one characteristic described in the at least one previously generated data set model:
• retrieve an indication from a correlation database of at least one previously performed action previously performed on the at least one previously analyzed data set, wherein the at least one previously performed action comprises at least one of normalization, a transform or a task performed on the at least one previously analyzed data set;
• select a computer language based on the node data;
• generate node instructions, in the selected computer language and based on at least the current data set model, to cause the node device to perform the at least one previously performed action on at least a portion of the current data set;
• and
• transmit the node instructions to the node device;
• in response to detection of a lack of a match that meets the similarity threshold between the at least one characteristic described in the current data set model and the at least one characteristic described in the at least one previously generated data set model present a request for input indicative of a current action to perform on the current data set, wherein the current action comprises at least one of normalization, a transform or a task to be performed on the current data set;
• retrieve multiple instances of descriptive data from multiple node devices, wherein the multiple node devices comprises the node device, and each instance of descriptive data is descriptive of at least one characteristic of a portion of the current data set that is stored by a corresponding one of the multiple node devices;
• combine the multiple instances of descriptive data to generate an annotated metadata, wherein the annotated metadata comprises an indication of at least one of a label by which the current data set is organized, a delimiter used to separate two data items within the current data set, or a format of data item within the current data set;
• and
• generate the current data set model from the annotated metadata, wherein the at least one characteristic of the current data set comprises at least one of a quantity of rows into which the current data set is organized, a quantity of data items that employ a specified format, a degree of sparseness of the current data set, or a degree of cardinality of the current data set.

A computer-implemented method comprising:

• retrieving node data, from a node device, wherein the node data is descriptive of at least one characteristic of an execution environment of the node device;
• generating a current data set model, at a coordinating device, wherein the current data set model is descriptive of at least one characteristic of a current data set;
• comparing the current data set model to at least one previously generated data set model of at least one previously analyzed data set to detect a match in the at least one characteristic that meets a similarity threshold, wherein the at least one previously generated data set model is descriptive the of at least one characteristic of the at least one previously analyzed data set;
• in response to detection of a match that meets the similarity threshold between the at least one characteristic described in the current data set model and the at least one characteristic described in the at least one previously generated data set model:
• retrieving an indication from a correlation database of at least one previously performed action previously performed on the at least one previously analyzed data set, wherein the at least one previously performed action comprises at least one of normalization, a transform or a task performed on the at least one previously analyzed data set;
• selecting a computer language based on the node data;
• generating, at the coordinating device, node instructions, in the selected computer language and based on at least the current data set model, to cause the node device to perform the at least one previously performed action on at least a portion of the current data set;
• and
• transmitting the node instructions to the node device;
• monitoring previously performed actions performed on each previously analyzed data set of the at least one previously analyzed data set;
• for each previously analyzed data set of the at least one previously analyzed data set, storing previously generated data set model that corresponds to the previously analyzed data set correlated to an indication of a previously performed action performed on the previously analyzed data set in the correlation database;
• deriving a correlation between the at least one characteristic and the at least one previously performed action from the correlation database;
• and
• determining the at least one previously performed action to cause the node device to perform on the current data set based on the correlation.

A computer-implemented method comprising:

• retrieving node data, from a node device, wherein the node data is descriptive of at least one characteristic of an execution environment of the node device:
• generating a current data set model, at a coordinating device, wherein the current data set model is descriptive of at least one characteristic of a current data set;
• comparing the current data set model to at least one previously generated data set model of at least one previously analyzed data set to detect a match in the at least one characteristic that meets a similarity threshold, wherein the at least one previously generated data set model is descriptive the of at least one characteristic of the at least one previously analyzed data set;
• in response to detection of a match that meets the similarity threshold between the at least one characteristic described in the current data set model and the at least one characteristic described in the at least one previously generated data set model:
• retrieving an indication from a correlation database of at least one previously performed action previously performed on the at least one previously analyzed data set, wherein the at least one previously performed action comprises at least one of normalization, a transform or a task performed on the at least one previously analyzed data set;
• selecting a computer language based on the node data;
• generating, at the coordinating device, node instructions, in the selected computer language and based on at least the current data set model, to cause the node device to perform the at least one previously performed action on at least a portion of the current data set;
• and
• transmitting the node instructions to the node device;
• retrieving multiple instances of descriptive data from multiple node devices, wherein the multiple node devices comprises the node device, and each instance of descriptive data is descriptive of at least one characteristic of a portion of the current data set that is stored by a corresponding one of the multiple node devices;
• combining the multiple instances of descriptive data to generate an annotated metadata, wherein the annotated metadata comprises an indication of at least one of a label by which the current data set is organized, a delimiter used to separate two data items within the current data set, or a format of a data item within the current data set;
• and
• generating, at the coordinating device, the current data set model from the annotated metadata, wherein the at least one characteristic of the current data set comprises at least one of a quantity of rows into which the current data set is organized, a quantity of data items that employ a specified format, a degree of sparseness of the current data set, or a degree of cardinality of the current data set.