Method and system for deployment of prediction models using sketches generated through distributed data distillation

A non-transitory computer readable medium comprising computer readable program code, which when executed by a computer processor enables the computer processor to perform a method for managing data nodes, the method comprising:

• identifying, by a data node manager associated with a plurality of data nodes, a model deployment event;
• in response to identifying the model deployment event:
• generating, by the data node manager, a new model using model generation information from a subset of the plurality of data nodes specified by a data node registry;
• deploying, by the data node manager, the new model to the plurality of data nodes;
• and
• updating the data node registry based on the new model to obtain an updated data node registry.

A system for managing data nodes, the system comprising:

• a data node manager associated with a plurality of data nodes, comprising a processor and memory, configured to:
• identify, by a data node manager associated with a plurality of data nodes, a model deployment event;
• in response to identifying the model deployment event:
• generate, by the data node manager, a new model using model generation information from a subset of the plurality of data nodes specified by a data node registry;
• deploy, by the data node manager, the new model to the plurality of data nodes;
• and
• update the data node registry based on the new model to obtain an updated data node registry.