Scheduler training for multi-module byte caching

A data deduplication data processing system configured for dynamic caching module selection for optimized data deduplication, the system comprising:

• a server communicatively coupled to a data store and plurality of client computers over a computer communications network;
• middleware disposed between the server and the client computers and executing in memory of a host computer, the middleware comprising a multiplicity of byte caching modules, each byte caching module having a different configuration;
• a scheduler comprising program code executing in memory of a host computer and enabled to classify a request to retrieve data from the data store of the server, to identify, in a table, from amongst the different byte caching modules a particular byte caching module associated with the classification of the request, and to route the data for deduplication in the identified byte caching module;
• and,
• a trainer comprising program code executing in the memory of the host computer and enabled to process historically relevant byte streams in each of the different byte caching modules to populate a table of associations between different classifications of the historically relevant byte streams and correspondingly optimal ones of the byte caching modules.

A computer program product for dynamic caching module selection for optimized data deduplication, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a device to cause the device to perform a method comprising:

• processing, by the device, historically relevant byte streams in each of a multiplicity of byte caching modules to populate a table of associations between different classifications of the historically relevant byte streams and correspondingly optimal ones of the multiplicity of the byte caching modules;
• receiving, by the device, a request to retrieve data from a data source;
• classifying, by the device, the request;
• consulting the table, by the device, to identify, from amongst the multiplicity of byte caching modules, a particular byte caching module associated with the classification of the request;
• and,
• deduplicating the data, by the device, in the identified byte caching module.