System and method for adaptive information storage management

A computer-implemented method for adaptive information storage management, wherein the method is implemented by a system receiving a data stream from at least one client station, the system is coupled to a storage system, the method comprising:

• identifying one or more parameters from an incoming data stream based on a set of predetermined rules, wherein the identified parameters correspond to a set of predetermined parameters;
• applying a subset of rules, from the set of predetermined rules, on the incoming data stream, wherein the subset of rules represent a series of iterative rules associated with each identified parameter, the series of iterative rules comprises:
• applying a first rule to check if a frequently searched field exists in an event the identified parameter includes presence of search parameters, wherein if the frequently searched field is not found a record is generated indicating a type of the data stream;
• and
• applying a second rule to check if the data stream is part of data stored in a schema-based information storage system if the search fields are found
• and
• generating one or more data storage allocation files representing results of application of the set of predetermined rules and the subset of rules, wherein the results include at least a storage system type identified from the storage system as optimal for storing the incoming data stream.

A system for adaptive information storage management, wherein the system is coupled to a storage system and receives a data stream from at least one client station, the system comprising:

• a memory storing program instructions;
• a processor for executing program instructions stored in a memory;
• a data processing engine, in communication with the processor and configured to:
• identify one or more parameters from an incoming data stream based on a set of predetermined rules, wherein the identified parameters correspond to a set of predetermined parameters;
• apply a subset of rules, from the set of predetermined rules, on the incoming data stream, wherein the subset of rules represent a series of iterative rules associated with each identified parameter, the series of iterative rules comprises:
• applying a first rule to identify if the incoming data stream is the same as any of a previous data stream in an event the identified parameter is not found;
• applying a second rule to check if field names and field counts associated with the incoming data stream is the same as that of the previous data stream if the data stream is found to be the same as any of the previous data stream;
• and
• applying a third rule to check if a data type of any of the fields of the incoming data stream is the same as that of the previous data stream if it is found that the field names and field counts of the incoming data stream are the same as the field names and field counts of the previous data stream;
• and
• generate one or more data storage allocation files representing results of application of the set of predetermined rules and the subset of rules, wherein the results include at least a storage system type that is identified from the storage system as optimal for storing the incoming data stream.

A computer program product comprising:

• a non-transitory computer-readable medium having computer-readable program code stored thereon, the computer-readable program code comprising instructions that, when executed by a processor, causes the processor to:
• identify one or more parameters from an incoming data stream based on a set of predetermined rules, wherein the identified parameters correspond to a set of predetermined parameters;
• apply a subset of rules, from the set of predetermined rules, on the incoming data stream, wherein the subset of rules represent a series of iterative rules associated with each identified parameter, the series of iterative rules comprises:
• applying a first rule to identify if the incoming data stream is the same as any of a previous data stream in an event the identified parameter is not found;
• applying a second rule to check if field names and field counts associated with the incoming data stream is the same as that of the previous data stream if the data stream is found to be the same as any of the previous data stream;
• and
• applying a third rule to check if a data type of any of the fields of the incoming data stream is the same as that of the previous data stream if it is found that the field names and field counts of the incoming data stream are the same as the field names and field counts of the previous data stream;
• and
• generate one or more data storage allocation files representing results of application of the set of predetermined rules and the subset of rules, wherein the results include at least a storage system type that is identified from the storage system as optimal for storing the incoming data stream.