System for capture, analysis and storage of time series data from sensors with heterogeneous report interval profiles

A system for capture, analysis and storage of data time series from sensors with heterogeneous report interval profiles comprising:

• a data stream management engine stored in a memory of and operating on a processor of a computing device;
• a multidimensional time series data store stored in a memory of and operating on a processor of a computing device;
• a data query and output engine stored in a memory of and operating on a processor of one of more computing devices;
• wherein, the data stream management engine:
• (a) receives a plurality sensor data;
• (b) aggregates the sensor data over a predetermined amount of time, a predetermined quantity of data or a predetermined number of events for transmission into the multidimensional time series data store;
• (c) transmits a specific quantity of aggregated sensor data per each access connection predetermined to allow reliable transmission to and inclusion of the data into the multidimensional time series data store;
• (d) transparently transmits quantities of aggregated sensor data too large to be reliably transferred by one access connection using a further plurality access connections to allow capture of all aggregated sensor data by the multidimensional time series data store under conditions of heavy sensor data influx;
• and
• wherein the multidimensional time series data store:
• (e) stores aggregated sensor data in a simple key-value pair with very little or no data transformation from how the aggregated sensor data is received;
• (f) stores data for a predetermined number of samples then purges the oldest data;
• and
• wherein the data query and output engine:
• (g) is a point of interaction to set up analysis prior to sensor data collection by specifying such parameters as number of events or time units to be placed within each quantum of aggregated sensor data, the number of connection lanes between the data stream management engine and the multidimensional time series data store, number of lanes that can be combined at one time to transfer aggregated sensor data to the multidimensional data store, number of interrelated dimensions to be store per sensor;
• (h) has an SQL like query language to retrieve sensor data of interest from the multidimensional time series database in a useful format;
• (i) is the point of interaction for selection of transformations performed on the retrieved multidimensional time series data store as well as specifying the format of data output.