Hybrid systems and methods for identifying cause-effect relationships in structured data

A system comprising:

• one or more processors;
• and
• a non-transitory computer-readable medium storing a plurality of instructions, which when executed, cause the one or more processors to:
• extract event data objects from a stream of input data received over a network connection, each event data object comprising a parameter from a data set and a numerical trend over a predetermined period of time;
• retrieve a plurality of selected expert rule templates from an expert rule database, the selected expert rule templates being selected based on having input parameters that match the parameters of one or more of the event data objects, each expert rule template stored within the expert rule database including a cause parameter from the data set, an effect parameter from the data set, change thresholds for both the cause and the effect parameters and time intervals for both the cause and effect parameters;
• identify cause-effect relationships between parameters of the data set in response to the selected expert rule templates being satisfied by the extracted event data objects;
• transmit, via the network connection, narrative text and one or more visualizations associated with a satisfied selected expert rule template to a display device;
• cause an insight graphic interface to be displayed by the display device, the insight graphic interface including the narrative text and the one or more visualizations;
• identify a correlated pair of different parameters of the data set observed over a plurality of predetermined correlation time periods, the correlated pair being identified based on pairwise comparison of all parameters of the data set and a coincidence probability of the different parameters;
• create a new expert rule template in the expert rule database based on the correlated pair of different parameters between the different parameters;
• and
• generate an alert in response to one of the expert rule templates in the expert rule database or the new expert rule template being contradicted by subsequent data in the stream of input data.

A non-transitory computer readable storage medium having embodied thereon a program, the program being executable by a processor for performing a method comprising:

• extracting event data objects from a stream of input data received over a network connection, each event data object comprising a parameter from a data set and a numerical trend over a predetermined period of time;
• retrieving, via a rule engine module, a plurality of selected expert rule templates from an expert rule database, the selected expert rule templates being selected based on having input parameters that match the parameters of one or more of the event data objects, each expert rule template stored within the expert rule database including a cause parameter from the data set, an effect parameter from the data set, change thresholds for both the cause and the effect parameters and time intervals for both the cause and effect parameters;
• identifying cause-effect relationships between parameters of the data set in response to the selected expert rule templates being satisfied by the extracted event data objects;
• transmitting, via the network connection, narrative text and one or more visualizations associated with a satisfied selected expert rule template to a display device;
• causing an insight graphic interface to be displayed by the display device, the insight graphic interface including the narrative text and the one or more visualizations;
• identifying, via a statistical correlation module, a correlated pair of different parameters of the data set observed over a plurality of predetermined correlation time periods, the correlated pair being identified based on pairwise comparison of all parameters of the data set and a persistence probability of the different parameters;
• creating a new expert rule template in the expert rule database based on the correlated pair of different parameters between the different parameters;
• and
• generating an alert in response to one of the expert rule templates in the expert rule database or the new expert rule template being contradicted by subsequent data in the stream of input data.