Method and Apparatus for Determining and Validating Provenance Data in Data Stream Processing System

Apparatus for processing data associated with a data stream received by a data stream processing system, wherein the system comprises a plurality of processing elements, the apparatus comprising:

• a memory;
• and
• a processor coupled to the memory and configured to obtain input data elements and output data elements associated with at least one processing element of the plurality of processing elements, and compute one or more intervals for the processing element using data representing observations of associations between inputs elements and output elements of the processing element, wherein, for a given one of the intervals, one or more particular input elements contained within the given interval are determined to have contributed to a particular output element.

An article of manufacture for processing data associated with a data stream received by a data stream processing system, wherein the system comprises a plurality of processing elements, the article comprising a computer readable storage medium having one or more programs embodied therewith wherein the one or more programs, when executed by a computer, perform steps of:

• obtaining input data elements and output data elements associated with at least one processing element of the plurality of processing elements;
• and
• computing one or more intervals for the processing element using data representing observations of associations between inputs elements and output elements of the processing element, wherein, for a given one of the intervals, one or more particular input elements contained within the given interval are determined to have contributed to a particular output element.