Projecting Effect of In-Flight Streamed Data on a Relational Database

A non-transitory computer-readable media having recorded thereon a computer program having a plurality of computer-executable instructions, wherein the computer program, when executed by at least one computer system, causes the at least one computer system to perform actions comprising:

• receiving, in a stream computing application, a request from a structured database to project data matching the parameters of a logical query which will be output to the structured database from the stream computing application, the stream computing application implementing an operator graph having a plurality of processing elements which operate on data tuples being transferred among processing elements of the plurality of processing elements, the stream computing application producing output data tuples for inclusion in said structured database;
• responsive to receiving said request to project data matching the parameters of the logical query which will be output to the structured database from the stream computing application, identifying in-flight data of interest contained in one or more data tuples of said stream computing application;
• responsive to receiving said request to project data matching the parameters of the logical query which will be output to the structured database from the stream computing application and identifying in-flight data of interest contained in one or more data tuples of said stream computing application, analyzing the in-flight data of interest using profiling data characterizing said stream computing application to project data which will be produced from the in-flight data of interest as output data tuples matching the parameters of the logical query, the output data tuples being produced by said stream computing application for inclusion in the structured database;
• and
• returning, from the stream computing application to the structured database, results from said analyzing the in-flight data of interest using profiling data characterizing said stream computing application, the results including the projected data which will be produced from the in-flight data of interest as output data tuples matching the parameters of the logical query.

A data processing apparatus supporting execution of a stream computing application, comprising:

• at least one physical processor;
• at least one physical memory;
• a stream computing application embodied as instructions executable on the at least one processor and storable in the at least one memory, the stream computing application implementing an operator graph having a plurality of processing elements which operate on data tuples being transferred among processing elements of the plurality of processing elements, the stream computing application producing output tuples for inclusion in a structured database;
• a database projection function embodied as instructions executable on the at least one processor and storable in the at least one memory, wherein the database projection function, responsive to a request from the structured database to project data matching the parameters of a logical query which will be output to the structured database from said stream computing application;
• identifies in-flight data of interest contained in one or more data tuples of said stream computing application;
• analyzes the in-flight data of interest using profiling data characterizing said stream computing application to project data which will be produced from the in-flight data of interest as output data tuples matching the parameters of the logical query, the output data tuples being produced by said stream computing application for inclusion in the structured database;
• and returns results from analyzing the in-flight data of interest using profiling data characterizing said stream computing application to the structured database, the results including the projected data which will be produced from the in-flight data of interest as output data tuples matching the parameters of the logical query.