Unified data processing across streaming and indexed data sets

A system comprising:

• one or more data stores including computer-executable instructions;
• and
• one or more processors configured to execute the computer-executable instructions, wherein execution of the instructions causes the system to:
• obtain a query for data indexed at a data processing system, the query specifying criteria for identifying search results from data items previously indexed by an indexing subsystem of the data processing system;
• convert the query into a data processing pipeline, the data processing pipeline specifying a series of nodes and interconnections between individual nodes within the series, wherein the individual nodes designate a transformation of data items within the data processing pipeline and wherein the interconnections designate a routing of messages through the data processing pipeline, and wherein the series of nodes and interconnections logically represent the query;
• and
• apply the data processing pipeline to a streaming data processing subsystem of the data processing system to cause the streaming data processing subsystem to process data items within a stream of new messages obtained at the data processing system according to the data processing pipeline;
• wherein the query is designated by a user as a recurring query, and wherein converting the query into the data processing pipeline implements the recurring query while requiring that the query be run only once against data items previously indexed by the indexing subsystem of the data processing system.

Non-transitory computer-readable media comprising instructions executable by a computing system to:

• obtain a query for data indexed at a data processing system, the query specifying criteria for identifying search results from data items previously indexed by an indexing subsystem of the data processing system;
• convert the query into a data processing pipeline, the data processing pipeline specifying a series of nodes and interconnections between individual nodes within the series, wherein the individual nodes designate a transformation of data items within the data processing pipeline and wherein the interconnections designate a routing of messages through the data processing pipeline, and wherein the series of nodes and interconnections logically represent the query;
• and
• apply the data processing pipeline to a streaming data processing subsystem of the data processing system to cause the streaming data processing subsystem to process data items within a stream of new messages obtained at the data processing system according to the data processing pipeline;
• wherein the query is designated by a user as a recurring query, and wherein converting the query into the data processing pipeline implements the recurring query while requiring that the query be run only once against data items previously indexed by the indexing subsystem of the data processing system.