Guided creation interface for streaming data processing pipelines
AssigneeSplunk Inc.
InventorsJared Breeden, Asmita Puri
Life of this patent
Estimating the term…
Abstract
Systems and methods are disclosed for implementing a data processing workflow user interface for a streaming data processing system. The workflow is visually represented as a series of modules along with interconnections for the modules. Each module represents an operation on a streaming data object, such as a data transformation. The user interface enables selection of a workflow template based on a user-specified data source, and then allows the user to customize the workflow template by specifying additional operations to apply to data objects. The interface may show the user a preview of output data objects processed according to the customized workflow.
Claims20
A computer-implemented method comprising:
- obtaining, by a streaming data processing system, a plurality of streaming data pipeline templates, wherein each of the plurality of streaming data pipeline templates describes steps for processing objects from data sources in a respective data source category;
- obtaining, based at least in part on individual templates of the plurality of streaming data pipeline templates, a plurality of streaming data pipeline configuration user interfaces, wherein individual user interfaces of the plurality of streaming data pipeline configuration user interfaces correspond to individual templates of the plurality of streaming data pipeline templates, and wherein individual user interfaces of the plurality of streaming data pipeline configuration user interfaces enable user configuration of a streaming data pipeline in accordance with the steps for processing objects described in the corresponding streaming data pipeline template;
- and
- displaying a data source category selection user interface, wherein the data source category selection user interface enables user selection of a data source category from a plurality of data source categories;
- in response to selection of a first data source category via the data source category selection user interface, displaying a first streaming data pipeline configuration user interface of the plurality of streaming data pipeline configuration user interfaces corresponding to a first streaming data pipeline template of the plurality of streaming data pipeline templates, wherein the first streaming data pipeline template corresponds to the first data source category.
A system comprising:
- a data store storing computer-executable instructions;
- and
- a processor configured to execute the computer-executable instructions, wherein when executed the computer-executable instructions cause the system to:
- obtain, by a streaming data processing system, a plurality of streaming data pipeline templates, wherein each of the plurality of streaming data pipeline templates describes steps for processing objects from data sources in a respective data source category;
- obtain, based at least in part on individual templates of the plurality of streaming data pipeline templates, a plurality of streaming data pipeline configuration user interfaces, wherein individual user interfaces of the plurality of streaming data pipeline configuration user interfaces correspond to individual templates of the plurality of streaming data pipeline templates, and wherein individual user interfaces of the plurality of streaming data pipeline configuration user interfaces enable user configuration of a streaming data pipeline in accordance with the steps for processing objects described in the corresponding streaming data pipeline template;
- and
- display a data source category selection user interface, wherein the data source category selection user interface enables user selection of a data source category from a plurality of data source categories;
- in response to selection of a first data source category via the data source category selection user interface, display a first streaming data pipeline configuration user interface of the plurality of streaming data pipeline configuration user interfaces corresponding to a first streaming data pipeline template of the plurality of streaming data pipeline templates, wherein the first streaming data pipeline template corresponds to the first data source category.
One or more non-transitory computer-readable media comprising computer-executable instructions that, when executed by a computing system, cause the computing system to:
- obtain, by a streaming data processing system, a plurality of streaming data pipeline templates, wherein each of the plurality of streaming data pipeline templates describes steps for processing objects from data sources in a respective data source category;
- obtain, based at least in part on individual templates of the plurality of streaming data pipeline templates, a plurality of streaming data pipeline configuration user interfaces, wherein individual user interfaces of the plurality of streaming data pipeline configuration user interfaces correspond to individual templates of the plurality of streaming data pipeline templates, and wherein individual user interfaces of the plurality of streaming data pipeline configuration user interfaces enable user configuration of a streaming data pipeline in accordance with the steps for processing objects described in the corresponding streaming data pipeline template;
- and
- display a data source category selection user interface, wherein the data source category selection user interface enables user selection of a data source category from a plurality of data source categories;
- in response to selection of a first data source category via the data source category selection user interface, display a first streaming data pipeline configuration user interface of the plurality of streaming data pipeline configuration user interfaces corresponding to a first streaming data pipeline template of the plurality of streaming data pipeline templates, wherein the first streaming data pipeline template corresponds to the first data source category.
Dependencies are inferred from the claim text.