Back to results
US 2019/0155533 A1Published application
Data pipeline architecture for cloud processing of structured and uinstructured data
AssigneeAccenture Global Solutions Limited
InventorsJagaran Das, Teresa Sheausan Tung, Srinivas Yelisetty, Daniel Corin
Life of this patent
Estimating the term…
Abstract
Scalable architectures provide resiliency and redundancy and are suitable for cloud deployment. The architectures support extreme data throughput requirements. In one implementation, the architectures provide a serving layer and an extremely high speed processing lane. With these and other features, the architectures support complex analytics, visualization, rule engines, and centralized pipeline configuration.
Claims20
A system comprising:
- a data stream processing pipeline circuitry configured to implement a pipeline flow defined by an endpoint selection, the endpoint selection including:
- a selected input endpoint of a defined input group of input endpoints;
- and
- a selected output endpoint of a defined output group of output endpoints;
- the data stream processing pipeline circuitry including:
- an ingestion circuitry stage configured to select among ingestion options including:
- stream processor reception;
- and
- publish-subscribe protocol reception;
- a storage circuitry stage configured to select among storage options in a defined memory hierarchy;
- a processing circuitry stage configured to select among processing options including:
- batch processing;
- and
- in-memory processing at a speed faster than that of batch processing;
- and
- a visualization circuitry stage configured to select among visualization options by selecting a specific one of multiple visualization processors;
- and
- the data stream processing pipeline circuitry further configured to, at a configuration stage and responsive to a configuration file, select a specific option combination from among the ingestion, storage, processing, and visualization options based on the endpoint selection.
15 more elements
A method comprising:
- in a data stream processing pipeline circuitry implement a pipeline flow defined by an endpoint selection, the endpoint selection including:
- a selected input endpoint of a defined input group of input endpoints;
- and
- a selected output endpoint of a defined output group of output endpoints;
- selecting, responsive to a configuration file, a specific option combination based on the endpoint selection by:
- at an ingestion circuitry stage of the data stream processing pipeline circuitry, selecting among ingestion options including:
- stream processor reception;
- and
- publish-subscribe protocol reception;
- at a storage circuitry stage of the data stream processing pipeline circuitry, selecting among storage options in a defined memory hierarchy;
- at a processing circuitry stage of the data stream processing pipeline circuitry, selecting among processing options including:
- batch processing;
- and
- in-memory processing at a speed faster than that of batch processing;
- and
- at a visualization circuitry stage of the data stream processing pipeline circuitry, selecting among visualization options by selecting a specific one of multiple visualization processors.
13 more elements
A product comprising:
- machine-readable media other than a transitory signal;
- and
- instructions stored on the machine-readable media, the instructions configured to, when executed, cause a machine to:
- in a data stream processing pipeline circuitry implement a pipeline flow defined by an endpoint selection, the endpoint selection including:
- a selected input endpoint of a defined input group of input endpoints;
- and
- a selected output endpoint of a defined output group of output endpoints;
- select, responsive to a configuration file, a specific option combination based on the endpoint selection by:
- at an ingestion circuitry stage of the data stream processing pipeline circuitry, select among ingestion options including:
- stream processor reception;
- and
- publish-subscribe protocol reception;
- at a storage circuitry stage of the data stream processing pipeline circuitry, select among storage options in a defined memory hierarchy;
- at a processing circuitry stage of the data stream processing pipeline circuitry, select among processing options including:
- batch processing;
- and
- in-memory processing at a speed faster than that of batch processing;
- and
- at a visualization circuitry stage of the data stream processing pipeline circuitry, select among visualization options by selecting a specific one of multiple visualization processors.
16 more elements
Dependencies are inferred from the claim text.