Data pipeline for process control system anaytics

A plant control and communication system for controlling a process within a plant, comprising:

• a multiplicity of process control devices disposed within the plant to control the process including a process controller that executes to control the process at an execution rate;
• a plurality of data processing devices disposed within the plant;
• one or more communication networks that communicatively couple the multiplicity of process control devices and the plurality of data processing devices;
• one or more data sources disposed within the plant distributed among the multiplicity of process control devices that collect raw data from the process control devices within the plant at a collection data rate greater than the execution rate of the controller;
• a database communicatively coupled to the one or more communication networks for storing the collected raw data from the one or more data sources at the collection data rate;
• and
• a data pipeline disposed in the one or more of the plurality of processing devices within the plant, the data pipeline including a series of data processing modules communicatively connected together in a particular communication order, wherein at least one of the data processing modules of the data pipeline performs a data processing operation on raw data from one of the one or more data sources, and at least another one of the data processing modules performs data processing on data received from one of the data processing modules within the data pipeline, and wherein at least two of the data processing modules operate at a rate faster than the execution rate of the process controller.

A process plant communication system for use within a process plant environment that implements a process, comprising:

• a process control network including a multiplicity of process control devices disposed within the plant to control the process and a process control communication network communicatively coupled between the multiplicity of process control devices, wherein one or more of the multiplicity of process control devices collects or generates process control data;
• a further plant communication network including a plurality of processing devices communicatively coupled together by a further plant communication network link, wherein at least one of the plurality of processing devices on the further plant communication network is communicatively connected to the process control communication network;
• a plurality of distributed data pipelines, each data pipeline including a series of different data processing modules communicatively connected together to perform processing on process control data in a particular sequence, wherein each data pipeline includes one or more data collection modules that collect process data from the process control network, one or more intermediate data processing modules that process the data collected by one or more of the data collection modules or another intermediate data processing module, and one or more ending data processing modules that produce data pipeline output data using data generated by the one or more intermediate data processing modules, and wherein at least two data processing modules of each data pipeline are located in different devices within the process control communication network and the further plant communication network;
• and
• a set of higher level analytic applications that are communicatively connected within the further plant communication network, wherein each of the set of higher level analytic applications subscribes to data generated by the ending data processing module of one or more of the distributed data pipelines.

A method of processing data in a plant having a process control network including a multiplicity of process control devices disposed within the plant to control a process and a process control communication network communicatively coupled between the multiplicity of process control devices, wherein one or more of the multiplicity of process control devices collects or generates process control data, and including a further plant network including a plurality of processing devices communicatively coupled together by a further plant communication network link, the method comprising:

• storing a distributed data pipeline within the process control network and in the further plant network, wherein storing the distributed data pipeline includes storing a series of data processing modules that are configured to be communicatively connected together in a particular order to perform processing on process control data in various different ones of the process control devices and processing devices;
• collecting data at one or more of the data processing modules of the data pipeline during on-line operation of the process control network;
• processing the collected process data in the data processing modules of the distributed data pipeline during on-line operation of the process control network;
• storing the processed data developed by the data processing modules of the distributed data pipeline in a computer memory device;
• and
• using the data developed by the data processing modules of the distributed data pipeline in a further application executed on a further processing device.

A method of configuring a data processing pipeline within a process plant having a process control network with a multiplicity of process control devices that operate to control the process and having a process communication network having a multiplicity of processing devices communicatively coupled together, comprising:

• storing a set of data processing modules within different ones of the multiplicity of process control devices and the processing devices;
• communicatively interconnecting the data processing modules in a fixed manner to create a set of three or more data processing modules communicatively connected in series;
• and
• configuring the set of three or more data processing modules connected in series to perform specific types of data processing on data collected in the plant including;
• configuring one or more of the series of data processing modules within process control devices within the process control network as data collection modules to collect raw process data;
• configuring one or more of the series of data processing modules as intermediate process modules to communicate with one or more data collection modules and to process the raw process data collected by the data collection modules to create intermediate process data;
• and
• configuring one or more of the series of data processing modules as end-use process modules to communicate with one or more of the intermediate data processing modules to process the intermediate process data to generate end-use process data, including configuring one or more of the end-use data processing modules to provide the end-use process data to one or more subscribing applications communicatively connected to the process communication network.