Managing big data in process control systems

A method of storing process control data associated with a process control plant, the method comprising:

• receiving process control data from a plurality of devices configured to control at least one process in the process control plant, the process control data including a plurality of portions each associated with a respective process variable;
• and
• for each respective portion of the data:
• identifying (1) the respective process variable, (2) a timestamp associated with the respective portion of the data, the timestamp including a rounded timestamp portion and a remainder timestamp portion, and (3) a measurement value associated with the respective process variable,
• identifying, by a processor, a rowkey stored in a data storage device, wherein the rowkey is a combination of the respective process variable and the rounded timestamp portion, and
• storing, within a portion of the data storage device associated with the rowkey, the remainder timestamp portion and the measurement value, to enable effective subsequent access of at least the measurement value.

A process control system, comprising:

• a controller configured to control a process in the process control system;
• a field device communicatively connected to the controller, the field device configured to perform a physical function to control the process in the process control system, and the field device configured to transmit to or receive from the controller real-time data corresponding to the physical function;
• and
• a process control system big data apparatus, the process control system big data apparatus including:
• a data storage device configured to store the real-time data, and
• a data receiver configured to receive the real-time data from the field device, the real-time data including a plurality of portions each associated with a respective process variable, and
• a processor adapted to interface with the data storage device and the data receiver and configured to, for each respective portion of the data:
• identify (1) the respective process variable, (2) a timestamp associated with the respective portion of the data, the timestamp including a rounded timestamp portion and a remainder timestamp portion, and (3) a measurement value associated with the respective process variable,
• identify a rowkey stored in the data storage device, wherein the rowkey is a combination of the respective process variable and the rounded timestamp portion, and
• store, within a portion of the data storage device associated with the rowkey, the remainder timestamp portion and the measurement value, to enable effective subsequent access of at least the measurement value;
• wherein the controller is a first node of a process control system big data network, and the process control system big data apparatus is a second node of the process control system big data network.

A system for storing process control data associated with a process control plant, comprising:

• a data storage device configured to store process control data corresponding to at least one process that is controlled by a plurality of devices in the process control plant;
• a data receiver configured to receive the process control data from the plurality of devices, the process control data including a plurality of records each having (1) a respective process variable, (2) a measurement value associated with the respective process variable, and (3) a timestamp including a rounded timestamp portion and a remainder timestamp portion;
• and
• a processor adapted to interface with the data storage device and the data receiver and configured to:
• determine that a set period of time based on the rounded timestamp portion has elapsed,
• identify one or more of the plurality of records recorded within the set period of time
• identify at least one statistical parameter from the one or more of the plurality of records, and
• store the at least one statistical parameter in a time period data record associated with the set period of time and the respective process variable, to enable effective subsequent access of at least the at least one statistical parameter.

A method of storing process control data associated with a process control plant, the method comprising:

• receiving process control data from a plurality of devices configured to control at least one process in the process control plant, the process control data including a plurality of records each having (1) a respective process variable, (2) a measurement value associated with the respective process variable, and (3) a timestamp including a rounded timestamp portion and a remainder timestamp portion;
• determining, by a processor, that a set period of time based on the rounded timestamp portion has elapsed;
• identifying one or more of the plurality of records recorded within the set period of time;
• identifying at least one statistical parameter from the one or more of the plurality of records;
• and
• storing, in a data storage device, the at least one statistical parameter in a time period data record associated with the set period of time and the respective process variable, to enable effective subsequent access of at least the at least one statistical parameter.

A process control system, comprising:

• a controller configured to control a process in the process control system;
• a field device communicatively connected to the controller, the field device configured to perform a physical function to control the process in the process control system, and the field device configured to transmit to or receive from the controller real-time data corresponding to the physical function;
• and
• a process control system big data apparatus, the process control system big data apparatus including:
• a data storage device configured to store the real-time data,
• a data receiver configured to receive the real-time data from the field device, the real-time data including a plurality of records each having (1) a respective process variable, (2) a measurement value associated with the respective process variable, and (3) a timestamp including a rounded timestamp portion and a remainder timestamp portion, and
• a processor adapted to interface with the data storage device and the data receiver and configured to:
• determine that a set period of time based on the rounded timestamp portion has elapsed,
• identify one or more of the plurality of records recorded within the set period of time,
• identify at least one statistical parameter from the one or more of the plurality of records, and
• store the at least one statistical parameter in a time period data record associated with the set period of time and the respective process variable, to enable effective subsequent access of at least the at least one statistical parameter;
• wherein the controller is a first node of a process control system big data network, and the process control system big data apparatus is a second node of the process control system big data network.