Message queue telemetry transport (MQTT) data logger and processor for near real time data analysis

A method for MQ Telemetry Transport (MQTT) data logging and processing comprising:

• logging all data and messages receivable by an MQTT broker from one or more clients over a communication network;
• sorting and correcting the logged data and messages to generate cleaned logged data and messages;
• and
• converting the cleaned logged data and messages into another data format usable by another system;
• wherein sorting and correcting the logged data and messages further comprises:
• sorting the logged data and messages with a message sorter;
• correcting instances of not a number (NaN), infinites (INFs), and Zeros found in the logged data and messages;
• and
• generating a file containing the sorted and corrected logged data and messages with the message sorter for use in a further message sorter and file assignment module.

An apparatus for MQ Telemetry Transport (MQTT) data logging and processing comprising:

• a processor coupled to at least one memory device;
• a data logger module coupled with the processor and an MQTT broker, the data logger module including:
• a data flow module configured to store one or more messages sent to the MQTT broker over a machine-to-machine (M2M) network, wherein the one or more messages are configured according to MQTT network protocol;
• and
• a message sorter module configured to sort and clean the one or more messages stored in the data logging node according to one or more predetermined processes;
• wherein the data logger module is further configured to convert the cleaned one or more messages into another data format different from MQTT network protocol that is accessible by another system;
• and
• wherein the message sorter module is further configured to correct instances of not a number (NaN), infinites (INFs), and Zeros found in the logged data and messages, and generate a file containing the sorted and corrected logged data and messages with the message sorter for use in a further message sorter and file assignment module.

A non-transitory computer-readable medium storing computer executable code, wherein the code when executed by at least one processor causes the at least one processor to:

• store one or more messages sent to an MQTT broker over a network, the one or more messages configured according to MQTT network protocol;
• clean the one or more stored messages according to one or more predetermined processes including correcting instances of not a number (NaN), infinites (INFs), and Zeros found in the logged data and messages, and generating a file containing the sorted and corrected logged data and messages with the message sorter for use in a further message sorter and file assignment module;
• and
• convert the cleaned one or more stored messages into another data format apart from MQTT network protocol that is accessible by another system.