Methods and systems for reducing volumes of log messages sent to a data center

A computer system for reducing volumes of log messages sent from an edge system to a data center, the system comprising:

• one or more processors;
• one or more data storage devices;
• and
• machine-readable instructions stored in the one or more data storage devices of the computer system that when executed using the one or more processors controls the computer system to perform operations comprising:
• collecting a stream of log messages generated by one or more event sources of the edge system;
• determining representative log messages of the log messages in the stream of log messages at the edge system;
• sending the representative log messages to the data center over the Internet;
• and
• discarding non-representative log messages from data storage devices of the edge system, wherein determining the representative log messages includes determining event types of the log messages in the stream of log messages, clustering semantically similar event types, and determining one or more representative log messages for each cluster of even types.

A non-transitory computer-readable medium encoded with machine-readable instructions for enabling one or more processors of a computer system to reduce log messages sent to a data center by performing operations comprising:

• collecting a stream of log messages generated by one or more event sources of an edge system;
• determining representative log messages of the log messages in the stream of log messages using a computer system of the edge system;
• sending the representative log messages from the edge system to the data center;
• and
• discarding non-representative log messages from data storage devices of the edge system, where the representative log messages received at the data center are stored in data storage devices, wherein determining the representative log messages includes determining event types of the log messages in the stream of log messages, clustering semantically similar event types, and determining one or more representative log messages for each cluster of even types.