A method for streamlining and standardizing the ingest of data in a security monitoring system across a plurality of tenant networks, the security monitoring system comprising an edge module, a central control plane module, and a plurality of data gateway modules, each of the plurality of data gateway modules associated with a different log source, each of the plurality of tenant networks comprising at least one log source, the method comprising:
- receiving, by each of the plurality of data gateway modules of the security monitoring system, raw log data from the log source associated therewith;
- generating, by each of the plurality of data gateway modules of the security monitoring system, formatted log data based on the raw log data;
- ingesting, by the edge module of the security monitoring system, formatted log data from the plurality of data gateway modules;
- automatically updating, by the central control plane module of the security monitoring system, a configuration of at least one of the plurality of data gateway modules based on a change to the log source(s) associated therewith;
- and
- implementing, by the security monitoring system, a security action related to at least one of the plurality of tenant networks based on the ingested formatted data.