Method and system for implementing a log parser in a log analytics system
AssigneeOracle International Corporation
InventorGregory Michael Ferrar
Life of this patent
Estimating the term…
Abstract
Disclosed is a system, method, and computer program product for implementing a log analytics method and system that can configure, collect, and analyze log records in an efficient manner. An improved approach has been described to automatically generate a log parser by analysis of the line content of a log. In addition, an efficient approach has been described to extract key-value content from the log content.
Claims23
One or more non-transitory computer-readable media storing instructions that, when executed by one or more processors, cause performance of operations comprising:
- obtaining, by a log analytics system, a first line and a second line from a plurality of lines of a log;
- identifying, by the log analytics system, a first common element of the first line and the second line as a first candidate delimiter;
- generating, by the log analytics system, a first score associated with the first common element,
- wherein the first score corresponds to a likelihood of the first common element being a delimiter;
- and
- wherein generating the first score comprises applying a weighting factor to the first score based at least on a numerical position of the first common element in the first line;
- determining, by the log analytics system based at least on the first score, that the first common element is a first delimiter;
- generating a regular expression configured to identify key-value pairs in log data using (a) the first common element as the first delimiter and (b) one or more placeholders corresponding to variable parts of the log data;
- generating, by the log analytics system, a log parser configured to extract the key-value pairs from the log data at least by applying the regular expression to the log data;
- extracting, by the log analytics system using the log parser, at least a first key-value pair from a set of log data monitored by the log analytics system.
A system comprising:
- at least one device comprising one or more hardware processors, the system being configured to perform operations comprising:
- obtaining, by a log analytics system, a first line and a second line from a plurality of lines of a log;
- identifying, by the log analytics system, a first common element of the first line and the second line as a first candidate delimiter;
- generating, by the log analytics system, a first score associated with the first common element,
- wherein the first score corresponds to a likelihood of the first common element being a delimiter;
- and
- wherein generating the first score comprises applying a weighting factor to the first score based at least on a numerical position of the first common element in the first line;
- determining, by the log analytics system based at least on the first score, that the first common element is a first delimiter;
- generating a regular expression configured to identify key-value pairs in log data using (a) the first common element as the first delimiter and (b) one or more placeholders corresponding to variable parts of the log data;
- generating, by the log analytics system, a log parser configured to extract the key-value pairs from the log data at least by applying the regular expression to the log data;
- extracting, by the log analytics system using the log parser, at least a first key-value pair from a set of log data monitored by the log analytics system.
A method comprising:
- obtaining, by a log analytics system, a first line and a second line from a plurality of lines of a log;
- identifying, by the log analytics system, a first common element of the first line and the second line as a first candidate delimiter;
- generating, by the log analytics system, a first score associated with the first common element,
- wherein the first score corresponds to a likelihood of the first common element being a delimiter;
- and
- wherein generating the first score comprises applying a weighting factor to the first score based at least on a numerical position of the first common element in the first line;
- determining, by the log analytics system based at least on the first score, that the first common element is a first delimiter;
- generating a regular expression configured to identify key-value pairs in log data using (a) the first common element as the first delimiter and (b) one or more placeholders corresponding to variable parts of the log data;
- generating, by the log analytics system, a log parser configured to extract the key-value pairs from the log data at least by applying the regular expression to the log data;
- extracting, by the log analytics system using the log parser, at least a first key-value pair from a set of log data monitored by the log analytics system;
- wherein the method is performed by at least device comprising one or more hardware processors.
Dependencies are inferred from the claim text.