Log information transmission integrity
AssigneeAmazon Technologies, Inc.
InventorsDaniel Vassallo, Emmanuel Pierre Devillard, Hongqi Wang, Muhammad Umer Azad
Life of this patent
Estimating the term…
Abstract
A system for collecting and disseminating log information may comprise a log agent and a log service. A log agent may transmit a log stream to a log service using non-overlapping adjacent subsets of log entries. Each subset may be associated with a unique and monotonically increasing sequence number, which is not incremented until the subset is received and processed by a log service.
Claims20
A system, comprising:
- at least one processor;
- at least one memory having stored thereon instructions that, upon execution by the at least one processor, cause the system at least to:
- store a first subset of a plurality of records, the plurality of records comprising operational information for at least one computing node;
- store information associating the first subset of the plurality of records with a first identifier issued by a provider of log sequence identifiers;
- transmit the first subset of the plurality of records and the first identifier for processing by a computing node;
- obtain information indicating that the first subset of the plurality of records were processed by the computing node;
- obtain a second identifier issued by the provider of log sequence identifiers, the second identifier unique with respect to previous identifiers of subsets of the plurality of records;
- free the first subset of the plurality of records from storage;
- and
- store information associating a second subset of the plurality of records with the second identifier.
A method, comprising:
- storing a plurality of log records;
- obtaining a first identifier from a provider of log sequence identifiers;
- storing information associating a first subset of the plurality of log records with the first identifier;
- transmitting the first subset of the plurality of log records to a computing node;
- freeing the first subset of the plurality of log records from storage in response to receiving information indicating that the computing node has processed the first subset of the plurality of log records;
- and
- storing information associating a second subset of the plurality of log records with a second identifier received from the provider of log sequence identifiers.
A non-transitory computer-readable storage medium having stored thereon instructions that, upon execution by a computing device, cause the computing device at least to:
- store a first subset of a plurality of log entries;
- store an association between the first subset of the plurality of log entries and a first identifier received from a provider of log sequence identifiers;
- transmit the first subset of the plurality of log entries and the first identifier to a computing node comprising a service for disseminating log information;
- obtain information from the computing node, the received information indicative of the first subset of the plurality of log entries having been processed by the computing node, the information further comprising a second identifier unique with respect to previous identifiers including the first identifier;
- free the record from storage in response to the log entries having been processed by the computing node;
- and
- store an association between a second subset of the plurality of log entries a second identifier received from the provider of log sequence identifiers.
Dependencies are inferred from the claim text.