Back to results
US 9,794,326 B1Granted
Log information transmission integrity
AssigneeAmazon Technologies, Inc.
InventorsDaniel Vassallo, Emmanuel Pierre Devillard, Hongqi Wang, Muhammad Umer Azad
Life of this patent
Estimating the term…
Abstract
A system for collecting and disseminating log information may comprise a log agent and a log service. A log agent may transmit a log stream to a log service using non-overlapping adjacent subsets of log entries. Each subset may be associated with a unique and monotonically increasing sequence number, which is not incremented until the subset is received and processed by a log service.
Claims20
A system for transmitting log information, the system comprising:
- a first one or more computing nodes operating a first one or more services, the first one or more services generating a log data stream comprising a plurality of log entries, the first one or more computing nodes communicatively coupled to a storage device;
- a second one or more computing nodes operating a service for processing the log data stream;
- one or more memories having stored thereon computer readable instructions that, upon execution by a computing device, cause the system at least to:
- identify a first subset of the plurality of log entries for transmitting from the first one or more computing nodes to the second one or more computing nodes;
- receive a first identifier issued by a log sequence provider;
- store, on the storage device communicatively coupled to the first one or more computing nodes, a record comprising information indicative of the first subset of the plurality of log entries and the first identifier;
- transmit the first subset of the plurality of log entries and the first identifier to the second one or more computing nodes;
- receive information from the second one or more computing nodes, the received information indicative of the first subset of the plurality of log entries having been processed by the second one or more computing nodes, the information further comprising a second identifier unique with respect to previous identifiers, including the first identifier;
- and
- in response to receiving the information, freeing the record from the storage device and associating a second subset of the plurality of log entries with the second identifier.
7 more elements
A system comprising:
- one or more computing nodes including a log agent for collecting and transmitting log entries;
- one or more memories having stored thereon computer readable instructions implementing a log service that, upon execution by a computing device, cause the system at least to:
- receive a first subset of a plurality of log entries maintained on the one or more computing nodes and a first identifier associated with the first subset of the plurality of log entries, wherein the first identifier was issued by a log sequence provider;
- process the first subset of the plurality of log entries;
- transmit, to the log sequence provider, a request to generate a second identifier that is different from previous identifiers of the log sequence provider;
- and
- transmit information indicative of completed processing of the first subset of the plurality of log entries, the information comprising the second identifier.
4 more elements
A computer-implemented method for processing log information from hosted computing services, the method comprising:
- receiving, from a log agent running on a computer system, information indicative of a first subset of a plurality of log entries and a first identifier, wherein the first subset of the plurality of entries and the first identifier were stored on a storage device of the computer system;
- processing the first subset of the plurality of log entries;
- and
- obtaining a second identifier that is different from previous identifiers including the first identifier;
- and
- transmitting, to the log agent, information indicative of completed processing of the first subset of the plurality of entries, the information comprising the second identifier, wherein the log agent, in response to the transmitting, frees the first subset of the plurality of entries and the first identifier from being stored on the storage device of the computer system and associates a second subset of the plurality of log entries with the second identifier.
3 more elements
Dependencies are inferred from the claim text.