US 2022/0035533 A1 · Ordered Event Stream Merging

Abstract

Merging of portions of ordered event streams is disclosed. The disclosed merging of events can limit loss of order of events from streams in exchange for reduced computational load by grouping events according to a pseudo-epoch, wherein events are stored according to a scheme, even though the grouping can result reading events in a different order that that in which the events were written. However, by grouping the events, there can be fewer transitions between storage schemes when reading events than if they were read in the same order in which they were written, thereby reducing computational load. Moreover, restraints on the loss of order can be imposed by selecting a maximum progress window and generally restricting groups from comprising events two different storage schemes. Where events can be moved to archival storage, reducing storage scheme transitions can be of further benefit and speed access times of archived events.

Claims20

Dependent claims

A system, comprising:

a processor;
and
a memory that stores executable instructions that, when executed by the processor, facilitate performance of operations, comprising:
receiving an indication to merge a first portion of a first ordered event stream and a second portion of a second ordered event stream, wherein the first ordered event stream and the second ordered event stream are stored via an ordered event stream storage system;
determining a read order of events of the first portion of the first ordered event stream and the second portion of the second ordered event stream;
and
enabling reading of the events of the first portion of the first ordered event stream and the second portion of the second ordered event stream according to the read order.

4 more elements

A non-transitory machine-readable medium, comprising executable instructions that, when executed by a processor, facilitate performance of operations, comprising:

in response to receiving an merge events instruction, determining a read order of merged events of a first portion of a first ordered event stream and a second portion of a second ordered event stream, wherein:
the first ordered event stream and the second ordered event stream are stored via an ordered event stream storage system,
the first ordered event stream and the second ordered event stream are different ordered event streams,
the first ordered event stream employs a first event storage scheme corresponding to a first epoch,
the second ordered event stream employs a second event storage scheme corresponding to a second epoch, and
the read order is based on a progress step associated with a first pseudo-epoch corresponding to first events of the first portion of the first epoch and a second pseudo-epoch corresponding to second events of the second portion of the second epoch;
and
enabling reading of the first events of the first portion of the first epoch and the second events of the second portion of the second epoch according to the read order of the merged events, wherein the read order of the merged events is different than the write order of events comprising the merged events, and wherein the read order of the merged events reduces transitions between the first event storage scheme and the second event storage scheme in comparison to reading the merged events in the order they were written to the ordered event stream storage system.

5 more elements

Dependencies are inferred from the claim text.

Ordered Event Stream Merging

Life of this patent

Ordered Event Stream Merging

Life of this patent

Abstract

Claims20