Method and system for event topic checkpointing

A computing device configured to implement an execution of a method for providing ingestion checkpointing from an event topic, the computing device comprising:

• a processor;
• a memory;
• and
• a communication interface coupled to each of the processor and the memory,
• wherein the processor is configured to:
• poll, via an event consumer, a message broker to initiate consumption of at least one event from the event topic, the event topic relating to event storage;
• checkpoint, based on a result of the polling, the consumption of the at least one event by writing corresponding data in multiple stages to a checkpointing durable store;
• insert an event pending status for the at least one event in an events time bucket table;
• commit, via the event consumer, the consumption of the at least one event;
• initiate event processing for the at least one event;
• and
• update the events time bucket table with an event complete status when consumption of the at least one event is completed.

A non-transitory computer readable storage medium storing instructions for providing ingestion checkpointing from an event topic, the storage medium comprising executable code which, when executed by a processor, causes the processor to:

• poll, via an event consumer, a message broker to initiate consumption of at least one event from the event topic, the event topic relating to event storage;
• checkpoint, based on a result of the polling, the consumption of the at least one event by writing corresponding data in multiple stages to a checkpointing durable store;
• insert an event pending status for the at least one event in an events time bucket table;
• commit, via the event consumer, the consumption of the at least one event;
• initiate event processing for the at least one event;
• and
• update the events time bucket table with an event complete status when consumption of the at least one event is completed.