Computer system and process for checkpointing operations on data in a computer system by partitioning the data
AssigneeTorrent Systems, Inc.
InventorMichael J. Beckerle
Life of this patent
Estimating the term…
Abstract
Checkpointing of operations on data may be provided by partitioning the data into temporal segments. Operations may be performed on the temporal segments and checkpoints may be established by storing a persistent indication of the segment being processed. The entire processing state need not be saved. If a failure occurs, processing can be restarted using the saved indication of the segment to be processed. Such data partitioning and checkpointing may be applied to relational databases, databases with dataflow operation and/or parallelism and other database types with or without parallel operation.
Claims4
A process for checkpointing operations on data by a processing element in a computer system, comprising:
- partitioning the data into temporal segments for processing by the processing element;
- selecting one of the temporal segments;
- saving a persistent indication of the selected temporal segment;
- processing the selected temporal segment by the processing element;
- when a failure of the processing element is detected, discarding any outputs generated by the processing element for the selected temporal segment and reprocessing the selected temporal segment corresponding to the saved persistent indication;
- and
- when processing by the processing element completes without failure, saving the outputs produced by the processing element and selecting the next temporal segment to be processed by the processing element.
A computer system for checkpointing operations on data by a processing element in a computer system, comprising:
- means for partitioning the data into temporal segments for processing by the processing element;
- means for selecting one of the temporal segments;
- means for saving a persistent indication of the selected temporal segment;
- means for processing the selected temporal segment by the processing element;
- means for when a failure of the processing element is detected, discarding any outputs generated by the processing element for the selected temporal segment and reprocessing the selected temporal segment corresponding to the saved persistent indication;
- and
- means for when processing by the processing element completes without failure, saving the outputs produced by the processing element and selecting the next temporal segment to be processed by the processing element.
Dependencies are inferred from the claim text.