Checkpoint model building for data mining
AssigneeOracle International Corporation
InventorsMark F. Hornick, Pavani Kuntala, Gary Drescher
Life of this patent
Estimating the term…
Abstract
The notion of checkpointing model building is introduced to safeguard against the loss of computational results due to abnormal termination of long running computation algorithms. A checkpoint manager initiates a checkpoint, wherein initiation occurs by various scenarios, including dynamically, automatically and manually. A computation module executes the checkpoint on an in progress data computation. The checkpoint manager also monitors the execution of the checkpoint for abnormal termination. Upon a determination of abnormal checkpoint termination, the inability to resume model building from a checkpoint, the checkpoint manger either resumes model build from the checkpoint or aborts the model build.
Claims40
A method of checkpoint model building, the model building performed by a model build process for data mining, the method comprising the steps of:
- periodically detecting a notification interrupt originating from any one of two sources, the notification interrupt notifying a checkpoint manager to initiate checkpoints and wherein one of the sources is remote from the other source;
- initiating a checkpoint on the model build process, the model building process generating models in accordance with one or more data analysis algorithms;
- and
- executing the checkpoint on a set of the one or more data analysis algorithms, the set based on the source of the notification interrupt;
- wherein the checkpoint enables the model build process to continue generating models from a point prior to an occurrence of model build process operation failure.
An apparatus for checkpoint model building, the model building performed by a model build process for data mining, the apparatus comprising:
- a processor operable to execute a checkpoint manager and one or more data analysis algorithms;
- a memory operable to store a checkpoint manager and one or more data analysis algorithms executable by the processor;
- a checkpoint manager for:
- periodically detecting a notification interrupt originating from any one of two sources, the notification interrupt notifying a checkpoint manager to initiate checkpoints and wherein one of the sources is remote from the other source;
- initiating a checkpoint on the model build process, the model building process generating a model in accordance with one or more data analysis algorithms, wherein the checkpoint enables the model build process to continue generating models from a point prior to a point of model build process operation failure;
- and
- a set of the one or more data analysis algorithms for executing the checkpoint, the set based on the source of the notification interrupt;
- and
- a non-volatile storage structure for storing analysis information.
A computer program product for checkpoint model building, the model building performed by a model build process for data mining in an electronic data processing system, comprising:
- a computer readable medium;
- computer program instructions, recorded on the computer readable medium, executable by a processor, for performing the steps of:
- periodically detecting a notification interrupt originating from any one of two sources, the notification interrupt notifying a checkpoint manager to initiate checkpoints and wherein one of the sources is remote from the other source;
- initiating a checkpoint on the model build process, the model building process generating a model in accordance with one or more data analysis algorithms, wherein the checkpoint enables the model build process to continue generating models from a point prior to a point of model build process operation failure;
- and
- executing the checkpoint on a set of the one or more data analysis algorithms, the set based on the source of the notification interrupt.
Dependencies are inferred from the claim text.