Runbook deployment based on confidence evaluation
AssigneeInternational Business Machines Corporation
InventorsMatthew Richard James Thornhil, David Jon Griffin, LUKE TAHER
Life of this patent
Estimating the term…
Abstract
Runbook deployment based on confidence evaluation. Obtaining a runbook based on commands, where the commands relate to resolving an incident and determining an aggregated skill level of operators for the runbook based on historical resolutions of incidents by the operators. A confidence measure of the runbook is determined according to the aggregated skill level for the runbook. Deployment of the runbook is performed in accordance with the confidence measure.
Claims21
A computer-implemented method for runbook deployment based on confidence evaluation, comprising:
- identifying an incident;
- identifying, within a knowledge domain, an incident type associated with the incident;
- obtaining a generated runbook having runbook commands based on operator commands entered by one or more operators to resolve a previous incident of the identified incident type, the operator commands executed against affected resources and resulting in system state changes during resolution of the previous incident;
- determining operator skill levels for the incident type based on historical resolutions of incidents by the one or more operators;
- responsive to determining operator skill levels, aggregating individual operator skill levels for the incident type for the one or more operators entering commands corresponding to the generated runbook;
- determining an aggregated skill level of the one or more operators for the generated runbook, the aggregate skill level combining individual skill levels of the one or more operators where the skill level is based on historical resolutions of incidents by each one of the one or more operators;
- determining a confidence measure of the generated runbook based on the aggregated skill level of the one or more operators who generated the operator commands used in the generated runbook;
- and
- responsive to the confidence measure indicating an above-threshold skill level, automatically deploying the runbook commands of the generated runbook to resolve the incident.
(canceled)
A system for runbook deployment based on confidence evaluation, comprising:
- a processor and a memory configured to provide computer program instructions to the processor to execute the function of the components:
- an event management system for identifying an incident;
- a historical incident component for identifying, within a knowledge domain, an incident type associated with the incident;
- a runbook obtaining component for obtaining a generated runbook having runbook commands based on operator commands entered by one or more operators to resolve a previous incident of the identified incident type, the operator commands executed against affected resources and resulting in system state changes during resolution of the previous incident;
- an operator skill level component for determining operator skill levels for the incident type based on historical resolutions of incidents by the one or more operators;
- a runbook deployment component for, responsive to determining operator skill levels, aggregating individual operator skill levels for the incident type for the one or more operators entering commands corresponding to the generated runbook;
- an aggregated skill level component for determining an aggregated skill level of the one or more operators for the generated runbook, the aggregate skill level combining individual skill levels of the one or more operators where the skill level is based on historical resolutions of incidents by each one of the one or more operators;
- a confidence measure component for determining a confidence measure of the generated runbook based on the aggregated skill level of the one or more operators who generated the operator commands used in the generated runbook;
- and
- a deployment instructing component for, responsive to the confidence measure indicating an above-threshold skill level, automatically deploying the runbook commands of the generated runbook to resolve the incident.
(canceled)
A computer program product for runbook deployment based on confidence evaluation, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a processor to cause the processor to:
- identify an incident;
- identify, within a knowledge domain, an incident type associated with the incident;
- obtain a generated runbook having runbook commands based on operator commands entered by one or more operators to resolve a previous incident of the identified incident type, the operator commands executed against affected resources and resulting in system state changes during resolution of the previous incident;
- determine operator skill levels for the incident type based on historical resolutions of incidents by the one or more operators;
- responsive to determining operator skill levels, aggregate individual operator skill levels for the incident type for the one or more operators entering commands corresponding to the generated runbook;
- determine an aggregated skill level of the one or more operators for the generated runbook, the aggregate skill level combining individual skill levels of the one or more operators where the skill level is based on historical resolutions of incidents by each one of the one or more operators;
- determine a confidence measure of the generated runbook based on the aggregated skill level of the one or more operators who generated the operator commands used in the generated runbook;
- and
- responsive to the confidence measure indicating an above-threshold skill level, automatically deploy the runbook commands of the generated runbook to resolve the incident.
Dependencies are inferred from the claim text.