Automation of workflow creation and failure recovery

A non-transitory computer-readable medium comprising instructions executable by a processor of a computing device to cause the computing device to perform a method, the method comprising:

• receiving a first job in a workflow of jobs to execute;
• executing the first job;
• determining, via a processor, a plurality of data associated with the first job, wherein the plurality of data comprises data associated with (i) a second job executed immediately prior to the first job, (ii) a third job executed immediately after the first job, (iii) a determination of whether the first job failed or executed successfully and (iv) a type of data associated with the first job;
• storing the determined plurality of data;
• receiving an analytic job to execute immediately after the third job;
• determining two or more related jobs to be executed in the workflow instead of the analytic job based on determining that the analytic job had previously failed and determining that (i) the two more related jobs perform a same function, while the two or more related jobs are performed in combination, as the analytic job and (ii) the two or more related jobs, in combination, can be substituted for the analytic job by determining that the two or more related jobs have not previously failed based on previous analytic job results;
• substituting the two or more related jobs for the analytic job in the workflow;
• executing the two or more related jobs;
• and
• in a case that the two or more related jobs to be performed in combination cannot be determined, exiting the workflow prior to running any remaining jobs associated with the workflow.

A system comprising:

• a processor;
• a non-transitory computer-readable medium comprising instructions executable by the processor to cause the system to perform a method, the method comprising:
• receiving a first job in a workflow of jobs to execute;
• executing the first job;
• determining, via a processor, a plurality of data associated with the first job, wherein the plurality of data comprises data associated with (i) a second job executed immediately prior to the first job, (ii) a third job executed immediately after the first job, (iii) a determination of whether the first job failed or executed successfully and (iv) a type of data associated with the first job;
• storing the determined plurality of data;
• receiving an analytic job to execute immediately after the third job;
• determining two or more related jobs to be executed in the workflow instead of the analytic job based on determining that the analytic job had previously failed and determining that (i) the two more related jobs perform a same function, while the two or more related jobs are performed in combination, as the analytic job and (ii) the two or more related jobs, in combination, can be substituted for the analytic job by determining that the two or more related jobs have not previously failed based on previous analytic job results;
• substituting the two or more related jobs for the analytic job in the workflow;
• executing the two or more related jobs;
• and
• in a case that the two or more related jobs to be performed in combination cannot be determined, exiting the workflow prior to running any remaining jobs associated with the workflow.