Methods and systems for identifying duplicate jobs in a continuous integration environment

A system comprising:

• a processor;
• and
• a memory storing instructions which, when executed by the processor, cause the processor to:
• receive a first job definition file for execution in a continuous integration environment;
• split the first job definition file into a first plurality of stages;
• compare the first plurality of stages with a second plurality of stages from a second job definition file to determine one or more corresponding stages between the first and the second plurality of stages;
• determine, based on the one or more corresponding stages, whether the first and the second job definition files are hard copies or soft copies of one another;
• remove, responsive to determining that the first and the second job definition files are hard copies of one another, one of the first and the second job definition files from the continuous integration environment;
• and
• generate, responsive to determining that the first and the second job definition files are soft copies of one another, a generic job definition file to replace the first and the second job definition files within the continuous integration environment.

A non-transitory, computer-readable medium storing instructions which, when executed by a processor, cause the processor to:

• receive a first job definition file for execution in a continuous integration environment;
• split the first job definition file into a first plurality of stages;
• compare the first plurality of stages with a second plurality of stages from a second job definition file to determine one or more corresponding stages between the first and the second plurality of stages;
• determine, based on the one or more corresponding stages, whether the first and the second job definition files are hard copies or soft copies of one another;
• remove, responsive to determining that the first and the second job definition files are hard copies of one another, one of the first and the second job definition files from the continuous integration environment;
• and
• generate, responsive to determining that the first and the second job definition files are soft copies of one another, a generic job definition file to replace the first and the second job definition files within the continuous integration environment.