Copying datasets between data integration systems

A system comprising:

• a first data integration system comprising:
• a first memory operable to store a first extract, transform, and load (ETL) job and a dataset associated with the first ETL job;
• and
• a first processor communicably coupled to the first memory, the first processor operable to process the first ETL job;
• a second data integration system comprising:
• a second memory operable to store the ETL job and the dataset associated with the first ETL job;
• a second processor communicably coupled to the second memory, the second processor operable to process the first ETL job;
• and
• wherein a version of operating system software, a version of integration system software, and a file system structure are substantially identical between the first data integration system and the second data integration system;
• a shared storage system shared between the first data integration system and the second data integration system;
• the dataset is stored on the shared storage system and comprises user data and metadata, wherein the metadata comprises virtual identifiers that identify data system integration resources used to create the dataset;
• the first processor is further operable to resolve the virtual identifiers to particular resources in the first data integration system;
• and
• the second processor is further operable to resolve the virtual identifiers to particular resources in the second data integration system.

A method of copying a dataset associated with a first extract, transform, and load (ETL) job in a first data integration system to a second data integration system, the method comprising:

• copying executable code associated with the first ETL job from the first data integration system to the second data integration system, wherein a version of operating system software, a version of integration system software, and a file system structure are substantially identical between the first data integration system and the second data integration system;
• executing the second ETL job to read the dataset from the first data integration system and write the dataset to the second data integration system, wherein:
• the second ETL job is associated with configuration parameters comprising:
• source parameters specifying identifiers of storage resources in the first data integration system associated with the current storage location of the dataset;
• and
• destination parameters specifying identifiers of storage resources in the second data integration system associated with a destination storage of the dataset;
• and
• copying metadata generated by the second ETL job from the first data integration system to the second data integration system.