Generating a combined database with data extracted from multiple systems

A method of generating a combined database including data extracted from at least a first system and a second system, the method comprising:

• determining, with an electronic processor, data changes in the first system;
• extracting the data changes from the first system and inserting the data changes extracted from the first system into one or more tables included in the combined database;
• determining data changes in the second system;
• extracting a report including the data changes from the second system, the report including a markup language document;
• generating a shared mapping table to define one or more virtual tables,
• for each virtual table of the one or more virtual tables defined in the shared mapping table:
• generating a processing task associated with the virtual table,
• extracting, with the processing task, data from the markup language document using a path in the virtual table, and
• queuing, with the processing task, the data extracted from the markup language document into an in-memory table associated with the virtual table;
• in response to the processing task associated with each of the one or more virtual tables completing without failure, inserting, with the electronic processor, the data queued in the in-memory table associated with each of the one or more virtual tables into one or more tables included in the combined database;
• receiving a query;
• executing the query on the combined database to generate query results, wherein the query results include data stored in the combined database extracted from the first system and data stored in the combined database extracted from the second system;
• and
• outputting the query results.

Non-transitory computer readable medium storing instructions that, when executed by an electronic processor, perform a set of functions, the set of functions comprising:

• determining data changes in a system;
• extracting a report including the data changes from the system, the report including a markup language document;
• generating a shared mapping table to define one or more virtual tables,
• for each virtual table of the one or more virtual tables defined in the shared mapping table:
• generating a processing task associated with the virtual table,
• extracting, with the processing task, data from the markup language document using a path in the virtual table, and
• queuing, with the processing task, the data extracted from the markup language document into an in-memory table associated with the virtual table;
• and
• in response to the processing task associated with each of the one or more virtual tables completing without failure, inserting the data queued in the in-memory table associated with each of the one or more virtual tables into one or more tables included in a database.