Remote data collection systems and methods using read only data extraction and dynamic data handling

A remote data collection method, comprising:

• receiving a request for remote data collection to extract data from a data source;
• extracting the data in a non-intrusive manner from the data source using a two phase process comprising a reconciliation phase and a collection phase;
• and
• transmitting one of an entire set and a subset of the extracted data based on the request.

Software stored in a non-transitory computer readable medium and comprising instructions executable by a system, and in response to such execution causes the system to perform operations comprising:

• receiving a request for remote data collection to extract data from a data source;
• interfacing to the data source in a read-only manner;
• performing a reconciliation phase to determine what data to extract from the data source, to determine how to extract the data from the data source, and to define a current collection object for extracting the data from the data source;
• performing a collection phase to synchronize data between the data source and a shadow database, to process the data in the shadow database, and to send the processed data;
• and
• transmitting one of an entire set and a subset of the extracted data based on the request.