Cloud data extraction in high-security contexts

A computer-implemented method comprising:

• transmitting a first request to a cloud computing environment, the first request being for a total number of records in a batch of records that was processed by the cloud computing environment during a prior time window;
• receiving a first response to the first request, the first response indicating the total number of records in the batch of records;
• transmitting a second request to the cloud computing environment, the second request being for a list of subgroups of records contained within the batch of records;
• receiving a second response to the second request, the second response including the list of subgroups of records;
• executing a partitioned retrieval process for the batch of records, wherein the partitioned retrieval process involves:
• spawning a number of processing threads;
• and
• operating the processing threads in parallel, such that each of the processing threads retrieves one or more of the subgroups of records from the cloud computing environment and saves the one or more subgroups of records to one or more files;
• and
• validating the partitioned retrieval process by determining whether a number of records stored in the one or more files matches the total number of records in the batch of records.

A system comprising:

• one or more processors;
• and
• one or more memories including instructions that are executable by the one or more processors for causing the one or more processors to perform operations including:
• transmitting a first request to a cloud computing environment, the first request being for a total number of records in a batch of records that was processed by the cloud computing environment during a prior time window;
• receiving a first response to the first request, the first response indicating the total number of records in the batch of records;
• transmitting a second request to the cloud computing environment, the second request being for a list of subgroups of records contained within the batch of records;
• receiving a second response to the second request, the second response including the list of subgroups of records;
• executing a partitioned retrieval process for the batch of records, wherein the partitioned retrieval process involves:
• spawning a number of processing threads;
• and
• operating the processing threads in parallel, such that each of the processing threads retrieves one or more of the subgroups of records from the cloud computing environment and saves the one or more subgroups of records to one or more files;
• and
• validating the partitioned retrieval process by determining whether a number of records stored in the one or more files matches the total number of records in the batch of records.