Systems and methods for expedited large file processing

A system for processing a large file, comprising:

• one or more processors;
• and
• a memory in communication with the one or more processors and storing instructions that, when executed by the one or more processors, are configured to cause the system to:
• receive record data comprising a plurality of records, each of the plurality of records comprising an identification value in a common field, the common field having a data format comprising a sequence of characters;
• determine, based on a comparison of a size of the record data to a predetermined size threshold, a focus value order of magnitude;
• determine, based on the data format and the focus value order of magnitude, a plurality of focus values comprising at least a first focus value and a second focus value, each of the plurality of focus values corresponding to a sub-group of the plurality of records such that the first focus value corresponds to a first sub-group of the plurality of records and the second focus value corresponds to a second sub-group of the plurality of records, wherein the plurality of focus values correspond to a specified portion of the sequence of characters in the data format;
• create a first virtual processing unit for processing the first sub-group of the plurality, of records corresponding to the first focus value;
• create a second virtual processing unit for processing the second sub-group of the plurality of records corresponding to the second focus value;
• and
• process the first and second sub-groups of the plurality of records via the first and second virtual processing units, respectively.

A method of processing a large file comprising:

• receiving record data comprising a plurality of records, each of the plurality of records comprising an identification value in a common field, the common field having a data format comprising a multi-digit sequence;
• determining, based on a comparison of a size of the record data to a predetermined size threshold, a focus value order of magnitude;
• determining, based on the data format and the focus value order of magnitude, a plurality of unique focus values, each of the plurality of focus values corresponding to a sub-group of the plurality of records, wherein each of the plurality of focus values correspond to a specified portion of the multi-digit sequence in the data format;
• creating a plurality of virtual processing units, each associated with a unique one of the plurality of focus values;
• and
• responsive to searching the record data, processing, by each of the plurality of virtual processing units, the respective sub-group of the plurality of records that corresponds to the focus value associated with the respective virtual processing unit.