Systems and methods for expedited large file processing
AssigneeCapital One Services, LLC
InventorJapan Bhatt
Life of this patent
Estimating the term…
Abstract
A system includes one or more memory devices storing instructions, and one or more processors configured to execute the instructions to perform steps of a method for processing a large file. The system may receive record data comprising a plurality of records having an identification value in a common field having a data format. The system may determine a plurality of focus values based on the data format and create a plurality of virtual processing units based on the plurality of focus values. Each of the plurality of virtual processing units may process a sub-group of the plurality of records that corresponds to the focus value associated with the respective virtual processing unit.
Claims1
A system for processing a large file, comprising:
- one or more processors;
- and
- a memory in communication with the one or more processors and storing instructions that, when executed by the one or more processors, are configured to cause the system to:
- receive record data comprising a plurality of records, each of the plurality of records comprising an identification value in a common field, the common field having a data format comprising a sequence of characters;
- determine, based on a comparison of a size of the record data to a predetermined size threshold, a focus value order of magnitude;
- determine, based on the data format and the focus value order of magnitude, a plurality of unique focus values, each of the plurality of focus values corresponding to a sub-group of the plurality of records, wherein each of the plurality of focus values correspond to a specified portion of the sequence of characters in the data format;
- create a plurality of virtual processing units, each associated with a unique one of the plurality of focus values;
- and
- responsive to searching the record data, process, by each of the plurality of virtual processing units, the respective sub-group of the plurality of records that corresponds to the focus value associated with the respective virtual processing unit.
Dependencies are inferred from the claim text.