Sorted parallel processing of a large dataset

A system, comprising:

• a memory;
• and
• at least one processor coupled to the memory and configured to:
• receive a search request for a plurality of items from a user, wherein the search request includes a query attribute for the plurality of items and the query attribute depends on information related to the user and a known attribute of the plurality of items;
• determine an intermediate result set of items in the plurality of items based on the search request;
• sort the items in the intermediate result set based on the known attribute;
• divide the sorted items into a plurality of batches, wherein each of the plurality of batches has a sequential identification number (ID);
• determine the query attribute based on the known attribute for each item in a subset of the plurality of batches in parallel with other batches in the subset of the plurality of batches;
• collect the determined query attribute for each item in the subset of the plurality of batches into a staging map;
• and
• generate, according to the sequential ID of the batches in the subset, a final result set of items for display to the user based on the determined query attribute for each item in the staging map prior to completion of determining the query attribute for all items in the plurality of batches.

A non-transitory computer-readable device having instructions stored thereon that, when executed by at least one computing device, cause the at least one computing device to perform operations comprising:

• receiving a search request containing a query attribute for a plurality of items from a user, wherein the search request includes the query attribute for the plurality of items and the query attribute depends on information related to the user and a known attribute of the plurality of items;
• determining an intermediate result set of items in the plurality of items based on the search request;
• sorting the items in the intermediate result set based on the known attribute;
• dividing the sorted items into a plurality of batches, wherein each of the plurality of batches has a sequential identification number (ID);
• determining the query attribute based on the known attribute for each item in a subset of the plurality of batches in parallel with other batches in the subset of the plurality of batches;
• collecting the determined query attribute for each item in the subset of the plurality of batches into a staging map;
• and
• generating, according to the sequential ID of the batches in the subset, a final result set of items for display to the user based on the determined query attribute for each item in the staging map prior to completion of determining the query attribute for all items in the plurality of batches.