Data grouping for efficient parallel processing

One or more non-transitory computer-readable storage media storing computer-executable instructions for causing a computing system to perform an improved method for distributing data objects, the method comprising:

• receiving a request for parallel processing of a plurality of data objects;
• generating one or more groups for distributing the data objects;
• determining hash value intervals for the one or more groups;
• determining hash values for the plurality of data objects;
• distributing the plurality of data objects into the one or more groups based on their respective hash values and the hash value intervals;
• processing the plurality of data objects in parallel by the groups comprising the distributed data objects;
• and,
• returning the processing results of the plurality of data objects in response to the request.

A method for reducing skew in groups of data objects to be processed in parallel, the method comprising:

• receiving a plurality of data objects;
• determining a total number of groups for distributing the data objects;
• generating value intervals for the groups using a discretized value generation function;
• for data objects of the plurality of data objects:
• assigning a value generated using the discretized value generation function to a given data object of the plurality of data objects, and
• distributing the given data object into a given group of the groups based on the value assigned to the given data object and the generated value interval for the given group;
• and,
• providing the groups having the distributed data objects.