Data Partitioning for Improved Computer Performance When Processing

A system for improved performance of a computer configured to perform data query processing, the system comprising:

• a data set analyzer configured to identify a cut point value associated with a data set having a plurality of data records,
• wherein each of the plurality of data records in the data set includes an attribute value associated with the attribute,
• wherein each of the attribute values are normalized to a corresponding normalized attribute value between a first normal bound and a second normal bound,
• wherein the cut point value is any one value between the first and second normal bounds that is associated with a maximum data skipping performance value,
• wherein the data skipping performance value is calculated by applying a predefined data skipping performance function based on the normalized attribute values and the cut point value, and
• wherein the predefined data skipping performance function relates to a selected predefined data query distribution profile;
• a partition manager configured to partition the data set into multiple partitions,
• wherein one of the partitions includes a subset of the data records whose attribute values correspond to the normalized attribute values that are greater than the cut point value, and
• wherein another of the partitions includes a subset of the data records whose attribute values correspond to the normalized attribute values that are less than the cut point value;
• and
• a data storage manager configured to store the partitions on physical data storage media for access by a computer configured to perform data query processing.

A computer program product for improved performance of a computer configured to perform data query processing, the computer program product comprising:

• a non-transitory, computer-readable storage medium;
• and
• computer-readable program code embodied in the storage medium, wherein the computer-readable program code is configured to
• identify a cut point value associated with a data set having a plurality of data records,
• wherein each of the plurality of data records in the data set includes an attribute value associated with the attribute,
• wherein each of the attribute values are normalized to a corresponding normalized attribute value between a first normal bound and a second normal bound,
• wherein the cut point value is any one value between the first and second normal bounds that is associated with a maximum data skipping performance value,
• wherein the data skipping performance value is calculated by applying a predefined data skipping performance function based on the normalized attribute values and the cut point value, and
• wherein the predefined data skipping performance function relates to a selected predefined data query distribution profile,
• partition the data set into multiple partitions,
• wherein one of the partitions includes a subset of the data records whose attribute values correspond to the normalized attribute values that are greater than the cut point value, and
• wherein another of the partitions includes a subset of the data records whose attribute values correspond to the normalized attribute values that are less than the cut point value, and
• store the partitions on physical data storage media for access by a computer configured to perform data query processing.