Techniques for external application-directed data partitioning in data exporting from a database management system
AssigneeTeradata US, Inc.
InventorsYu Xu, Olli Pekka Kostamaa
Life of this patent
Estimating the term…
Abstract
Techniques for external application-directed data partitioning in data exported from a parallel database management system (DBMS) are provided. An external application sends a query, a total number of requested access module processors (AMPs), and an application-defined data partitioning expression to the DBMS. The DBMS executes the query with the results vertical partitioned on the identified number of AMPs. Individual external mappers access their assigned AMPs asking for specific partitions that they are assigned to process the query results.
Claims20
A method implemented and programmed within a non-transitory computer-readable storage medium and processed by one or more processors, the processors configured to execute the method, comprising:
- obtaining a query;
- acquiring a total number of access module processors (AMPs) available on a database management system (DBMS);
- defining a data partitioning expression that is for vertical partitioning of query results on the AMPs by the DBMS when the query is processed by the DBMS;
- and
- submitting the query, the total number of AMPs, and the data partitioning expression to the DBMS for execution.
A method implemented and programmed within a non-transitory computer-readable storage medium and processed by one or more processors, the processors configured to execute the method, comprising:
- configuring mapping functions to process query results on access module processors (AMPs) of a database management system (DBMS);
- submitting a query, a total number of AMPs for the AMPs, and an application-defined partition expression to the DBMS, the DMBS executes the query and partitions the query results according to the application-defined partition expression on the AMPs;
- and
- initiating the mapping functions in parallel to process the query results on the AMPs.
A system, comprising:
- one or more processors configured with an external partitioner residing in a non-transitory computer-readable medium that executes on the one or more processors;
- wherein the external partitioner is configured to assigning mapping functions to specific access module processors (AMPs) of a database management system (DBMS) and to process a specific partition of query results housed on that AMP, and the external partitioner configured to submit a query, a total number of AMPs, and a partition expression to the DMBS, the DBMS executes the query and partitions the query results according to the partition expression in the AMPs.
Dependencies are inferred from the claim text.