Techniques for guided access to an external distributed file system from a database management system
AssigneeTeradata US, Inc.
InventorYu Xu
Life of this patent
Estimating the term…
Abstract
Techniques for guided access to an external distributed file system (DFS) from a database management system (DBMS) are provided. A user access a graphical user interface (GUI) to interactively define a search on an external DFS. The search and any filtering conditions are processed on the external DFS and results are imported to the DBMS and mapped to a table in the DBMS for manipulation and access by the user within the DBMS.
Claims20
A method implemented and programmed within a non-transitory computer-readable storage medium and processed by one or more processors, the processors configured to execute the method, comprising:
- presenting a graphical user interface (GUI) within a parallel database management system (DBMS) to a user;
- using the GUI, the user identifies a file from an external distributed file system (DFS), external to the DBMS;
- acquiring, via the GUI, and from the user first columns to select from the file and a mapping of the first columns to data types present in the DBMS;
- obtaining, via the GUI, and from the user filtering conditions for matching data in the first columns of the file;
- and
- generating a user-defined function (UDF) for selections of the user made via the GUI.
A method implemented and programmed within a non-transitory computer-readable storage medium and processed by one or more processors, the processors configured to execute the method, comprising:
- identifying a file located in an external distributed file system (DFS), identification occurs within a parallel database management system (DBMS);
- using an Application Programming Interface (API) of the DFS to access the file on the DFS;
- presenting data from the file to a requestor;
- receiving from the requestor column definitions, mapping instructions, and filtering conditions for matching selective data within the file as defined by the requestor to a table of the DBMS;
- and
- generating executable code for a user-defined function (UDF) that acquires the selective data from the file and imports that selective data to the table using the mapping instructions.
A system, comprising:
- one or more processors of a parallel database management system (DBMS) configured with an external distributed file system (DFS) user-defined function (UDF) generator, the DFS UDF generator executing on the one or ore processors;
- and
- a graphical user interface (GUI) that executes on the one or more processors;
- wherein the GUI is configured to interact with a user of the DBMS and the DFS UDF generator, the GUI provides a menu-driven interface to the user for the user to define columns, mapping instructions, and filtering conditions for a file of the DFS, the DFS UDF generator configured to use the columns, mapping instructions, and the filtering conditions to generate a specific UDF that when executed accesses the file from the DFS and imports selective data matching the filtering conditions for the columns into a table of the DBMS based on the mapping instructions for the selective data to be analyzed and processed within the DBMS.
Dependencies are inferred from the claim text.