Loading patent…
OwnerPremkumar Narayanaswamy, Vincent Martino +2inventors
InventorsPremkumar Narayanaswamy, Vincent Martino, Aswin Govindarajan, Balachandar Kandaswamy
Estimating the term…
A data engineering framework may support data management by integrating a configuration data store with electronic records for data framework pipelines. Each pipeline includes a data source and a cloud-based storage target. The framework interfaces with the configuration data store to perform metadata setups, define new pipelines, and generate configuration files based on developer input. It also creates batch shell scripts for new pipelines, which are executed by an automated job control system to seamlessly transfer data from the source to the cloud-based target. The framework automates the data engineering development pipeline, encompassing data extraction from source systems, transformation as needed, and loading into target systems or databases. Capabilities include audit balancing checks to ensure data accuracy, automatic table creation based on predefined schemas, and ease of adoption. Notably, the framework can be deployed with minimal development effort, reducing the time and resources required to automate data engineering processes.
A data engineering system for an enterprise, comprising:
A data engineering method for an enterprise, comprising:
A non-transitory, computer-readable medium storing instructions, that, when executed by a processor, cause the processor to perform a data engineering method for an enterprise, the method comprising:
Dependencies are inferred from the claim text.