# US 2025/0097290 A1 · Data pipeline orchestration for data-driven engineering > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2025/0097290 A1 - Document ID: US20250097290A1 - Status: Published application - Kind: A1 - Application number: 18/470,724 - Filed: 2023-09-20 - Published: 2025-03-20 - Earliest claimed: 2023-09-20 - Assignees: Sap SE - Applicants: Sap SE - Inventors: Fabian ARNDT; Enes OERDEK - Web page: https://patentgrep.com/patent/US20250097290A1 ## CPC - H04L 67/1095: Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) ## Abstract A system associated with data pipeline orchestration may include a data pipeline data store that contains, for each of a plurality of data pipelines, a series of data pipeline steps associated with a data pipeline use case. A data pipeline orchestration server may receive, from a data engineering operator, a selection of a data pipeline use case in the data pipeline data store. The data pipeline orchestration server may also receive first configuration information for the selected data pipeline use case and second configuration information, different than the first configuration information, for the selected data pipeline use case. The data pipeline orchestration server may then store representations of both the first configuration information and the second configuration information in connection with the selected data pipeline use case. Execution of the selected pipeline is then arranged in accordance with one of the first configuration information and the second configuration information. ## Claims ### Claim 1 A system associated with data pipeline orchestration, comprising: a data pipeline data store containing, for each of a plurality of data pipelines, a series of data pipeline steps associated with a data pipeline use case, wherein the series of data pipeline steps include: automatically downloading raw data from an internal enterprise data source; automatically performing extract, transform, load tasks; automatically performing data cleanup; and automatically storing information in a cloud-based data warehouse; and a data pipeline orchestration server, coupled to the data pipeline data store, including: a computer processor, and a computer memory storage device, coupled to the computer processor, that contains instructions that when executed by the computer processor enable the data pipeline orchestration server to: (i) receive, from a data engineering operator, a selection of a data pipeline use case in the data pipeline data store, (ii) receive first configuration information for the selected data pipeline use case, (iii) receive second configuration information, different than the first configuration information, for the selected data pipeline use case, (iv) store representations of both the first configuration information and the second configuration information in connection with the selected data pipeline use case, and (v) arrange for an automatic execution of the selected pipeline in accordance with one of the first configuration information and the second configuration information, wherein a data pipeline use case associated with one data engineering team of an enterprise is shared with another data engineering team of the enterprise via a platform and cloud-based service for software development and version control. ### Claim 2 (depends on 1) The system of claim 1, wherein at least one of the series of data pipeline steps further comprises all of: data cleanup; data processing; deployment of a structure; and data uploading. ### Claim 3 (depends on 1) The system of claim 1, wherein the first configuration information includes information associated with all of: (i) credentials, (ii) data sources, and (iii) configuration of further calculations. ### Claim 4 (canceled) ### Claim 5 (canceled) ### Claim 6 (depends on 1) The system of claim 1, wherein the data pipeline use case is deployed to all of: (i) a development system, (ii) a test system, and (iii) a production system. ### Claim 7 (depends on 1) The system of claim 1, wherein execution of the selected pipeline is further performed in accordance with data pipeline scheduler information. ### Claim 8 A computer-implemented method associated with data pipeline orchestration, comprising: receiving, at a computer processor of a data pipeline orchestration server from a data engineering operator, a selection of a data pipeline use case in a data pipeline data store, wherein the data pipeline data store contains, for each of a plurality of data pipelines, a series of data pipeline steps associated with a data pipeline use case, wherein the series of data pipeline steps include: automatically downloading raw data from an internal enterprise data source; automatically performing extract, transform, load tasks; automatically performing data cleanup; and automatically storing information in a cloud-based data warehouse; receiving first configuration information for the selected data pipeline use case; receiving second configuration information, different than the first configuration information, for the selected data pipeline use case; storing representations of both the first configuration information and the second configuration information in connection with the selected data pipeline use case; and arranging for an automatic execution of the selected pipeline in accordance with one of the first configuration information and the second configuration information, wherein a data pipeline use case associated with one data engineering team of an enterprise is shared with another data engineering team of the enterprise via a platform and cloud-based service for software development and version control. ### Claim 9 (depends on 8) The method of claim 8, wherein at least one of the series of data pipeline steps further comprises all of: data processing; deployment of a structure; and data uploading. ### Claim 10 (depends on 8) The method of claim 8, wherein the first configuration information includes information associated with all of: (i) credentials, (ii) data sources, and (iii) configuration of further calculations. ### Claim 11 (canceled) ### Claim 12 (canceled) ### Claim 13 (depends on 8) The method of claim 8, wherein a data pipeline use case is deployed to all of: (i) a development system, (ii) a test system, and (iii) a production system. ### Claim 14 (depends on 8) The method of claim 8, wherein execution of the selected pipeline is further performed in accordance with data pipeline scheduler information. ### Claim 15 A non-transitory, computer readable medium having executable instructions stored therein to implement a method associated with data pipeline orchestration, the method comprising: receiving, at a computer processor of a data pipeline orchestration server from a data engineering operator, a selection of a data pipeline use case in a data pipeline data store, wherein the data pipeline data store contains, for each of a plurality of data pipelines, a series of data pipeline steps associated with a data pipeline use case, wherein the series of data pipeline steps include: automatically downloading raw data from an internal enterprise data source; automatically performing extract, transform, load tasks; automatically performing data cleanup; and automatically storing information in a cloud-based data warehouse; receiving first configuration information for the selected data pipeline use case; receiving second configuration information, different than the first configuration information, for the selected data pipeline use case; storing representations of both the first configuration information and the second configuration information in connection with the selected data pipeline use case; and arranging for an automatic execution of the selected pipeline in accordance with one of the first configuration information and the second configuration information, wherein a data pipeline use case associated with one data engineering team of an enterprise is shared with another data engineering team of the enterprise via a platform and cloud-based service for software development and version control. ### Claim 16 (depends on 15) The medium of claim 15, wherein at least one of the series of data pipeline steps further comprises all of: data processing; deployment of a structure; and data uploading. ### Claim 17 (depends on 15) The medium of claim 15, wherein the first configuration information includes information associated with all of: (i) credentials, (ii) data sources, and (iii) configuration of further calculations. ### Claim 18 (canceled) ### Claim 19 (depends on 15) The medium of claim 15, wherein the data pipeline use case is shared via a platform and cloud-based service for software development and version control and deployed to all of: (i) a development system, (ii) a test system, and (iii) a production system. ### Claim 20 (depends on 15) The medium of claim 15, wherein execution of the selected pipeline is further performed in accordance with data pipeline scheduler information.