# US 2024/0176648 A1 · Platform and source agnostic data processing for structured and unstructured data sources

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0176648 A1
- Document ID: US20240176648A1
- Status: Published application
- Kind: A1
- Application number: 18/404,017
- Filed: 2024-01-04
- Published: 2024-05-30
- Earliest claimed: 2021-06-24
- Assignees: Capitol One Services, LLC
- Applicants: Capitol One Services, LLC
- Inventors: Timothy Haggerty; Yuting Zhou; Venu Kumar Nannapaneni; Pravin Nair; Hussein Ali Khalif Samao
- Web page: https://patentgrep.com/patent/US20240176648A1

## CPC

- G06F 9/48: Program initiating; Program switching, e.g. by interrupt
- G06F 16/256: {in federated or virtual databases}
- G06F 16/24524: {Access plan code generation and invalidation; Reuse of access plans}
- G06F 16/2471: {Distributed queries}
- G06F 16/25: Integrating or interfacing systems involving database management systems
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Data queries that are agnostic to any particular data source may include a data source alias. The data source alias may be replaced with a data source identifier to obtain a data query configured for a target data source. Data processing jobs may be agnostic to any particular data processing platform. A data processing job may include a data processing task that is agnostic to any particular data processing platform. A code library may provide platform-specific code configured to implement a data processing task on a data processing platform. A data query configured for a particular data source and a data processing task configured for a particular data processing platform may be used to create a data processing job. Configurations that restrict execution of a data processing job to execution via an interactive development environment may be removed to allow its execution directly at the data processing platform itself.

## Claims

### Claim 1

A computer-implemented method comprising:
receiving a platform-agnostic data processing job;
obtaining, for a target data processing platform and based on the platform-agnostic data processing job, at least one platform-specific data processing job;
creating, for the target data processing platform and using the platform-specific data processing job, a restricted platform-specific data processing job that is restricted to execution within an interactive development environment (IDE);
obtaining an unrestricted platform-specific data processing job configured for execution outside of the IDE at least by removing, from the restricted platform-specific data processing job, one or more configurations that restrict execution of the restricted platform-specific data processing job to execution within the IDE; and
causing execution, outside of the IDE, of the unrestricted platform-specific data processing job at the target data processing platform.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1, wherein the obtaining the at least one platform-specific data processing job comprises retrieving, from a code library, platform-specific code configured to perform at least one data processing task at the target data processing platform, wherein the code library comprises first code configured to perform at least one data processing task at a first data processing platform of a first type and second code configured to perform the at least one data processing task at a second data processing platform of a second type that is different from the first type.

### Claim 3 (depends on 1)

The computer-implemented method of claim 1, wherein the removing the one or more configurations from the restricted platform-specific data processing job comprises at least one of:
modifying at least one of the one or more configurations of the restricted platform-specific data processing job; or
removing, from the restricted platform-specific data processing job, at least one of:
at least one formatting element associated with the IDE;
at least one input element associated with an input function of the IDE; or
at least one output element associated with an output function of the IDE.

### Claim 4 (depends on 1)

The computer-implemented method of claim 1, further comprising storing, in a version control repository, the platform-agnostic data processing job, wherein the version control repository is accessible to each of a data processing job development environment and a data processing job production environment.

### Claim 5 (depends on 1)

The computer-implemented method of claim 1, wherein the creating the platform-specific data processing job comprises creating the platform-specific data processing job further using a view definition that defines, for a target data source, a first data view that corresponds to a second data view of a second data source.

### Claim 6 (depends on 1)

The computer-implemented method of claim 1, wherein the at least one platform-agnostic data processing job comprises at least one platform-agnostic data processing task comprising one or more of an extraction task, a transform task, a formatting task, an encryption task, a tokenization task, or a scheduling task.

### Claim 7 (depends on 1)

The computer-implemented method of claim 1, further comprising:
receiving a data source-agnostic data query comprising a data source alias; and
creating, for a target data source, a data source-specific data query at least by replacing, using an alias mapping and based on the target data source, the data source alias with a data source identifier that indicates the target data source;
wherein the creating the restricted platform-specific data processing job comprises creating the restricted platform-specific data processing job further based on the data source-specific data query;
wherein the alias mapping comprises at least one of:
a first mapping between a first data source alias and a first data source identified of a first data source comprising a data warehouse of structured data; or
a second mapping between a second alias and a second data source identifier of a second data source comprising a data lake of unstructured data; and
wherein the target data processing platform accesses, during execution of the unrestricted platform-specific data processing job and based on the data source-specific data query, the target data source.

### Claim 8

A system comprising:
one or more processors; and
memory storing computer-readable instructions that, when executed by the one or more processors, cause the system to:
receive a platform-agnostic data processing job;
obtain, for a target data processing platform and based on the platform-agnostic data processing job, at least one platform-specific data processing job;
create, for the target data processing platform and using the platform-specific data processing job, a restricted platform-specific data processing job that is restricted to execution within an interactive development environment (IDE);
obtain an unrestricted platform-specific data processing job configured for execution outside of the IDE at least by removing, from the restricted platform-specific data processing job, one or more configurations that restrict execution of the restricted platform-specific data processing job to execution within the IDE; and
cause execution, outside of the IDE, of the unrestricted platform-specific data processing job at the target data processing platform.

### Claim 9 (depends on 8)

The system of claim 8, wherein the instructions, when executed by the one or more processors, cause the system to obtain the at least one platform-specific data processing job at least by retrieving, from a code library, platform-specific code configured to perform at least one data processing task at the target data processing platform, wherein the code library comprises first code configured to perform at least one data processing task at a first data processing platform of a first type and second code configured to perform the at least one data processing task at a second data processing platform of a second type that is different from the first type.

### Claim 10 (depends on 8)

The system of claim 8, wherein the instructions, when executed by the one or more processors, cause the system to remove the one or more configurations from the restricted platform-specific data processing job at least by:
modifying at least one of the one or more configurations of the restricted platform-specific data processing job; or
removing, from the restricted platform-specific data processing job, at least one of:
at least one formatting element associated with the IDE;
at least one input element associated with an input function of the IDE; or
at least one output element associated with an output function of the IDE.

### Claim 11 (depends on 8)

The system of claim 8, wherein the instructions, when executed by the one or more processors, further cause the system to store, in a version control repository, the platform-agnostic data processing job, wherein the version control repository is accessible to each of a data processing job development environment and a data processing job production environment.

### Claim 12 (depends on 8)

The system of claim 8, wherein the instructions, when executed by the one or more processors, cause the system to create the platform-specific data processing job at least by creating the platform-specific data processing job further using a view definition that defines, for a target data source, a first data view that corresponds to a second data view of a second data source.

### Claim 13 (depends on 8)

The system of claim 8, wherein the at least one platform-agnostic data processing job comprises at least one platform-agnostic data processing task comprising one or more of an extraction task, a transform task, a formatting task, an encryption task, a tokenization task, or a scheduling task.

### Claim 14 (depends on 8)

The system of claim 8, wherein the instructions, when executed by the one or more processors, further cause the system to:
receive a data source-agnostic data query comprising a data source alias; and
create, for a target data source, a data source-specific data query at least by replacing, using an alias mapping and based on the target data source, the data source alias with a data source identifier that indicates the target data source;
wherein the creating the restricted platform-specific data processing job comprises creating the restricted platform-specific data processing job further based on the data source-specific data query; and
wherein the alias mapping comprises at least one of:
a first mapping between a first data source alias and a first data source identified of a first data source comprising a data warehouse of structured data; or
a second mapping between a second alias and a second data source identifier of a second data source comprising a data lake of unstructured data; and
wherein the target data processing platform accesses, during execution of the unrestricted platform-specific data processing job and based on the data source-specific data query, the target data source.

### Claim 15

A non-transitory computer-readable medium storing instructions that, when executed, cause:
receiving a platform-agnostic data processing job;
obtaining, for a target data processing platform and based on the platform-agnostic data processing job, at least one platform-specific data processing job;
creating, for the target data processing platform and using the platform-specific data processing job, a restricted platform-specific data processing job that is restricted to execution within an interactive development environment (IDE);
obtaining an unrestricted platform-specific data processing job configured for execution outside of the IDE at least by removing, from the restricted platform-specific data processing job, one or more configurations that restrict execution of the restricted platform-specific data processing job to execution within the IDE; and
causing execution, outside of the IDE, of the unrestricted platform-specific data processing job at the target data processing platform.

### Claim 16 (depends on 15)

The non-transitory computer-readable medium if claim 15, wherein the obtaining the at least one platform-specific data processing job comprises retrieving, from a code library, platform-specific code configured to perform at least one data processing task at the target data processing platform, wherein the code library comprises first code configured to perform at least one data processing task at a first data processing platform of a first type and second code configured to perform the at least one data processing task at a second data processing platform of a second type that is different from the first type.

### Claim 17 (depends on 15)

The non-transitory computer-readable medium if claim 15, wherein the removing the one or more configurations from the restricted platform-specific data processing job comprises at least one of:
modifying at least one of the one or more configurations of the restricted platform-specific data processing job; or
removing, from the restricted platform-specific data processing job, at least one of:
at least one formatting element associated with the IDE;
at least one input element associated with an input function of the IDE; or
at least one output element associated with an output function of the IDE.

### Claim 18 (depends on 15)

The non-transitory computer-readable medium if claim 15, wherein the instructions, when executed, further cause storing, in a version control repository, the platform-agnostic data processing job, wherein the version control repository is accessible to each of a data processing job development environment and a data processing job production environment.

### Claim 19 (depends on 15)

The non-transitory computer-readable medium if claim 15, wherein the creating the platform-specific data processing job comprises creating the platform-specific data processing job further using a view definition that defines, for a target data source, a first data view that corresponds to a second data view of a second data source.

### Claim 20 (depends on 15)

The non-transitory computer-readable medium if claim 15, wherein the instructions, when executed, further cause:
receiving a data source-agnostic data query comprising a data source alias; and
creating, for a target data source, a data source-specific data query at least by replacing, using an alias mapping and based on the target data source, the data source alias with a data source identifier that indicates the target data source;
wherein the creating the restricted platform-specific data processing job comprises creating the restricted platform-specific data processing job further based on the data source-specific data query; and
wherein the alias mapping comprises at least one of:
a first mapping between a first data source alias and a first data source identified of a first data source comprising a data warehouse of structured data; or
a second mapping between a second alias and a second data source identifier of a second data source comprising a data lake of unstructured data; and
wherein the target data processing platform accesses, during execution of the unrestricted platform-specific data processing job and based on the data source-specific data query, the target data source.
