# US 2021/0279043 A1 · Generation of optimized logic from a schema

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0279043 A1
- Document ID: US20210279043A1
- Status: Published application
- Kind: A1
- Application number: 17/025,751
- Filed: 2020-09-18
- Published: 2021-09-09
- Earliest claimed: 2020-03-06
- Assignees: Ab Initio Technology LLC
- Applicants: Ab Initio Technology LLC
- Inventors: Jonah Egenolf; Marshall A. Isman; Ian Schechter
- Web page: https://patentgrep.com/patent/US20210279043A1

## CPC

- G06F 16/2423: {Interactive query statement specification based on a database schema}
- G06F 16/254: {Extract, transform and load [ETL] procedures, e.g. ETL data flows in data warehouses}
- G06F 8/34: Graphical or visual programming
- G06F 8/36: Software reuse
- G06F 8/38: for implementing user interfaces
- G06F 16/211: {Schema design and management}
- G06F 16/2365: {Ensuring data consistency and integrity}
- G06F 16/2428: {Query predicate definition using graphical user interfaces, including menus and forms (G06F16/2423 takes precedence)}
- G06F 16/24524: {Access plan code generation and invalidation; Reuse of access plans}
- G06F 16/24526: {Internal representations for queries}
- G06F 16/2453: Query optimisation
- G06F 16/24544: {Join order optimisation}
- G06F 16/24545: {Selectivity estimation or determination}
- G06F 16/288: {Entity relationship models}
- G06F 16/81: Indexing, e.g. XML tags; Data structures therefor; Storage structures
- G06F 16/9024: {Graphs; Linked lists (G06F16/9027 takes precedence)}
- G06F 16/9027: {Trees}
- G06Q 10/10: Office automation; Time management
- G06Q 30/0243: {Comparative campaigns}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR

## Abstract

A method includes accessing a schema that specifies relationships among datasets, computations on the datasets, or transformations of the datasets, selecting a dataset from among the datasets, and identifying, from the schema, other datasets that are related to the selected dataset. Attributes of the datasets are identified, and logical data representing the identified attributes and relationships among the attributes is generated. The logical data is provided to a development environment, which provides access to portions of the logical data representing the identified attributes. A specification that specifies at least one of the identified attributes in performing an operation is received from the development environment. Based on the specification and the relationships among the identified attributes represented by the logical data, a computer program is generated to perform the operation by accessing, from storage, at least one dataset having the at least one of the attributes specified in the specification.

## Claims

### Claim 1

A method implemented by a data processing system for providing a development environment and storage that stores datasets having one or more attributes, and with the development environment providing access to the one or more attributes of the datasets, including:
accessing a schema that specifies relationships among datasets represented in the schema, one or more computations on one or more of the datasets, or one or more transformations of one or more of the datasets;
identifying, from among the datasets, a plurality of the datasets in storage, by:
selecting a dataset from among the datasets; and
identifying, from the schema, one or more other datasets that are related to the selected dataset;
identifying attributes of the plurality of the datasets;
generating logical data representing identified attributes of the plurality of the datasets and further representing one or more relationships among the attributes;
providing, to a development environment, the logical data;
providing, by the development environment, access to one or more portions of the logical data representing the identified attributes of the plurality of the datasets;
receiving, from the development environment, a specification that specifies at least one of the identified attributes in performing an operation; and
based on the specification and on the one or more relationships among the identified attributes represented by the logical data, generating a computer program that is configured to perform the operation by accessing, from storage, at least one dataset from the plurality, with the at least one dataset accessed having the at least one of the attributes specified in the specification.

### Claim 2 (depends on 1)

The method of claim 1, wherein the development environment provides access to the one or more portions of the logical data without accessing the plurality of datasets from storage.

### Claim 3 (depends on 1)

The method of claim 1, comprising:
identifying a dataset from the plurality of datasets including the at least one of the attributes specified in the specification; and
accessing, from storage, the identified dataset.

### Claim 4 (depends on 1)

The method of claim 1, comprising executing the computer program using the at least one dataset accessed from storage.

### Claim 5 (depends on 1)

The method of claim 1, comprising optimizing the computer program to produce an optimized computer program that is configured to perform the operation by accessing, from storage, only those datasets in the plurality of datasets having the at least one of the attributes specified in the specification.

### Claim 6 (depends on 1)

The method of claim 1, wherein the one or more attributes include field names of the plurality of the datasets.

### Claim 7 (depends on 1)

The method of claim 1, wherein the one or more attributes include information for accessing the plurality of the datasets in storage.

### Claim 8 (depends on 1)

The method of claim 1, comprising identifying, from the schema, one or more parameters for joining the selected dataset and the one or more other datasets.

### Claim 9 (depends on 8)

The method of claim 8, wherein the one or more parameters include a key for joining the selected dataset and at least one of the one or more other datasets.

### Claim 10 (depends on 1)

The method of claim 1, comprising receiving, from a client device, selection data specifying the selected dataset.

### Claim 11 (depends on 1)

The method of claim 1, wherein the selected dataset comprises a root node of the logical data, and wherein at least one of the one or more other datasets are joined to the selected dataset.

### Claim 12 (depends on 1)

The method of claim 1, wherein the one or more computations on one or more of the datasets or one or more transformations of one or more of the datasets define a virtual field for at least one of the plurality of the datasets.

### Claim 13 (depends on 1)

The method of claim 1, comprising generating, based on the specification and on the one or more relationships among the identified attributes represented by the logical data, an executable dataflow graph that is configured to perform the operation, wherein the executable dataflow graph includes at least one of the one or more attributes as an input.

### Claim 14 (depends on 1)

The method of claim 1, comprising removing from the computer program an operation to access, from storage, at least one dataset in the plurality of datasets that does not include the at least one of the attributes specified in the specification.

### Claim 15 (depends on 1)

The method of claim 1, wherein the computer program is configured to access, from storage, at least some data from the plurality by a select statement, wherein the select statement is minimized to select only the at least one of the attributes specified in the specification.

### Claim 16 (depends on 1)

The method of claim 1, wherein the development environment reads the logical data as a data source.

### Claim 17

A system for providing a development environment and storage that stores datasets having one or more attributes, and with the development environment providing access to the one or more attributes of the datasets, including:
one or more processors and one or more storage devices storing instructions that are operable, when executed by the one or more processors, to cause the one or more processors to perform operations comprising:
accessing a schema that specifies relationships among datasets represented in the schema, one or more computations on one or more of the datasets, or one or more transformations of one or more of the datasets;
identifying, from among the datasets, a plurality of the datasets in storage, by:
selecting a dataset from among the datasets; and
identifying, from the schema, one or more other datasets that are related to the selected dataset;
identifying attributes of the plurality of the datasets;
generating logical data representing identified attributes of the plurality of the datasets and further representing one or more relationships among the attributes;
providing, to a development environment, the logical data;
providing, by the development environment, access to one or more portions of the logical data representing the identified attributes the plurality of the datasets;
receiving, from the development environment, a specification that specifies at least one of the identified attributes in performing an operation; and
based on the specification and on the one or more relationships among the identified attributes represented by the logical data, generating a computer program that is configured to perform the operation by accessing, from storage, at least one dataset from the plurality, with the at least one dataset accessed having the at least one of the attributes specified in the specification.

### Claim 18 (depends on 17)

The system of claim 17, wherein the computer program is configured to access, from storage, only those datasets having the at least one of the attributes specified in the specification.

### Claim 19

A non-transitory computer-readable storage medium storing instructions for causing a computing system to:
access a schema that specifies relationships among datasets represented in the schema, one or more computations on one or more of the datasets, or one or more transformations of one or more of the datasets;
identify, from among the datasets, a plurality of the datasets in storage, by:
selecting a dataset from among the datasets; and
identifying, from the schema, one or more other datasets that are related to the selected dataset;
identify attributes of the plurality of the datasets;
generate logical data representing identified attributes of the plurality of the datasets and further representing one or more relationships among the attributes;
provide, to a development environment, the logical data;
provide, by the development environment, access to one or more portions of the logical data representing the identified attributes the plurality of the datasets;
receive, from the development environment, a specification that specifies at least one of the identified attributes in performing an operation; and
based on the specification and on the one or more relationships among the identified attributes represented by the logical data, generate a computer program that is configured to perform the operation by accessing, from storage, at least one dataset from the plurality, with the at least one dataset accessed having the at least one of the attributes specified in the specification.

### Claim 20 (depends on 19)

The non-transitory computer-readable storage medium of claim 19, wherein the computer program is configured to access, from storage, only those datasets having the at least one of the attributes specified in the specification.
