# US 2022/0027372 A1 · Disk based hybrid transactional analytical processing system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0027372 A1
- Document ID: US20220027372A1
- Status: Published application
- Kind: A1
- Application number: 17/159,046
- Filed: 2021-01-26
- Published: 2022-01-27
- Earliest claimed: 2020-07-24
- Assignees: Sap SE
- Applicants: Sap SE
- Inventors: Ivan Schreter
- Web page: https://patentgrep.com/patent/US20220027372A1

## CPC

- G06F 16/2365: {Ensuring data consistency and integrity}
- G06F 16/24573: {using data annotations, e.g. user-defined metadata}
- G06F 16/221: {Column-oriented storage; Management thereof}
- G06F 16/2282: {Tablespace storage structures; Management thereof}
- G06F 16/2428: {Query predicate definition using graphical user interfaces, including menus and forms (G06F16/2423 takes precedence)}
- G06F 16/2455: Query execution
- G06F 16/24561: {Intermediate data storage techniques for performance improvement}
- G06F 16/248: Presentation of query results
- G06F 16/283: {Multi-dimensional databases or data warehouses, e.g. MOLAP or ROLAP}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A method for providing optimized support for transactional processing and analytical processing with minimal memory footprint may include storing, on a data page in a disk of a database system, a portion of one or more columns of data from a database table. A metadata associated with the data page may be stored on a metadata page in the disk of the database system. The metadata may include one or more byte ranges on the data page at which the portion of the one or more columns of data is stored. The database system may execute one or more queries by accessing, based at least on the metadata associated with the data page, a portion of the data page storing the portion of the one or more columns of data required by the one or more queries. Related systems and articles of manufacture are also provided.

## Claims

### Claim 1

A distributed data storage system, comprising:
at least one data processor; and
at least one memory storing instructions which, when executed by the at least one data processor, cause operations comprising:
storing, on a data page in a disk of a database system, one or more columns of data from a database table;
storing, on a metadata page in the disk of the database system, a metadata associated with the data page, the metadata including a byte range on the data page at which the one or more columns of data are stored; and
executing, by the database system, one or more queries including by accessing, based at least on the metadata associated with the data page, a portion of the data page storing the one or more columns of data required by the one or more queries.

### Claim 2 (depends on 1)

The system of claim 1, wherein the portion of the data page is accessed by at least loading, into a memory of the database system, the portion of the data page but not the data page in its entirety.

### Claim 3 (depends on 1)

The system of claim 1, further comprising:
receiving one or more rows of data;
storing, in a columnar buffer, the one or more rows of data decomposed into one or more individual cells corresponding to the one or more columns of data; and
in response to the columnar buffer exceeding a threshold capacity, generating the data page for storing the one or more columns of data.

### Claim 4 (depends on 1)

The system of claim 1, wherein the database system performs one or more input output (IO) operations in order to access the portion of the data page stored in the disk of the database system, and wherein the database system is configured to perform the one or more input output operations by asynchronously executing one or more coroutines.

### Claim 5 (depends on 1)

The system of claim 1, wherein the executing of the one or queries comprises:
reading, from the disk of the database system, the portion of the data page storing the one or more columns of data required by the one or more queries; and
scanning the one or more columns of data while the one or more columns of data are held in a cache of a central processing unit of the database system.

### Claim 6 (depends on 1)

The system of claim 1, wherein the executing of the one or more queries comprises:
adding, to a query set associated with a scan of the one or more columns of data from the database table, a first query scanning the one or more columns of data and a second query scanning the one or more columns of data;
storing, in a shared buffer, a first column set, a first predicate, and a first reference to a first result set reference associated with the first query;
storing, in the shared buffer set, a second column set, a second predicate, and a second reference to a second result set associated with the second query; and
in response to the one or more columns of data being loaded into the memory of the database system, scanning the one or more columns of data including by (i) evaluating the first predicate and the second predicate, (ii) sending, to the first result set, a first data from the one or more columns satisfying the first predicate, and (iii) sending, to the second result set, a second data from the one or more columns satisfying the second predicate.

### Claim 7 (depends on 6)

The system of claim 6, wherein the first query and the second query are added to the query set in response to the query set including less than a threshold quantity of queries permitted to scan the one or more columns of data from the database table.

### Claim 8 (depends on 7)

The system of claim 7, wherein the threshold quantity of queries permitted to scan the one or more columns of data is determined based at least on a capacity of a cache of a central processing unit of the database system.

### Claim 9 (depends on 1)

The system of claim 1, further comprising:
determining a load factor of the first data page, the load factor corresponding to a quantity of used space on the data page, and the load factor of the data page being determined based at least on (i) a quantity of rows in the data page visible to the one or more queries and/or (ii) one or more data definition language (DDL) executed to modify the database table.

### Claim 10 (depends on 5)

The system of claim 5, further comprising:
in response to the load factor of the data page exceeding a threshold value, splitting the data page into a plurality of data pages; and
in response to the load factor of the data page being below a threshold value, merging the data page with one or more neighboring data pages.

### Claim 11 (depends on 1)

The system of claim 1, wherein the one or more queries include one or more of a transactional processing query and an analytical processing query.

### Claim 12 (depends on 1)

The system of claim 1, wherein the disk of the database system comprises one or more solid state devices storing the first data page and the metadata page.

### Claim 13 (depends on 1)

The system of claim 1, further comprising:
caching, in a memory of the database system, the metadata associated with the data page.

### Claim 14 (depends on 1)

The system of claim 1, wherein the one or more columns of data are stored in the data page in a partition attribute across (PAX) format.

### Claim 15 (depends on 1)

The system of claim 1, wherein the metadata associated with the data page further includes a logical page number of the data page, a pointer to a cache frame containing the data page, a row identifier range of one or more rows of the database table stored on the data page, a metadata version, a column identifier of the one or more columns, a datatype of the one or more columns, and/or an encoding of the one or more columns.

### Claim 16

A computer-implemented method, comprising:
storing, on a data page in a disk of a database system, one or more columns of data from a database table;
storing, on a metadata page in the disk of the database system, a metadata associated with the data page, the metadata including a byte range on the data page at which the one or more columns of data are stored; and
executing, by the database system, one or more queries including by accessing, based at least on the metadata associated with the data page, a portion of the data page storing the one or more columns of data required by the one or more queries.

### Claim 17 (depends on 16)

The method of claim 16, further comprising:
receiving one or more rows of data;
storing, in a columnar buffer, the one or more rows of data decomposed into one or more individual cells corresponding to the one or more columns of data; and
in response to the columnar buffer exceeding a threshold capacity, generating the data page for storing the one or more columns of data.

### Claim 18 (depends on 16)

The method of claim 16, wherein the executing of the one or more queries comprises:
reading, from the disk of the database system, the portion of the data page storing the one or more columns of data required by the one or more queries; and
scanning the one or more columns of data while the one or more columns of data are held in a cache of a central processing unit of the database system.

### Claim 19 (depends on 16)

The method of claim 16, wherein the executing of the one or more queries comprises:
adding, to a query set associated with a scan of the one or more columns of data from the database table, a first query scanning the one or more columns of data and a second query scanning the one or more columns of data;
storing, in a shared buffer, a first column set, a first predicate, and a first reference to a first result set reference associated with the first query;
storing, in the shared buffer set, a second column set, a second predicate, and a second reference to a second result set associated with the second query; and
in response to the one or more columns of data being loaded into the memory of the database system, scanning the one or more columns of data including by (i) evaluating the first predicate and the second predicate, (ii) sending, to the first result set, a first data from the one or more columns satisfying the first predicate, and (iii) sending, to the second result set, a second data from the one or more columns satisfying the second predicate.

### Claim 20

A non-transitory computer readable medium storing instructions, which when executed by at least one data processor, result in operations comprising:
storing, on a data page in a disk of a database system, one or more columns of data from a database table;
storing, on a metadata page in the disk of the database system, a metadata associated with the data page, the metadata including a byte range on the data page at which the one or more columns of data are stored; and
executing, by the database system, one or more queries including by accessing, based at least on the metadata associated with the data page, a portion of the data page storing the one or more columns of data required by the one or more queries.
