# US 2026/0203439 A1 · Enhancing data privacy in parquet data file systems

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0203439 A1
- Document ID: US20260203439A1
- Status: Published application
- Kind: A1
- Application number: 19/023,069
- Filed: 2025-01-15
- Published: 2026-07-16
- Earliest claimed: 2025-01-15
- Assignees: Mastercard Technologies Canada Ulc
- Applicants: Mastercard Technologies Canada Ulc
- Inventors: Murali Mani; John Hearty
- Web page: https://patentgrep.com/patent/US20260203439A1

## CPC

- G06F 21/6245: {Protecting personal data, e.g. for financial or medical purposes}
- G06F 12/0253: {Garbage collection, i.e. reclamation of unreferenced memory}
- G06F 16/125: {characterised by the use of retention policies (retention policies for HSM systems G06F16/185)}
- G06F 16/162: {Delete operations (erasing in storage systems G06F3/0652)}
- G06F 16/219: {Managing data history or versioning (querying versioned data G06F16/2474; querying temporal data G06F16/2477)}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Enhancing data privacy in parquet data file systems. One self-purging database server comprises a memory storing executable instructions, and an electronic processor communicatively coupled to the memory, the electronic processor configured to obtain a columnar storage file and a timestamp index file associated with the columnar storage file, wherein the columnar storage file includes one or more time-indexed data records, a time-indexed data record including a creation timestamp and a retention period, and perform an integrated garbage collection on the columnar storage file including automatically deleting one or more expired records in the columnar storage file based on the timestamp index file and retention periods of the one or more expired records.

## Claims

### Claim 1

A self-purging database server comprising:
a memory storing executable instructions; and
an electronic processor communicatively coupled to the memory, the electronic processor configured by the executable instructions to:
obtain a columnar storage file and a timestamp index file associated with the columnar storage file, wherein the columnar storage file includes one or more time-indexed data records, a time-indexed data record including a creation timestamp and a retention period relative to the creation timestamp; and
perform an integrated garbage collection on the columnar storage file including automatically deleting one or more expired records in the columnar storage file based on the timestamp index file and retention periods of the one or more expired records.

### Claim 2 (depends on 1)

The self-purging database server of claim 1, wherein, to perform the integrated garbage collection, the electronic processor is further configured to:
identify a candidate file among a plurality of columnar storage files based on a timestamp index file associated with the candidate file;
check each of one or more time-indexed data records in the candidate file based on the retention period to identify one or more expired records in the candidate file; and
delete the one or more expired records in the candidate file by creating a new file, the new file excluding the one or more expired records from the candidate file.

### Claim 3 (depends on 2)

The self-purging database server of claim 2, wherein the timestamp index file associated with the candidate file includes a maximum timestamp and a minimum timestamp, and wherein to identify the candidate file, the electronic processor is further configured to:
determine that the candidate file includes any time-indexed data records that include the creation timestamp that is on or between the maximum timestamp and the minimum timestamp.

### Claim 4 (depends on 1)

The self-purging database server of claim 1, wherein, to perform the integrated garbage collection, the electronic processor is further configured to:
consolidate delta files, the delta files storing changes to the one or more time-indexed data records before the integrated garbage collection, wherein a new file excluding the one or more expired records is created based on the consolidated delta files.

### Claim 5 (depends on 1)

The self-purging database server of claim 1, wherein, to perform the integrated garbage collection, the electronic processor is further configured to:
detect whether a trigger event occurs, wherein the trigger event includes one of a size of a delta file exceeding a threshold, a data retention policy being updated, a manual request being received, or a scheduled maintenance taking place, and
responsive to detecting the trigger event occurs, perform the integrated garbage collection.

### Claim 6 (depends on 1)

The self-purging database server of claim 1, wherein, to perform the integrated garbage collection, the electronic processor is further configured to:
create a new file excluding a sensitive data record based on a pre-determined deletion timestamp, wherein the pre-determined deletion timestamp is added to the sensitive data record based on a data privacy requirement.

### Claim 7 (depends on 1)

The self-purging database server of claim 1, wherein the columnar storage file is a file in Parquet format.

### Claim 8

A non-transitory computer-readable medium storing instructions executable by a device to:
obtain a columnar storage file and a timestamp index file associated with the columnar storage file, wherein the columnar storage file includes one or more time-indexed data records, a time-indexed data record including a creation timestamp and a retention period relative to the creation timestamp; and
perform an integrated garbage collection on the columnar storage file including automatically deleting one or more expired records in the columnar storage file based on the timestamp index file and retention periods of the one or more expired records.

### Claim 9 (depends on 8)

The non-transitory computer-readable medium of claim 8, wherein to perform the integrated garbage collection, the non-transitory computer-readable medium stores instructions executable by the device to further:
identify a candidate file among a plurality of columnar storage files based on a timestamp index file associated with the candidate file;
check each of one or more time-indexed data records in the candidate file based on the retention period to identify one or more expired records in the candidate file; and
delete the one or more expired records in the candidate file by creating a new file, the new file excluding the one or more expired records from the candidate file.

### Claim 10 (depends on 9)

The non-transitory computer-readable medium of claim 9, wherein the timestamp index file associated with the candidate file includes a maximum timestamp and a minimum timestamp, and wherein to identify the candidate file, the non-transitory computer-readable medium stores instructions executable by the device to further:
determine that the candidate file includes any time-indexed data records that include the creation timestamp that is on or between the maximum timestamp and the minimum timestamp.

### Claim 11 (depends on 8)

The non-transitory computer-readable medium of claim 8, wherein to perform the integrated garbage collection, the non-transitory computer-readable medium stores instructions executable by the device to further:
consolidate delta files, the delta files storing changes to the one or more time-indexed data records before the integrated garbage collection, wherein a new file excluding the one or more expired records is created based on the consolidated delta files.

### Claim 12 (depends on 8)

The non-transitory computer-readable medium of claim 8, wherein to perform the integrated garbage collection, the non-transitory computer-readable medium of claim stores instructions executable by the device to further:
detect whether a trigger event occurs, wherein the trigger event includes one of a size of a delta file exceeding a threshold, a data retention policy being updated, a manual request being received, or a scheduled maintenance taking place, and
responsive to detecting the trigger event occurs, perform the integrated garbage collection.

### Claim 13 (depends on 8)

The non-transitory computer-readable medium of claim 8, wherein to perform the integrated garbage collection, the non-transitory computer-readable medium of claim stores instructions executable by the device to further:
create a new file excluding a sensitive data record based on a pre-determined deletion timestamp, wherein the pre-determined deletion timestamp is added to the sensitive data record based on a data privacy requirement.

### Claim 14 (depends on 8)

The non-transitory computer-readable medium of claim 8, wherein the columnar storage file is a file in Parquet format.

### Claim 15

A self-purging system comprising:
a timestamp indexer configured to create a timestamp index file associated with a columnar storage file, wherein the columnar storage file includes one or more time-indexed data records, a time-indexed data record including a creation timestamp and a retention period relative to the creation timestamp; and
a self-purging apparatus configured to:
perform an integrated garbage collection on the columnar storage file including automatically deleting one or more expired records in the columnar storage file based on the timestamp index file and retention periods of the one or more expired records.

### Claim 16 (depends on 15)

The self-purging system of claim 15, wherein to perform the integrated garbage collection, the self-purging apparatus is further configured to:
identify a candidate file among a plurality of columnar storage files based on a timestamp index file associated with the candidate file;
check each of one or more time-indexed data records in the candidate file based on the retention period to identify one or more expired records in the candidate file; and
delete the one or more expired records in the candidate file by creating a new file, the new file excluding the one or more expired records from the candidate file.

### Claim 17 (depends on 16)

The self-purging system of claim 16, wherein the timestamp index file associated with the candidate file includes a maximum timestamp and a minimum timestamp, and wherein to identify the candidate file, the self-purging apparatus is further configured to:
determine that the candidate file includes any time-indexed data records that include the creation timestamp that is on or between the maximum timestamp and the minimum timestamp.

### Claim 18 (depends on 16)

The self-purging system of claim 16, wherein to perform the integrated garbage collection, the self-purging apparatus is further configured to:
detect whether a trigger event occurs, wherein the trigger event includes one of a size of a delta file exceeding a threshold, a data retention policy being updated, a manual request being received, or a scheduled maintenance taking place, and
responsive to detecting the trigger event occurs, perform the integrated garbage collection.

### Claim 19 (depends on 15)

The self-purging system of claim 15, further comprising:
a file organizer configured to arrange the one or more time-indexed data records in the columnar storage file based on timestamps using techniques including at least one of OPTIMIZE and ZORDER.

### Claim 20 (depends on 15)

The self-purging system of claim 15, further comprising:
an audit log repository configured to store records of deletion of the one or more expired records.
