# US 2023/0409522 A1 · Scalable and secure cross region and optimized file system delta transfer for cloud scale

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0409522 A1
- Document ID: US20230409522A1
- Status: Published application
- Kind: A1
- Application number: 17/991,688
- Filed: 2022-11-21
- Published: 2023-12-21
- Earliest claimed: 2022-06-16
- Assignees: Oracle International Corporation
- Applicants: Oracle International Corporation
- Inventors: Satish Kumar Kashi Visvanathan; Sudarsan R. Piduri; Vikram Singh Bisht; Viggnesh Venugopal; John McClain
- Web page: https://patentgrep.com/patent/US20230409522A1

## CPC

- G06F 11/1451: {by selection of backup contents}
- G06F 9/505: {considering the load}
- G06F 11/1417: {Boot up procedures}
- G06F 11/1464: {for networked environments}
- G06F 11/2023: {Failover techniques}
- G06F 11/2028: {eliminating a faulty processor or activating a spare}
- G06F 11/2038: {with a single idle spare processing component}
- G06F 11/2094: {Redundant storage or storage space (G06F11/2056 takes precedence)}
- G06F 11/2097: {maintaining the standby controller/processing unit updated (initialisation or re-synchronisation thereof G06F11/1658 and subgroups)}
- G06F 16/11: File system administration, e.g. details of archiving or snapshots (error detection or correction of the data by redundancy in operations G06F11/14)
- G06F 16/119: {Details of migration of file systems (migration mechanisms in storage systems G06F3/0647)}
- G06F 16/128: {Details of file system snapshots on the file-level, e.g. snapshot creation, administration, deletion (error detection or correction of the data by redundancy in operations or in hardware G06F11/14, G06F11/16)}
- G06F 16/1756: {based on delta files}
- G06F 16/178: Techniques for file synchronisation in file systems
- G06F 16/1844: {Management specifically adapted to replicated file systems}
- G06F 16/185: Hierarchical storage management [HSM] systems, e.g. file migration or policies thereof (details of archiving G06F16/11)
- G06F 16/2365: {Ensuring data consistency and integrity}
- G06F 16/27: Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
- G06F 21/602: {Providing cryptographic facilities or services}
- G06F 21/6218: {to a system of files or objects, e.g. local or distributed file system or database}
- H04L 9/0819: {Key transport or distribution, i.e. key establishment techniques where one party creates or otherwise obtains a secret value, and securely transfers it to the other(s) (network architectures or network communication protocols for key distribution in a packet data network H04L63/062)}
- H04L 9/0836: {using tree structure or hierarchical structure}
- H04L 9/0891: {Revocation or update of secret information, e.g. encryption key update or rekeying}
- H04L 9/0894: {Escrow, recovery or storing of secret information, e.g. secret key escrow or cryptographic key storage}
- H04L 9/14: using a plurality of keys or algorithms
- H04L 9/3228: {One-time or temporary data, i.e. information which is sent for every authentication or authorization, e.g. one-time-password, one-time-token or one-time-key}
- G06F 11/2048: {where the redundant components share neither address space nor persistent storage}
- G06F 16/1774: {Locking methods, e.g. locking methods for file systems allowing shared and concurrent access to files}
- G06F 16/2246: {Trees, e.g. B+trees}
- G06F 2201/84: Using snapshots, i.e. a logical point-in-time copy of the data
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

Novel techniques for end-to-end file storage replication and security between file systems in different cloud infrastructure regions are disclosed herein. In one embodiment, a file storage service generates deltas between snapshots in a source file system, and transfers the deltas and associated data through a high-throughput object storage to recreate a new snapshot in a target file system located in a different region during disaster recovery. The file storage service utilizes novel techniques to achieve scalable, reliable, and restartable end-to-end replication. Novel techniques are also described to ensure a secure transfer of information and consistency during the end-to-end replication.

## Claims

### Claim 1

A method, comprising:
generating snapshot deltas between a first snapshot and a second snapshot of a source file system located in a source region, wherein the snapshot deltas are differences between the first snapshot and the second snapshot, and the second snapshot is created later than the first snapshot;
encrypting the snapshot deltas using a session encryption key valid for a session;
uploading the encrypted snapshot deltas, from the source file system to a first object storage located in a target region, wherein the source region and the target region are different regions;
downloading the encrypted snapshot deltas from the first object storage to a target file system concurrently upon detecting at least part of the encrypted snapshot deltas reaching the first object storage and before the source file system completes uploading all of the snapshot deltas;
decrypting the encrypted snapshot deltas using the session encryption key by the target file system; and
applying the decrypted snapshot deltas to a third snapshot of the target file system to create a fourth snapshot of the target file system, wherein the fourth snapshot is a duplicate of the second snapshot.

### Claim 2 (depends on 1)

The method of claim 1, wherein the session starts when the second snapshot is created in the source file system and ends when the fourth snapshot is created in the target file system.

### Claim 3 (depends on 1)

The method of claim 1, wherein the differences between the first snapshot and the second snapshot comprise binary-tree (B-tree) keys and values, and associated file data.

### Claim 4 (depends on 1)

The method of claim 1, further comprising transferring the session encryption key from the source file system to the target file system via a secured encryption process.

### Claim 5 (depends on 1)

The method of claim 1, wherein uploading the encrypted snapshot deltas comprises uploading a first portion of the encrypted snapshot deltas by a first upload thread in the source file system and uploading a second portion of the encrypted snapshot deltas by a second upload thread in the source file system, wherein the first upload thread and the second upload thread operate in parallel and independently.

### Claim 6 (depends on 5)

The method of claim 5, further comprises upon detecting a failure of the first upload thread in the source file system, a third upload thread in the source file system takes over the first upload thread to continue the uploading process.

### Claim 7 (depends on 1)

The method of claim 1, wherein downloading the encrypted snapshot deltas comprises downloading a first portion of the encrypted snapshot deltas by a first download thread in the target file system and downloading a second portion of the encrypted snapshot deltas by a second download thread in the target file system, wherein the first download thread and the second download thread operate in parallel and independently.

### Claim 8 (depends on 1)

The method of claim 1, further comprising reversing roles of the source file system and the target file system.

### Claim 9 (depends on 8)

The method of claim 8, wherein reversing the roles comprises uploading new snapshot deltas from the target file system to a second object storage located in the source region and downloading the new snapshot deltas from the second object storage to the source file system.

### Claim 10

A non-transitory computer-readable medium storing computer-executable instructions that, when executed by one or more processors, cause the one or more processors to perform operations comprising:
generating snapshot deltas between a first snapshot and a second snapshot of a source file system located in a source region, wherein the snapshot deltas are differences between the first snapshot and the second snapshot, and the second snapshot is created later than the first snapshot;
encrypting the snapshot deltas using a session encryption key valid for a session;
uploading the encrypted snapshot deltas, from the source file system to a first object storage located in a target region, wherein the source region and the target region are different regions;
downloading the encrypted snapshot deltas from the first object storage to a target file system concurrently upon detecting at least part of the encrypted snapshot deltas reaching the first object storage and before the source file system completes uploading all of the snapshot deltas;
decrypting the encrypted snapshot deltas using the session encryption key by the target file system; and
applying the decrypted snapshot deltas to a third snapshot of the target file system to create a fourth snapshot of the target file system, wherein the fourth snapshot is a duplicate of the second snapshot.

### Claim 11 (depends on 10)

The non-transitory computer-readable medium of claim 10, wherein the session starts when the second snapshot is created in the source file system and ends when the fourth snapshot is created in the target file system.

### Claim 12 (depends on 10)

The non-transitory computer-readable medium of claim 10, wherein generating the snapshot deltas and uploading the encrypted snapshot deltas are in different pipeline stages.

### Claim 13 (depends on 10)

The non-transitory computer-readable medium of claim 10, wherein uploading the encrypted snapshot deltas comprises uploading a first portion of the encrypted snapshot deltas by a first upload thread in the source file system and uploading a second portion of the encrypted snapshot deltas by a second upload thread in the source file system, wherein the first upload thread and the second upload thread operate in parallel and independently.

### Claim 14 (depends on 10)

The non-transitory computer-readable medium of claim 10, wherein downloading the encrypted snapshot deltas comprises downloading a first portion of the encrypted snapshot deltas by a first download thread in the target file system and downloading a second portion of the encrypted snapshot deltas by a second download thread in the target file system, wherein the first download thread and the second download thread operate in parallel and independently.

### Claim 15 (depends on 10)

The non-transitory computer-readable medium of claim 10, further comprising reversing roles of the source file system and the target file system by uploading new snapshot deltas from the target file system to a second object storage located in the source region and downloading the new snapshot deltas from the second object storage to the source file system.

### Claim 16

A system, comprising:
one or more processors; and
one or more non-transitory computer readable media storing computer-executable instructions that, when executed by the one or more processors, cause the system to perform:
generating snapshot deltas between a first snapshot and a second snapshot of a source file system located in a source region, wherein the snapshot deltas are differences between the first snapshot and the second snapshot, and the second snapshot is created later than the first snapshot;
encrypting the snapshot deltas using a session encryption key valid for a session;
uploading the encrypted snapshot deltas, from the source file system to a first object storage located in a target region, wherein the source region and the target region are different regions;
downloading the encrypted snapshot deltas from the first object storage to a target file system concurrently upon detecting at least part of the encrypted snapshot deltas reaching the first object storage and before the source file system completes uploading all of the snapshot deltas;
decrypting the encrypted snapshot deltas using the session encryption key by the target file system; and
applying the decrypted snapshot deltas to a third snapshot of the target file system to create a fourth snapshot of the target file system, wherein the fourth snapshot is a duplicate of the second snapshot.

### Claim 17 (depends on 16)

The system of claim 16, wherein the session starts when the second snapshot is created in the source file system and ends when the fourth snapshot is created in the target file system.

### Claim 18 (depends on 16)

The system of claim 16, further comprising transferring the session encryption key from the source file system to the target file system via a secured encryption process.

### Claim 19 (depends on 16)

The system of claim 16, wherein uploading the encrypted snapshot deltas comprises uploading a first portion of the encrypted snapshot deltas by a first upload thread in the source file system and uploading a second portion of the encrypted snapshot deltas by a second upload thread in the source file system, wherein the first upload thread and the second upload thread operate in parallel and independently.

### Claim 20 (depends on 16)

The system of claim 16, further comprising reversing roles of the source file system and the target file system by uploading new snapshot deltas from the target file system to a second object storage located in the source region and downloading the new snapshot deltas from the second object storage to the source file system.
