# US 10,375,034 B2 · Secured transfer of data between datacenters > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,375,034 B2 - Document ID: US10375034B2 - Status: Granted - Kind: B2 - Application number: 15/419,303 - Filed: 2017-01-30 - Published: 2018-08-02 - Granted: 2019-08-06 - Earliest claimed: 2017-01-30 - Assignees: salesforce.com, inc. - Applicants: salesforce.com, inc. - Inventors: Paul Eldridge - Web page: https://patentgrep.com/patent/US10375034B2 ## CPC - H04L 63/0428: {wherein the data content is protected, e.g. by encrypting or encapsulating the payload} - G06F 11/3006: {where the computing system is distributed, e.g. networked systems, clusters, multiprocessor systems (multiprogramming arrangements G06F9/46; allocation of resources G06F9/50)} - G06F 11/3409: {for performance assessment} - G06F 11/3433: {for load management (allocation of a server based on load conditions G06F9/505; load rebalancing G06F9/5083; redistributing the load in a network by a load balancer H04L67/1029)} - G06F 11/3442: {for planning or managing the needed capacity} - G06F 11/3452: {Performance evaluation by statistical analysis} - G06F 21/602: {Providing cryptographic facilities or services} - H04L 63/0272: {Virtual private networks} - H04L 63/0435: {wherein the sending and receiving network entities apply symmetric encryption, i.e. same key used for encryption and decryption (cryptographic mechanisms or cryptographic arrangements for symmetric key encryption H04L9/06)} - H04L 63/0485: {Networking architectures for enhanced packet encryption processing, e.g. offloading of IPsec packet processing or efficient security association look-up} - G06F 2201/81: Threshold - G06F 2221/2107: File encryption - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract In various embodiments, a method of transferring data between datacenters may be performed. The method may include running a first plurality of host programs and a first plurality of encryption units at a first datacenter. The method may further include establishing, between the first datacenter and a second datacenter, secure communication connections between each of the first plurality of encryption units and a corresponding one of a second plurality of encryption units running at the second datacenter. The method may further include transferring, by the first datacenter, data from the first plurality of host programs to a second plurality of host programs running at the second datacenter. ## Claims ### Claim 1 A method, comprising: running, at a first datacenter, a first plurality of host programs and a first plurality of encryption units; establishing, between the first datacenter and a second datacenter, secure communication connections between each of the first plurality of encryption units and a corresponding one of a second plurality of encryptions units running at the second datacenter; monitoring one or more performance metrics of the first plurality of encryption units; transferring, by the first datacenter, data from the first plurality of host programs to a second plurality of host programs running at the second datacenter, including by: receiving, by the first plurality of host programs, information indicative of the one or more performance metrics of the first plurality of encryption units; selecting, by the first plurality of host programs, a subset of the first plurality of encryption units to encrypt data from the first plurality of host programs, wherein the subset of the first plurality of encryption units is selected based on the information indicative of the one or more performance metrics of the first plurality of encryption units; sending data from the first plurality of host programs to the subset of the first plurality of encryption units; encrypting the data sent to the subset of the first plurality of encryption units to generate encrypted data; and sending, via the secure communication connections, the encrypted data from the subset of the first plurality of encryption units to the second plurality of encryption units. ### Claim 2 (depends on 1) The method of claim 1, further comprising: monitoring one or more levels of usage of the first plurality of encryption units; and modifying a number of encryption units in the first plurality of encryption units based on the one or more levels of usage. ### Claim 3 (depends on 2) The method of claim 2, wherein the modifying the number of encryption units comprises: sending a request to an orchestration host to instantiate additional encryption units at the first datacenter and the second datacenter. ### Claim 4 (depends on 1) The method of claim 1, further comprising: determining that at least one of the one or more performance metrics of a particular encryption unit of the first plurality of encryption units is below a particular threshold; in response to the determining, adjusting information indicative of the at least one performance metric of the particular encryption unit; and providing the information indicative of the at least one performance metric of the particular encryption unit to each of the first plurality of host programs. ### Claim 5 (depends on 1) The method of claim 1, further comprising: determining that a performance level of a particular encryption unit of the first plurality of encryption units is below a performance threshold; and in response to the determining, sending a request to an orchestration host to remove the particular encryption unit from the first plurality of encryption units. ### Claim 6 (depends on 1) The method of claim 1, further comprising: determining, based on the one or more performance metrics, ranking information corresponding to the first plurality of encryption units; and providing the information indicative of the one or more performance metrics of the first plurality of encryption units to the first plurality of host programs, wherein the information indicative of the one or more performance metrics includes the ranking information. ### Claim 7 (depends on 1) The method of claim 1, wherein the one or more performance metrics include, for a given encryption unit of the first plurality of encryption units, at least one of a processor utilization, a data transmission speed, or a status of a secure communication connection. ### Claim 8 (depends on 1) The method of claim 1, wherein the secure communication connections include a secure tunnel over a peer-to-peer connection between each of the first plurality of encryption units and the corresponding one of the second plurality of encryption units running at the second datacenter. ### Claim 9 (depends on 8) The method of claim 8, wherein each of the first plurality of encryption units and the second plurality of encryption units share a cryptographic key; and wherein the encrypting includes establishing the secure tunnels using the cryptographic key. ### Claim 10 A non-transitory, computer-readable medium having computer instructions stored thereon that are capable of being executed by a computer system to cause operations comprising: establishing secure communication connections between each of a first plurality of encryption units at a first datacenter and a corresponding one of a second plurality of encryption units at a second datacenter; providing, to a first plurality of host programs at the first datacenter, information indicative of one or more performance metrics of the first plurality of encryption units; transferring data from a first host program of the first plurality of host programs to a second host program of a second plurality of host programs at the second datacenter, wherein the transferring includes: receiving, at a first encryption unit of the first plurality of encryption units, data from the first host program, wherein the receiving is in response to the first host program selecting the first encryption unit to encrypt the data based on the information indicative of one or more performance metrics of the first encryption unit; encrypting, by the first encryption unit, the data to generate encrypted data; and sending, via a first secure communication connection of the secure communication connections, the encrypted data to a corresponding second encryption unit at the second datacenter; monitoring levels of usage of the first plurality of encryption units; and in response to a determination that the levels of usage exceed a particular threshold, sending a request to an orchestration host to add additional encryption units to the first plurality of encryption units. ### Claim 11 (depends on 10) The non-transitory, computer-readable medium of claim 10, wherein the encrypting includes using a parallel packet-processing algorithm to encrypt the data sent to the first encryption unit. ### Claim 12 (depends on 10) The non-transitory, computer-readable medium of claim 10, wherein the operations further comprise: monitoring the one or more performance metrics of the first plurality of encryption units; and determining ranking information for the first plurality of encryption units based on the one or more performance metrics. ### Claim 13 (depends on 12) The non-transitory, computer-readable medium of claim 12, wherein the operations further comprise: providing the information indicative of one or more performance metrics to the first plurality of host programs, wherein the information indicative of one or more performance metrics includes the ranking information for the first plurality of encryption units. ### Claim 14 (depends on 10) The non-transitory, computer-readable medium of claim 10, wherein each of the first plurality of encryption units share a cryptographic key; and wherein the encrypting comprises establishing a secure tunnel, using the cryptographic key, over a peer-to-peer connection between each of the first plurality of encryption units and the corresponding one of the second plurality of encryption units at the second datacenter. ### Claim 15 A system, comprising: a datacenter facility that includes: a plurality of computer systems; a plurality of storage subsystems that are configured to store data for a plurality of entities; and a network interface configured to communicate with a second datacenter facility; wherein at least one of the plurality of computer systems includes a non-transitory, computer-readable medium having program instructions stored thereon that are capable of being executed by the plurality of computer systems to perform operations, comprising: establishing secure communication connections, via the network interface, between each of a first plurality of encryption units executing at the datacenter facility and a corresponding one of a second plurality of encryption units at the second datacenter facility; providing, to a first plurality of host programs executing on one or more of the plurality of computer systems, information indicative of one or more performance metrics of the first plurality of encryption units; monitoring one or more performance metrics of the first plurality of encryption units; transferring data from a first host program of the first plurality of host programs, via the network interface, to a second host program of a second plurality of host programs executing at the second datacenter facility, wherein the transferring includes: receiving, by the first host program, information indicative of the one or more performance metrics of the first plurality of encryption units; receiving, at a first encryption unit of the first plurality of encryption units, data from the first host program, wherein the receiving is in response to the first host program selecting the first encryption unit to encrypt the data based on the information indicative of one or more performance metrics of the first encryption unit; encrypting, by the first encryption unit, the data to generate encrypted data; and sending, via a first secure communication connection of the secure communication connections, the encrypted data to a corresponding second encryption unit at the second datacenter facility. ### Claim 16 (depends on 15) The system of claim 15, wherein at least one of the first plurality of encryption units includes a virtual machine running on one or more of the plurality of computer systems. ### Claim 17 (depends on 15) The system of claim 15, wherein the secure communication connections include IPsec tunnels created over BGP peer-to-peer connections between the each of the first plurality of encryption units executing at the datacenter facility and the corresponding one of the second plurality of encryption units at the second datacenter facility. ### Claim 18 (depends on 15) The system of claim 15, wherein the operations further comprise: monitoring a transfer rate of the encrypted data; and based on the transfer rate, modify a number of encryption units in the first plurality of encryption units. ### Claim 19 A method, comprising: running, at a first datacenter, a first plurality of host programs and a first plurality of encryption units; establishing, between the first datacenter and a second datacenter, secure communication connections between each of the first plurality of encryption units and a corresponding one of a second plurality of encryptions units running at the second datacenter; transferring, by the first datacenter, data from the first plurality of host programs to a second plurality of host programs running at the second datacenter, including by: selecting a subset of the first plurality of encryption units to encrypt data from the first plurality of host programs, wherein the subset of the first plurality of encryption units is selected based on information indicative of one or more performance metrics of the first plurality of encryption units; sending data from the first plurality of host programs to the subset of the first plurality of encryption units; encrypting the data sent to the subset of the first plurality of encryption units to generate encrypted data; and sending, via the secure communication connections, the encrypted data from the subset of the first plurality of encryption units to the second plurality of encryption units; monitoring one or more levels of usage of the first plurality of encryption units; and modifying a number of encryption units in the first plurality of encryption units based on the one or more levels of usage.