# US 10,769,300 B2 · Data processing in a hybrid cluster environment

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,769,300 B2
- Document ID: US10769300B2
- Status: Granted
- Kind: B2
- Application number: 16/453,908
- Filed: 2019-06-26
- Published: 2019-10-17
- Granted: 2020-09-08
- Earliest claimed: 2018-03-08
- Assignees: International Business Machines Corporation
- Applicants: International Business Machines Corporation
- Inventors: Lawrence A. Greene; Yong Li; Ryan Pham; Xiaoyan Pu; Yeh-Heng Sheng
- Web page: https://patentgrep.com/patent/US10769300B2

## CPC

- G06F 21/6245: {Protecting personal data, e.g. for financial or medical purposes}
- G06F 9/4881: {Scheduling strategies for dispatcher, e.g. round robin, multi-level priority queues}
- G06F 9/5072: {Grid computing}
- G06F 9/5083: {Techniques for rebalancing the load in a distributed system}
- G06F 16/183: {Provision of network file services by network file servers, e.g. by using NFS, CIFS (network file access protocols H04L67/1097)}
- H04L 41/40: using virtualisation of network functions or resources, e.g. SDN or NFV entities
- H04L 41/5019: Ensuring fulfilment of SLA
- H04L 43/0876: Network utilisation, e.g. volume of load or congestion level
- H04L 43/20: the monitoring system or the monitored elements being virtualised, abstracted or software-defined entities, e.g. SDN or NFV
- H04L 67/06: specially adapted for file transfer, e.g. file transfer protocol [FTP]
- H04L 67/1001: for accessing one among a plurality of replicated servers
- H04L 67/34: {involving the movement of software or configuration parameters (network booting or remote initial program loading [RIPL] G06F9/4416)}
- H04L 67/1004: Server selection for load balancing
- H04L 67/563: Data redirection of data network streams
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

A hybrid cluster environment with a public cloud cluster having nodes storing data and a plurality of private clusters is provided, wherein each of the plurality of private clusters has nodes storing data. Registration data that indicates a customer identifier, a new private cluster, and a file transfer server is received. The new private cluster is added to the plurality of private clusters in the hybrid cluster environment. Input to design a job to process data in the hybrid cluster environment is received. It is determined that the job is to be deployed to the new private cluster. The job is deployed to the new private cluster using the file transfer server, wherein the job is executed at the new private cluster. Job status information and one or more job logs are received with the file transfer server.

## Claims

### Claim 1

A computer-implemented method, comprising operations for:
providing a hybrid cluster environment with a public cloud cluster having nodes storing data and a plurality of private clusters, wherein each of the plurality of private clusters has nodes storing data;
receiving registration data that indicates a customer identifier, a new private cluster, and a file transfer server;
adding the new private cluster to the plurality of private clusters in the hybrid cluster environment;
receiving input to design a job to process data in the hybrid cluster environment;
determining that the job is to be deployed to the new private cluster;
deploying the job to the new private cluster using the file transfer server, wherein the job is executed at the new private cluster; and
receiving job status information and one or more job logs with the file transfer server.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1, wherein the job is deployed at any combination of: the public cloud cluster and any cluster from the plurality of private clusters.

### Claim 3 (depends on 1)

The computer-implemented method of claim 1, wherein the registration data identifies a master node of the new private cluster.

### Claim 4 (depends on 3)

The computer-implemented method of claim 3, further comprising operations for:
selecting a node of the nodes of the new private cluster using a load balancing proxy server of the master node of the new private cluster;
executing the job to process the data at the selected node of the new private cluster while monitoring the execution to generate the job status information and the one or more job logs without moving the data out of the selected node; and
returning the job status information and the one or more job logs using the file transfer server of the new private cluster.

### Claim 5 (depends on 1)

The computer-implemented method of claim 1, wherein a cluster management service of the hybrid cluster environment creates the job based on the input to design the job.

### Claim 6 (depends on 1)

The computer-implemented method of claim 1, wherein the new private cluster is one of an on-premise cluster at a customer location and a private cloud cluster.

### Claim 7 (depends on 1)

The computer-implemented method of claim 1, wherein a Software as a Service (SaaS) is configured to perform the operations of the method.