# US 2020/0401902 A1 · Method for configuring deep learning program and container manager

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0401902 A1
- Document ID: US20200401902A1
- Status: Published application
- Kind: A1
- Application number: 16/523,019
- Filed: 2019-07-26
- Published: 2020-12-24
- Earliest claimed: 2019-06-21
- Assignees: Hongfujin Precision Electronics (Tianjin) Co., Ltd.
- Applicants: Hongfujin Precision Electronics(Tianjin)Co.,Ltd.
- Inventors: CHENG-YUEH LIU
- Web page: https://patentgrep.com/patent/US20200401902A1

## CPC

- G06N 3/105: {Shells for specifying net layout}
- G06N 20/00: Machine learning
- G06F 9/5083: {Techniques for rebalancing the load in a distributed system}
- G06N 3/063: using electronic means
- G06N 5/01: Dynamic search techniques; Heuristics; Dynamic trees; Branch-and-bound
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A container manager used in a method for configuring a deep learning program acquires deep learning program, and analyzes at least one performance indicator from the acquired deep learning program and sends the at least one performance indicator to a server. The server determines a hardware configuration and a container image according to the at least one performance indicator, generates a label containing the name of the server, the determined hardware configuration, and the container image, and sends the label to the container manager. The container manager receives the label from the server, and determines whether the label contain the name of the server, and deploys a container for the deep learning program if the label contains the name of the server.

## Claims

### Claim 1

A container manager comprising:
a processor; and
a non-transitory storage medium coupled to the processor and configured to store a plurality of instructions, which cause the container manager to:
acquire a deep learning program;
analyze at least one performance indicator from the acquired deep learning program and send the at least one performance indicator to a server, wherein the server
determines a hardware configuration and a container image according to the at least one performance indicator,
generates a container image label containing the name of the server, the determined hardware configuration and the container image, and
sends the container image label to the container manager; and
receive the container image label from the server, and determine whether the container image label contain the name of the server, and deploy a container for the deep learning program according to the hardware configuration and the container image if the container image label contains the name of the server.

### Claim 2 (depends on 1)

The container manager as recited in claim 1, wherein the plurality of instructions are further configured to cause the container manager to:
use an event tracking tool to analyze the at least one performance indicator from the deep learning program.

### Claim 3 (depends on 1)

The container manager as recited in claim 1, wherein the plurality of instructions are further configured to cause the container manager to:
use the event tracking tool to analyze the at least one performance indicator from the deep learning program by a http web protocol function.

### Claim 4 (depends on 2)

The container manager as recited in claim 2, wherein the event tracking tool can be a Swarm-Oriented Function Call Analysis, or a Flame Graph.

### Claim 5 (depends on 1)

The container manager as recited in claim 1, wherein the at least one performance indicator comprises a forward propagation time, a backward time, a data replication time from a host to a graphics processing unit (GPU), and a data replication time from the host to the GPU.

### Claim 6

A method for configuring deep learning program comprising:
a container manager acquiring a deep learning program;
the container manager analyzing at least one performance indicator from the acquired deep learning program and sending the at least one performance indicator to a server;
the server determining a hardware configuration and a container image according to the at least one performance indicator, generating a container image label containing the name of the server, the determined hardware configuration and the container image, and sending the container image label to the container manager; and
the container manager receiving the container image label from the server, and determining whether the container image label contain the name of the server, and deploying a container for the deep learning program according to the hardware configuration and the container image if the container image label contains the name of the server.

### Claim 7 (depends on 6)

The method as recited in claim 6, further comprising:
the server determining the hardware configuration and container image by a preset rule according to the at least one performance indicator to make the deep learning program have a minimum running time after utilizing the hardware configuration and container image to encapsulates the deep learning program.

### Claim 8 (depends on 7)

The method as recited in claim 7, further comprising:
when the forward propagation time is within a first threshold range, the server determining the hardware configuration as setting the communication mode between a CPU and a graphics processing unit (GPU) as a NVLink communication mode, and setting the container image as setting application interface; when the forward propagation time is within a second threshold range, the server determining the hardware configuration as setting the communication mode between the CPU and the GPU as a PCIex2 communication mode, and setting the container image as setting application interface.

### Claim 9 (depends on 6)

The method as recited in claim 6, further comprising:
the server determining the hardware configuration as setting the number of CPU's cores, memory capacity, and the number of CPUs according to the at least one performance indicator.

### Claim 10 (depends on 6)

The method as recited in claim 6, further comprising:
the container manager using an event tracking tool to analyze the at least one performance indicator from the deep learning program.

### Claim 11 (depends on 11)

The method as recited in claim 11, further comprising:
the container manager using the event tracking tool to analyze the at least one performance indicator from the deep learning program by a web protocol function.

### Claim 12 (depends on 11)

The method as recited in claim 11, wherein the event tracking tool can be a Swarm-Oriented Function Call Analysis, or a Flame Graph.

### Claim 13 (depends on 6)

The method as recited in claim 6, wherein the at least one performance indicator comprises a forward propagation time, a backward time, a data replication time from a host to a graphics processing unit (GPU), and a data replication time from the host to the GPU.
