# US 2021/0342741 A1 · Method, electronic device, and computer program product for processing data

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0342741 A1
- Document ID: US20210342741A1
- Status: Published application
- Kind: A1
- Application number: 16/886,131
- Filed: 2020-05-28
- Published: 2021-11-04
- Earliest claimed: 2020-04-30
- Assignees: EMC IP Holding Company LLC
- Applicants: EMC IP Holding Company LLC
- Inventors: Jin Li; Jinpeng Liu; WuiChak Wong
- Web page: https://patentgrep.com/patent/US20210342741A1

## CPC

- G06N 20/00: Machine learning
- G06F 9/5027: {the resource being a machine, e.g. CPUs, Servers, Terminals}
- G06F 17/16: Matrix or vector computation {, e.g. matrix-matrix or matrix-vector multiplication, matrix factorization (matrix transposition G06F7/78)}
- G06N 20/10: using kernel methods, e.g. support vector machines [SVM]
- G06T 1/20: Processor architectures; Processor configuration, e.g. pipelining
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Embodiments of the present disclosure relate to a method, an electronic device, and a computer program product for processing data. According to exemplary implementations of the present disclosure, a method for processing data includes: determining a factor associated with a first input of a deep learning model, wherein the factor affects the number of threads for executing the deep learning model; generating a plurality of first partial inputs by using the first input based on the factor, wherein each first partial input in the plurality of first partial inputs is a part of the first input; and performing an operation on the plurality of first partial inputs by using the deep learning model, and generating an output of the deep learning model. Thereby, the data processing performance can be improved, and the resource requirement for data processing is lowered.

## Claims

### Claim 1

A method for processing data, comprising:
determining a factor associated with a first input of a deep learning model, wherein the factor affects the number of threads for executing the deep learning model;
generating a plurality of first partial inputs by using the first input based on the factor, wherein each first partial input in the plurality of first partial inputs is a part of the first input; and
performing an operation on the plurality of first partial inputs by using the deep learning model, and generating an output of the deep learning model.

### Claim 2 (depends on 1)

The method according to claim 1, wherein the first input is an image, and determining the factor comprises at least one of the following:
when it is determined that a channel number of the image exceeds a channel threshold value, determining the factor as the channel number; and
when it is determined that the size of at least one of a height or a width of the image exceeds a size threshold value, determining the factor as the size.

### Claim 3 (depends on 1)

The method according to claim 1, wherein the factor is the channel number, and generating the plurality of first partial inputs comprises:
dividing the first input into the plurality of first partial inputs, wherein the channel number of each first partial input in the plurality of first partial inputs is associated with a channel division threshold value.

### Claim 4 (depends on 1)

The method according to claim 1, wherein the factor is size, and generating the plurality of first partial inputs comprises:
determining the type of the operation to be executed by using the deep learning model on the plurality of first partial inputs; and
dividing the first input into the plurality of first partial inputs by using a size division threshold value based on the type.

### Claim 5 (depends on 4)

The method according to claim 4, wherein the operation of the type is a cross-multiplication operation; the deep learning model further has a second input; the first input and the second input are respectively matrices representing images; and dividing the first input into the plurality of first partial inputs by using the size division threshold value based on the type comprises:
when it is determined that the size of the first input exceeds the size of the second input, dividing the first input into a plurality of sub-matrices serving as the plurality of first partial inputs, wherein the size of each sub-matrix does not exceed the size division threshold value.

### Claim 6 (depends on 5)

The method according to claim 5, wherein dividing the first input into the plurality of first partial inputs by using the size division threshold value based on the type further comprises:
when it is determined that the size of the first input is less than the size of the second input, dividing the first input into a plurality of intermediate partial inputs, wherein each intermediate partial input is a matrix comprising at least one column vector of the first input; and
dividing each intermediate partial input in the plurality of intermediate partial inputs into a plurality of sub-matrices serving as the plurality of first partial inputs, wherein the size of each sub-matrix does not exceed the size division threshold value.

### Claim 7 (depends on 4)

The method according to claim 4, wherein the operation of the type is an element-wise operation; the first input is a matrix representing an image; and dividing the first input into the plurality of first partial inputs by using the size division threshold value based on the type comprises:
dividing the first input into a plurality of sub-matrices serving as the plurality of first partial inputs, wherein the size of each sub-matrix does not exceed the size division threshold value.

### Claim 8 (depends on 1)

The method according to claim 1, wherein generating the output of the deep learning model comprises:
performing the operation on the plurality of first partial inputs by using the deep learning model, and generating a plurality of partial outputs of the deep learning model; and
combining the plurality of partial outputs to generate the output.

### Claim 9

An electronic device, comprising:
at least one processing unit;
at least one memory, the at least one memory being coupled to the at least one processing unit and storing an instruction executed by the at least one processing unit, wherein the instruction, when executed by the at least one processing unit, causes the device to perform actions, and the actions comprise:
determining a factor associated with a first input of a deep learning model, wherein the factor affects the number of threads for executing the deep learning model;
generating a plurality of first partial inputs by using the first input based on the factor, wherein each first partial input in the plurality of first partial inputs is a part of the first input; and
performing an operation on the plurality of first partial inputs by using the deep learning model, and generating an output of the deep learning model.

### Claim 10 (depends on 9)

The device according to claim 9, wherein the first input is an image, and determining the factor comprises at least one of the following:
when it is determined that a channel number of the image exceeds a channel threshold value, determining the factor as the channel number; and
when it is determined that the size of at least one of a height or a width of the image exceeds a size threshold value, determining the factor as the size.

### Claim 11 (depends on 9)

The device according to claim 9, wherein the factor is a channel number, and generating the plurality of first partial inputs comprises:
dividing the first input into the plurality of first partial inputs, wherein the channel number of each first partial input in the plurality of first partial inputs is associated with a channel division threshold value.

### Claim 12 (depends on 9)

The device according to claim 9, wherein the factor is size, and generating the plurality of first partial inputs comprises:
determining the type of the operation to be executed by using the deep learning model on the plurality of first partial inputs; and
dividing the first input into the plurality of first partial inputs by using a size division threshold value based on the type.

### Claim 13 (depends on 12)

The device according to claim 12, wherein the operation of the type is a cross-multiplication operation; the deep learning model further has a second input; the first input and the second input are respectively matrices representing images; and dividing the first input into the plurality of first partial inputs by using the size division threshold value based on the type comprises:
when it is determined that the size of the first input exceeds the size of the second input, dividing the first input into a plurality of sub-matrices serving as the plurality of first partial inputs, wherein the size of each sub-matrix does not exceed the size division threshold value.

### Claim 14 (depends on 13)

The device according to claim 13, wherein dividing the first input into the plurality of first partial inputs by using the size division threshold value based on the type further comprises:
when it is determined that the size of the first input is less than the size of the second input, dividing the first input into a plurality of intermediate partial inputs, wherein each intermediate partial input is a matrix comprising at least one column vector of the first input; and
dividing each intermediate partial input in the plurality of intermediate partial inputs into a plurality of sub-matrices serving as the plurality of first partial inputs, wherein the size of each sub-matrix does not exceed the size division threshold value.

### Claim 15 (depends on 12)

The device according to claim 12, wherein the operation of the type is an element-wise operation; the first input is a matrix representing an image; and dividing the first input into the plurality of first partial inputs by using the size division threshold value based on the type comprises:
dividing the first input into a plurality of sub-matrices serving as the plurality of first partial inputs, wherein the size of each sub-matrix does not exceed the size division threshold value.

### Claim 16 (depends on 9)

The device according to claim 9, wherein generating the output of the deep learning model comprises:
performing the operation on the plurality of first partial inputs by using the deep learning model, and generating a plurality of partial outputs of the deep learning model; and
combining the plurality of partial outputs to generate the output.

### Claim 17

A computer program product, wherein the computer program product is tangibly stored on a non-transitory computer readable medium and comprises a machine-executable instruction; and the machine-executable instruction, when executed, causes a machine to perform the steps of:
determining a factor associated with a first input of a deep learning model, wherein the factor affects the number of threads for executing the deep learning model;
generating a plurality of first partial inputs by using the first input based on the factor, wherein each first partial input in the plurality of first partial inputs is a part of the first input; and
performing an operation on the plurality of first partial inputs by using the deep learning model, and generating an output of the deep learning model.

### Claim 18 (depends on 17)

The computer program product according to claim 17, wherein the first input is an image, and determining the factor comprises at least one of the following:
when it is determined that a channel number of the image exceeds a channel threshold value, determining the factor as the channel number; and
when it is determined that the size of at least one of a height or a width of the image exceeds a size threshold value, determining the factor as the size.

### Claim 19 (depends on 17)

The computer program product according to claim 17, wherein the factor is the channel number, and generating the plurality of first partial inputs comprises:
dividing the first input into the plurality of first partial inputs, wherein the channel number of each first partial input in the plurality of first partial inputs is associated with a channel division threshold value.

### Claim 20 (depends on 17)

The computer program product according to claim 17, wherein the factor is size, and generating the plurality of first partial inputs comprises:
determining the type of the operation to be executed by using the deep learning model on the plurality of first partial inputs; and
dividing the first input into the plurality of first partial inputs by using a size division threshold value based on the type.
