# US 2019/0378013 A1 · Self-tuning model compression methodology for reconfiguring deep neural network and electronic device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0378013 A1
- Document ID: US20190378013A1
- Status: Published application
- Kind: A1
- Application number: 16/001,923
- Filed: 2018-06-06
- Published: 2019-12-12
- Earliest claimed: 2018-06-06
- Assignees: Kneron Inc.
- Applicants: Kneron Inc.
- Inventors: JIE WU; JUNJIE SU; Bike Xie; Chun-Chen Liu
- Web page: https://patentgrep.com/patent/US20190378013A1

## CPC

- G06N 3/082: modifying the architecture, e.g. adding, deleting or silencing nodes or connections
- G06N 3/045: Combinations of networks
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06N 3/0495: Quantised networks; Sparse networks; Compressed networks
- G06N 3/063: using electronic means
- G06N 3/09: Supervised learning
- G06N 3/096: Transfer learning
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

A self-tuning model compression methodology for reconfiguring a Deep Neural Network includes: receiving a DNN model and a data set, wherein the DNN includes an input layer, at least one hidden layer and an output layer, and said at least one hidden layer and the output layer of the DNN model includes a plurality of neurons; compressing the DNN model into a reconfigured model according to the data set, wherein the reconfigured model includes an input layer, at least one hidden layer and an output layer, and said at least one hidden layer and the output layer of the reconfigured model includes a plurality of neurons, and a size of the reconfigured model is smaller than a size of the DNN model; and executing the reconfigured model on a user terminal for an end-user application.

## Claims

### Claim 1

A self-tuning model compression methodology for reconfiguring a Deep Neural Network (DNN), comprising:
receiving a DNN model and a data set, wherein the DNN model comprises an input layer, at least one hidden layer and an output layer, and said at least one hidden layer and the output layer of the DNN model comprise a plurality of neurons;
compressing the DNN model into a reconfigured model according to the data set, wherein the reconfigured model comprises an input layer, at least one hidden layer and an output layer, and said at least one hidden layer and the output layer of the reconfigured model comprise a plurality of neurons, and a size of the reconfigured model is smaller than a size of the DNN model; and
executing the reconfigured model on a user terminal for an end-user application.

### Claim 2 (depends on 1)

The methodology of claim 1, wherein compressing the DNN model into the reconfigured model according to the data set comprises:
analyzing a sparsity of the DNN model to generate an analysis result; and
generating the reconfigured model by pruning and quantizing a network redundancy of the DNN model, wherein pruning and quantizing the network redundancy of the DNN model comprises:
applying a low-rank approximation method to said at least one hidden layer and the output layer of the DNN model according to the analysis result.

### Claim 3 (depends on 1)

The methodology of claim 1, wherein a number of the plurality of neurons of the reconfigured model is less than a number of the plurality of neurons of the DNN model.

### Claim 4 (depends on 1)

The methodology of claim 1, wherein each of the plurality of neurons of the reconfigured model corresponds to at least one logic circuit comprising at least one of a multiplexer and an adder, each of the plurality of neurons of the DNN model corresponds to at least one logic circuit comprising at least one of a multiplexer and an adder, and a number of logic circuits in the reconfigured model is less than a number of logic circuits in the DNN model.

### Claim 5 (depends on 1)

The methodology of claim 1, further comprising:
retraining the reconfigured model with the data set.

### Claim 6 (depends on 1)

The methodology of claim 1, wherein the DNN model is an AlexNet, a VGG16, a RestNet, a MobileNet, a Yolo Network, and so on.

### Claim 7 (depends on 1)

The methodology of claim 1, wherein each of said at least one hidden layer and the output layer of the reconfigured model is a convolutional layer or a fully-connected layer.

### Claim 8 (depends on 1)

The methodology of claim 1, wherein the end-user application is a visual recognition application or a speech recognition application.

### Claim 9

An electronic device, comprising:
a storage device, arranged to store a program code; and
a processor, arranged to execute the program code;
wherein when loaded and executed by the processor, the program code instructs the processor to execute the following steps:
receiving a DNN model and a data set, wherein the DNN comprises an input layer, at least one hidden layer and an output layer, and said at least one hidden layer and the output layer of the DNN model comprise a plurality of neurons; and
compressing the DNN model into a reconfigured model according to the data set, wherein the reconfigured model comprises an input layer, at least one hidden layer and an output layer, and said at least one hidden layer and the output layer of the reconfigured model comprise a plurality of neurons, and a size of the reconfigured model is smaller than a size of the DNN model.

### Claim 10 (depends on 9)

The electronic device of claim 9, wherein compressing the DNN model into the reconfigured model according to the data set comprises:
analyzing a sparsity of the DNN model to generate an analysis result; and
generating the reconfigured model by pruning and quantizing a network redundancy of the DNN model, wherein pruning and quantizing the network redundancy of the DNN model comprises:
applying a low-rank approximation method to said at least one hidden layer and the output layer of the DNN model according to the analysis result.

### Claim 11 (depends on 9)

The electronic device of claim 9, wherein a number of the plurality of neurons of the reconfigured model is less than a number of the plurality of neurons of the DNN model.

### Claim 12 (depends on 9)

The electronic device of claim 9, wherein each of the plurality of neurons of the reconfigured model corresponds to at least one of a multiplexer and an adder, each of the plurality of neurons of the DNN model corresponds to at least one of a multiplexer and an adder, and a number of multiplexers and adders in the reconfigured model is less than a number of multiplexers and adders in the DNN model.

### Claim 13 (depends on 9)

The electronic device of claim 9, wherein the program code instructs the processor to further execute the following steps:
retraining the reconfigured model with the data set.

### Claim 14 (depends on 9)

The electronic device of claim 9, wherein the DNN model is an AlexNet, a VGG16, a RestNet, a MobileNet, a Yolo Network, and so on.

### Claim 15 (depends on 9)

The electronic device of claim 9, wherein each of said at least one hidden layer and the output layer of the reconfigured model is a convolutional layer or a fully-connected layer.

### Claim 16 (depends on 9)

The electronic device of claim 9, wherein the reconfigured model is executed on a user terminal for an end-user application.

### Claim 17 (depends on 16)

The electronic device of claim 16, wherein the end-user application is a visual recognition application or a speech recognition application.
