# US 2025/0158802 A1 · Privacy-preserving neural network model and privacy-preserving prediction using the privacy-preserving neural network model

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0158802 A1
- Document ID: US20250158802A1
- Status: Published application
- Kind: A1
- Application number: 18/839,497
- Filed: 2023-02-15
- Published: 2025-05-15
- Earliest claimed: 2022-02-24
- Assignees: Nanyang Technological University
- Applicants: Nanyang Technological University
- Inventors: Kwok Yan LAM; Huaxiong WANG; Xianhui LU; Linru ZHANG; Xiangning WANG
- Web page: https://patentgrep.com/patent/US20250158802A1

## CPC

- G06F 21/6245: {Protecting personal data, e.g. for financial or medical purposes}
- H04L 9/008: {involving homomorphic encryption}
- G06N 3/045: Combinations of networks
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06N 3/048: Activation functions
- G06N 3/09: Supervised learning
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

A method of building a privacy-preserving neural network model is provided. The method includes: performing first neural network operations using a non-private neural network of the privacy-preserving neural network model based on first input data in plaintext to produce first output data in plaintext, whereby the non-private neural network is pre-trained and learnable parameters of the non-private neural network are fixed while performing the first neural network operations; encrypting the first output data from the non-private neural network using a homomorphic encryption method to produce first encrypted data; and performing second neural network operations homomorphically using a private neural network of the privacy-preserving neural network model based on the first encrypted data to produce second encrypted data, whereby learnable parameters of the private neural network are trained while performing the second neural network operations. There is also provided a corresponding system for building a privacy-preserving neural network model, as well as method and system for performing privacy-preserving prediction using the privacy-preserving neural network model built.

## Claims

### Claim 1

A method of building a privacy-preserving neural network model using at least one processor, the method comprising:
performing first neural network operations using a non-private neural network of the privacy-preserving neural network model based on first input data in plaintext to produce first output data in plaintext, wherein the non-private neural network is pre-trained and learnable parameters of the non-private neural network are fixed while performing the first neural network operations;
encrypting the first output data from the non-private neural network using a homomorphic encryption method to produce first encrypted data; and
performing second neural network operations homomorphically using a private neural network of the privacy-preserving neural network model based on the first encrypted data to produce second encrypted data, wherein learnable parameters of the private neural network are trained while performing the second neural network operations.

### Claim 2 (depends on 1)

The method according to claim 1, wherein the non-private neural network comprises one or more first convolution layers obtained from a pre-trained neural network.

### Claim 3 (depends on 2)

The method according to claim 2, wherein the non-private neural network further comprises one or more first fully connected layers obtained from the pre-trained neural network.

### Claim 4 (depends on 3)

The method according to claim 3, wherein the private neural network comprises one or more second fully connected layers.

### Claim 5 (depends on 2)

The method according to claim 2, wherein the private neural network comprises one or more second convolution layers and one or more first fully connected layers obtained from the pre-trained neural network, and one or more second fully connected layers.

### Claim 6 (depends on 5)

The method according to claim 5, wherein the one or more second convolution layers of the private neural network obtained from the pre-trained neural network are one or more lower convolution layers of the pre-trained neural network with respect to the one or more first convolution layers obtained from the pre-trained neural network.

### Claim 7 (depends on 4)

The method according to claim 4, wherein the one or more second fully connected layers form a shallow fully connected network.

### Claim 8 (depends on 2)

The method according to claim 2, wherein the pre-trained neural network is an open-source pre-trained neural network.

### Claim 9 (depends on 1)

The method according to claim 1, wherein the first input data is labeled data from a training dataset.

### Claim 10 (depends on 9)

The method according to claim 9, wherein the training dataset is a private dataset and is different from a dataset on which the pre-trained neural network was trained.

### Claim 11 (depends on 1)

The method according to claim 1, wherein
said performing the second neural network operations comprises computing a plurality of non-linear functions, and
for each of the plurality of non-linear functions, the non-linear function is computed homomorphically using a look-up table (LUT) algorithm, wherein the LUT algorithm is configured to produce a polynomial having encoded therein a plurality of values of the non-linear function and to produce an output ciphertext corresponding to one of the plurality of values based on the polynomial and an input ciphertext to the LUT algorithm.

### Claim 12 (depends on 11)

The method according to claim 11, wherein the plurality of values of the non-linear function are encoded into coefficients of the polynomial.

### Claim 13 (depends on 12)

The method according to claim 12, wherein the plurality of non-linear functions are a plurality of activation functions.

### Claim 14 (depends on 11)

The method according to claim 11, wherein
each fully connected layer of the private neural network comprises a plurality of nodes, and
for each fully connected layer of the private neural network, each of the plurality of nodes of the fully connected layer is configured to compute a respective non-linear function of the plurality of non-linear functions homomorphically using the LUT algorithm.

### Claim 15 (depends on 14)

The method according to claim 14, wherein
said performing the second neural network operations further comprises computing a plurality of inner product functions homomorphically, and
for each fully connected layer of the private neural network, each of the plurality of nodes of the fully connected layer is configured to compute a respective inner product function of the plurality of inner product functions homomorphically based on an input ciphertext to the node and a weight matrix associated with the node to produce an output ciphertext, wherein the input ciphertext to the LUT algorithm for the node to compute the respective non-linear function homomorphically using the LUT algorithm corresponds to the output ciphertext of the respective inner product function.

### Claim 16 (depends on 15)

The method according to claim 15, further comprising, for each of the plurality of nodes of the fully connected layer, controlling a size of the output ciphertext produced by the respective inner product function to have a predetermined number of bits.

### Claim 17 (depends on 11)

The method according to claim 11, wherein the LUT algorithm is configured to, for each of a plurality of polynomial multiplication operations therein, perform polynomial multiplication of polynomials in residue numeral system (RNS) form.

### Claim 18

A system for building a privacy-preserving neural network model,
the system comprising:
at least one memory; and
at least one processor communicatively coupled to the at least one memory and configured to:
perform first neural network operations using a non-private neural network of the privacy-preserving neural network model based on first input data in plaintext to produce first output data in plaintext, wherein the non-private neural network is pre-trained and learnable parameters of the non-private neural network are fixed while performing the first neural network operations;
encrypt the first output data from the non-private neural network using a homomorphic encryption method to produce first encrypted data; and
perform second neural network operations homomorphically using a private neural network of the privacy-preserving neural network model based on the first encrypted data to produce second encrypted data, wherein learnable parameters of the private neural network are trained while performing the second neural network operations.

### Claim 19

A computer program product, embodied in one or more non-transitory computer-readable storage mediums, comprising instructions executable by at least one processor to:
perform first neural network operations using a non-private neural network of the privacy-preserving neural network model based on first input data in plaintext to produce first output data in plaintext, wherein the non-private neural network is pre-trained and learnable parameters of the non-private neural network are fixed while performing the first neural network operations;
encrypt the first output data from the non-private neural network using a homomorphic encryption method to produce first encrypted data; and
perform second neural network operations homomorphically using a private neural network of the privacy-preserving neural network model based on the first encrypted data to produce second encrypted data, wherein learnable parameters of the private neural network are trained while performing the second neural network operations.

### Claim at position 20

-37. (canceled)

### Claim 38 (depends on 18)

The system according to claim 18, wherein the non-private neural network comprises one or more first convolution layers obtained from a pre-trained neural network.
