# US 2021/0232916 A1 · Apparatus for operating a neural network, corresponding method and computer program product

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0232916 A1
- Document ID: US20210232916A1
- Status: Published application
- Kind: A1
- Application number: 17/156,158
- Filed: 2021-01-22
- Published: 2021-07-29
- Earliest claimed: 2020-01-24
- Assignees: STMicroelectronics S.r.l.
- Applicants: STMicroelectronics S.r.l.
- Inventors: Amedeo Veneroso
- Web page: https://patentgrep.com/patent/US20210232916A1

## CPC

- G06N 3/063: using electronic means
- G06N 3/08: Learning methods
- G06F 9/445: Program loading or initiating (bootstrapping G06F9/4401; security arrangements for program loading or initiating G06F21/57)
- G06F 21/72: in cryptographic circuits
- G06N 3/045: Combinations of networks
- G06N 3/0499: Feedforward networks
- H04L 9/30: Public key, i.e. encryption algorithm being computationally infeasible to invert or user's encryption keys not requiring secrecy
- H04L 67/56: Provisioning of proxy services (store-and-forward switching systems in data switching networks H04L12/54)
- H04W 12/03: Protecting confidentiality, e.g. by encryption
- H04W 12/40: Security arrangements using identity modules
- G06N 3/048: Activation functions
- H04W 88/02: Terminal devices
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)

## Abstract

An embodiment apparatus comprises a first processing system executing a first portion of a neural network comprising a first subset of a set of neural network layers providing a first intermediate output, and a second processing system receiving the first intermediate output, and operating a second portion of the neural network comprising a second subset of the set of layers providing a respective output, the second processing system configured to supply to the first processing system an output information function of the respective output, and the first processing system configured to obtain as a function of the output information a final output of the neural network. The second processing system includes a secure element storing a model of the second portion, and executes the second portion by applying the input information to the model of the second portion to provide the respective output.

## Claims

### Claim 1

An apparatus for operating a neural network comprising a set of neural network layers, the apparatus comprising:
a first processing system executing a first portion of the neural network comprising a first subset of the set of neural network layers obtaining a first intermediate output; and
a second processing system, external to the first processing system, configured to receive as input the first intermediate output of the first portion, and configured to execute a second portion of the neural network comprising a second subset of the set of neural network layers, obtaining a respective output;
wherein the second processing system is configured to supply, to the first processing system, output information as a function of the respective output;
wherein the first processing system is configured to obtain, as a function of the output information, a final output of the neural network;
wherein the second processing system includes a secure element storing a model of the second portion; and
wherein the second processing system is configured to execute the second portion of the neural network by applying the first intermediate output to the model of the second portion stored in the secure element to obtain the respective output.

### Claim 2 (depends on 1)

The apparatus according to claim 1, wherein in the secure element is stored an application comprising the model of the second portion executable by the second processing system.

### Claim 3 (depends on 2)

The apparatus according to claim 2, wherein the application includes a command to feed the first intermediate output to the model of the second portion.

### Claim 4 (depends on 2)

The apparatus according to claim 2, wherein the application includes an inference engine receiving the respective output and outputting predictions.

### Claim 5 (depends on 1)

The apparatus according to claim 1, wherein the model of the second portion includes an output layer, in particular a classifier.

### Claim 6 (depends on 1)

The apparatus according to claim 1, wherein the first processing system include a further proxy application which is configured to operate as an interface to the second processing system and the secure element, obtaining the first intermediate output and supplying it to the second processing system and the secure element, and receiving the output information as the function of the respective output from the second processing system.

### Claim 7 (depends on 2)

The apparatus according to claim 2, wherein the application comprising the model of the second portion includes a velocity mechanism which limits a number of executions performable by the application to a given limit number of executions, in particular includes a counter set to the given limit number of executions, the application comprising the model of the second portion being configured to stop when the counter reaches the given limit number of executions.

### Claim 8 (depends on 1)

The apparatus according to claim 1, wherein the secure element is one of:
a Universal Integrated Circuit Card (UICC);
an embedded UICC (eUICC);
an embedded Secure Element (eSE); or
a removable memory card.

### Claim 9 (depends on 1)

The apparatus according to claim 1, wherein the first processing system is a processor of a mobile device and the second processing system comprising the secure element is an integrated card in the mobile device.

### Claim 10

A method for executing a neural network comprising a set of layers, the method comprising:
dividing a trained neural network into a first portion comprising a first set of layers and a second portion comprising a second set of layers;
storing the first portion in a memory accessible by a first processing system, for operation by the first processing system;
storing an application comprising a model of the second portion in a secure element associated with a second processing system external to the first processing system;
operating the first portion obtaining a first intermediate output;
supplying the first intermediate output as intermediate input to the application comprising the model of the second portion in the secure element;
executing in the secure element the second portion obtaining a respective output; and
supplying to the first processing system output information as a function of the respective output.

### Claim 11 (depends on 10)

The method according to claim 10, wherein the supplying to the first processing system the output information as the function of the respective output includes one of the following:
feeding the respective output to an inference engine of the application to obtain predictions, which are sent back as intermediate output information to the first processing system to be outputted as final information;
taking as the first intermediate output an output of hidden layers of the neural network; or
taking as the first intermediate output an output of an output layer, in particular a classifier, stored inside the application.

### Claim 12 (depends on 10)

The method according to claim 10, wherein storing the application comprising the model of the second portion in the secure element includes remotely delivering the model by a secure channel or a confidential channel to the secure element.

### Claim 13 (depends on 12)

The method according to claim 12, wherein storing the application comprising the model of the second portion in the secure element includes loading the model in the secure element using over-the-air (OTA) remote provisioning.

### Claim 14 (depends on 13)

The method according to claim 13, wherein an OTA server loads in the secure element the application comprising the model of the second portion encrypted with a given key specific to the secure element, the secure element being configured to decrypt with the given key the second portion and to perform the executing the second portion.

### Claim 15 (depends on 10)

The method according to claim 10, wherein the model comprises a description of cells, connections, and weights and functions associated with the cells and the connections, of the second portion of the neural network.

### Claim 16 (depends on 10)

The method according to claim 10, wherein the supplying the first intermediate output is performed by a proxy application of the first processing system.

### Claim 17

A computer-program product loadable into a memory of at least one processor and comprising portions of software code for implementing the following steps:
dividing a trained neural network into a first portion comprising a first set of layers and a second portion comprising a second set of layers;
storing the first portion in a memory accessible by a first processing system, for operation by the first processing system;
storing an application comprising a model of the second portion in a secure element associated with a second processing system external to the first processing system;
operating the first portion obtaining a first intermediate output;
supplying the first intermediate output as intermediate input to the application comprising the model of the second portion in the secure element;
executing in the secure element the second portion obtaining a respective output; and
supplying to the first processing system output information as a function of the respective output.

### Claim 18 (depends on 17)

The computer-program product according to claim 17, wherein the supplying to the first processing system the output information as the function of the respective output includes one of the following:
feeding the respective output to an inference engine of the application to obtain predictions, which are sent back as intermediate output information to the first processing system to be outputted as final information;
taking as the first intermediate output an output of hidden layers of the trained neural network; or
taking as the first intermediate output an output of an output layer, in particular a classifier, stored inside the application.

### Claim 19 (depends on 17)

The computer-program product according to claim 17, wherein storing the application comprising the model of the second portion in the secure element includes remotely delivering the model by a secure channel or a confidential channel to the secure element.

### Claim 20 (depends on 19)

The computer-program product according to claim 19, wherein storing the application comprising the model of the second portion in the secure element includes loading the model in the secure element using over-the-air (OTA) remote provisioning.
