Method, system, and computer program product to employ a multi-layered neural network for classification

A computing device, comprising:

• neural network circuitry;
• a first convolutional layer of the neural network circuitry having a first input and a first output, which, in operation, applies two-valued weights of the first convolutional layer to produce a first output signal;
• a first normalization layer of the neural network circuitry having a second input and a second output—the second input configured to directly receive the first output signal from the first output of the first convolutional layer, wherein the first normalization layer, in operation, normalizes the first output signal directly from the first convolutional layer to produce a second output signal;
• a first two-valued function layer of the neural network circuitry having a third input and a third output—the third input configured to directly receive the second output signal from the second output of the first normalization layer, wherein the first two-valued function layer, in operation, applies a two-valued function of the first two-valued function layer to the second output signal directly from the first normalization layer to produce a third output signal;
• a second convolutional layer of the neural network circuitry having a fourth input and a fourth output—the fourth input configured to directly receive the third output signal from the third output of the first two-valued functional layer, wherein the second convolutional layer, in operation, applies weights of the second convolutional layer to the third output signal directly from the first two-valued function layer to produce a fourth output signal;
• a max pooling layer of the neural network circuitry having a fifth input and a fifth output—the fifth input configured to directly receive the fourth output signal from the fourth output of the second convolutional layer, wherein the max pooling layer, in operation, applies max pooling to the fourth output signal directly from the second convolutional layer to produce a fifth output signal;
• a fully-connected layer of the neural network circuitry having a sixth input and a sixth output—the sixth input configured to directly receive the fifth output signal from the fifth output of the max pooling layer, wherein the fully connected layer, in operation, applies two-valued weights of the fully connected layer to the fifth output signal directly from the max pooling layer to produce a sixth output signal;
• a second normalization layer of the neural network circuitry having a seventh input and a seventh output—the seventh input configured to directly receive the sixth output signal from the sixth output of the fully connected layer, wherein the second normalization layer, in operation, normalizes the sixth output signal directly from the fully-connected layer to produce a seventh output signal;
• a second two-valued function layer of the neural network circuitry having an eighth input and an eighth output—the eighth input configured to directly receive the seventh output signal from the seventh output of the second normalization layer, wherein the second two-valued function layer, in operation, applies a two-valued function of the second two-valued function layer to the seventh output signal directly from the second normalization layer to produce an eighth output signal;
• and
• a classifier of the neural network circuitry having a ninth input configured to directly receive the eighth output signal from the eighth output of the second two-valued function layer, wherein the classifier, in operation, classifies an input signal to the first input of the first convolutional layer based on the eighth output signal directly from the second two-valued function layer.

A system, comprising:

• an input interface;
• and
• digital signal processing circuitry, coupled to the input interface, wherein the digital signal processing circuitry, in operation, implements a neural network comprising:
• a first convolutional layer, which, in operation, applies two-valued weights to an input signal received via the input interface to produce a first output;
• a first normalization layer directly coupled to the first convolutional layer, which, in operation, normalizes the first output directly received from the first convolutional layer to produce a second output;
• a first two-valued function layer directly coupled to the first normalization layer, which, in operation, applies a first two-valued function to the second output directly received from the first normalization layer to produce a third output;
• a second convolutional layer directly coupled to the first two-valued function layer, which, in operation, applies weights to the third output directly received from the first two-valued function layer to produce a fourth output;
• a max pooling layer directly coupled to the second convolutional layer, which, in operation, applies max pooling to the fourth output directly received from the second convolutional layer to produce a fifth output;
• a max pooling layer directly coupled to the second convolutional layer, which, in operation, applies max pooling to the fourth output directly received from the second convolutional layer to produce a fifth output;
• a fully-connected layer directly coupled to the max pooling layer, which, in operation, applies two-valued weights to the fifth output directly received from the max pooling layer to produce a sixth output;
• a second normalization layer directly coupled to the fully-connected layer, which, in operation, normalizes the sixth output directly received from the fully-connected layer to produce a seventh output;
• a second two-valued function layer directly coupled to the second normalization layer, which, in operation, applies a two-valued function to the seventh output directly received from the second normalization layer to produce an eighth output;
• and
• a classifier directly coupled to the second two-valued function layer, which, in operation, classifies the input signal received via the input interface based on the eighth output directly received from the second two-valued function layer.

A non-transitory computer-readable medium having contents which configure digital signal processing circuitry to implement a neural network, the neural network comprising:

• a first convolutional layer which, in operation, applies two-valued weights to an input signal;
• a first normalization layer directly coupled at a first input to a first output of the first convolutional layer, and which, in operation, normalizes the first output;
• a first two-valued function layer directly coupled at a second input to a second output of the first normalization layer, and which, in operation, applies a first two-valued function to the second output;
• a second convolutional layer directly coupled at a third input to a third output of the first two-valued function layer, and which, in operation, applies weights to the third output;
• a max pooling layer directly coupled at a fourth input to a fourth output of the second convolutional layer, and which, in operation, applies max pooling to the fourth output;
• a fully-connected layer directly coupled at a fifth input to a fifth output of the max pooling layer, and which, in operation, applies two-valued weights to the fifth output;
• a second normalization layer directly coupled at a sixth input to a sixth output of the fully-connected layer, and which, in operation, normalizes the sixth output;
• a second two-valued function layer directly coupled at a seventh input to a seventh output of the second normalization layer, and which, in operation, applies a two-valued function to the seventh output;
• and
• a classifier coupled at an eighth input to an eighth output of the second two-valued function layer, and which, in operation, classifies the input signal based on the eighth output of the second two-valued function layer.