Tensor deep stacked neural network
AssigneeMicrosoft Corporation
InventorsDong Yu, Li Deng, Brian Hutchinson
Life of this patent
Estimating the term…
Loading patent…
AssigneeMicrosoft Corporation
InventorsDong Yu, Li Deng, Brian Hutchinson
Estimating the term…
A tensor deep stacked neural (T-DSN) network for obtaining predictions for discriminative modeling problems. The T-DSN network and method use bilinear modeling with a tensor representation to map a hidden layer to the predication layer. The T-DSN network is constructed by stacking blocks of a single hidden layer tensor neural network (SHLTNN) on top of each other. The single hidden layer for each block then is separated or divided into a plurality of two or more sections. In some embodiments, the hidden layer is separated into a first hidden layer section and a second hidden layer section. These multiple sections of the hidden layer are combined using a product operator to obtain an implicit hidden layer having a single section. In some embodiments the product operator is a Khatri-Rao product. A prediction is made using the implicit hidden layer and weights, and the output prediction layer is consequently obtained.
A method for mapping from a hidden layer to a prediction layer in a neural network, comprising:
A method for constructing a tensor deep stacked neural network, comprising:
A tensor deep stack neural network, comprising:
Dependencies are inferred from the claim text.