Methods for building a deep latent feature extractor for industrial sensor data
AssigneeSiemens Aktiengesellschaft
InventorsDenis Krompaß, Hans-Georg Köpken, Tomislav Tomov
Life of this patent
Estimating the term…
Abstract
The present disclosure relates to a method of and a system for building a latent feature extractor as well as a neural network including a latent feature extractor built by the method and/or with the system. The method includes providing non-uniform training data for a multitude of tasks and optimizing parameters of a neural network of the latent feature extractor based on the multitude of tasks.
Claims16
A method of pre-training a latent feature extractor that is one single sub-neural network for an industrial neural network by pre-initializing parameters of the latent feature extractor for industrial sensor data that automatically extracts latent features from general industrial sensor data such that an amount of labelled training data needed to train the industrial neural network for a specific task is reduced, the method comprising:
- providing non-uniform training data comprising training examples for each single task of a multitude of tasks covering different problems in an industrial field;
- and
- optimizing parameters of the industrial neural network of the latent feature extractor based on the multitude of tasks, wherein the following acts are executed iteratively until the parameters have converged:
- randomly selecting a single task from the multitude of tasks for optimizing the parameters;
- sampling the randomly selected task for iterations with the respective training examples of the non-uniform training data for optimizing the parameters based on the randomly selected task, wherein each iteration of the iterations comprises:
- extracting latent features from a training signal of the current training example of the respective training examples with the latent feature extractor;
- and
- deriving an output signal for the randomly selected task from the extracted latent features with a respective task module of the randomly selected task.
A system for pre-training a latent feature extractor that is a sub-neural network for an industrial neural network by pre-initializing parameters of the latent feature extractor for industrial sensor data that automatically extracts latent features from general industrial sensor data such that an amount of labelled training data needed to train the industrial neural network for a specific task is reduced, wherein the system is configured to:
- execute the latent feature extractor for extracting latent features, wherein the latent feature extractor is shared for each task of the multitude of tasks covering different problems in an industrial field;
- and
- execute task modules for each single task of the multitude of tasks downstream the latent feature extractor for deriving an output signal for the respective task.
A system for executing an industrial neural network, wherein the system is configured to:
- execute a latent feature extractor;
- execute a combiner module downstream the latent feature extractor in case multiple input signals are provided to the industrial neural network;
- and
- execute a specific task module that is a sub neural network for the industrial neural network downstream the latent feature extractor and the combiner module, respectively,
- wherein the latent feature extractor is pretrained by:
- providing non-uniform training data comprising training examples for each single task of a multitude of tasks covering different problems in an industrial field;
- and
- optimizing parameters of the industrial neural network of the latent feature extractor based on the multitude of tasks, wherein the following acts are executed iteratively until the parameters have converged:
- randomly selecting a single task from the multitude of tasks for optimizing the parameters;
- sampling the randomly selected task for iterations with the respective training examples of the non-uniform training data for optimizing the parameters based on the randomly selected task,
- wherein each iteration of the iterations comprises:
- extracting latent features from a training signal of the current training example of the respective training examples with the latent feature extractor;
- and
- deriving an output signal for the randomly selected task from the extracted latent features with a respective task module of the randomly selected task.
Dependencies are inferred from the claim text.