Apparatus and method with multi-task neural network

A processor implemented neural network method, the method comprising:

• training a neural network based on first training data for a first task, the trained neural network including a plurality of parameters;
• extracting a second parameter from among the plurality of parameters based on determined importances of the plurality of parameters;
• storing a value of the second parameter;
• updating the importances, including updating an importance of the second parameter among the determined importances;
• and
• retraining the neural network based on the updated importances and second training data for a second task.

A neural network apparatus, the apparatus comprising:

• a processor configured to:
• determine a target task with respect to input data;
• acquire a second parameter that is prestored in a memory to correspond to the target task among first parameters included in a neural network for a plurality of tasks;
• adapt the neural network to the target task by setting a value of a portion of the first parameters of the neural network to a value of the second parameter;
• and
• implement the adapted neural network with respect to the input data for the target task.

A neural network apparatus, the apparatus comprising:

• a processor configured to:
• train a neural network based on first training data for a first task, with the first trained neural network including a plurality of parameters;
• extract a second parameter from among the plurality of parameters based on determined importances of the plurality of parameters;
• store a value of the second parameter;
• update the importances, including an update of an importance of the second parameter among the determined importances;
• and
• retrain the neural network based on the updated importances and second training data for a second task;
• and
• a memory configured to store the value of the second parameter.

A processor implemented neural network method, the method comprising:

• obtaining first parameters of a neural network trained for a plurality of tasks, wherein the
• obtained first parameters of the neural network are configured to implement less than the plurality of tasks;
• acquiring one or more second parameters prestored to correspond to a target task among the plurality of tasks;
• adapting the neural network trained for the plurality of tasks to include all of the first parameters except for one or more parameters of the first parameters that are respectively replaced by the one or more second parameters;
• and
• implementing the adapted neural network with respect to input data for the target task.

A processor implemented neural network method, the method comprising:

• obtaining first parameters of a trained neural network trained for a first task;
• obtaining an importance matrix with respect to the neural network;
• obtaining one or more key parameters of the neural network;
• updating the importance matrix with respect to the determined one or more key parameters;
• and
• retraining, using a loss dependent on the updated importance matrix, the neural network with training data to have a plurality of parameters configured to implement a second task.