Soft-forgetting for connectionist temporal classification based automatic speech recognition

A computer program product comprising:

• one or more computer readable storage media and program instructions stored on the one or more computer readable storage media, the stored program instructions comprising:
• program instructions to train a first model utilizing one or more training batches wherein each training batch of the one or more training batches comprises one or more blocks of information;
• program instructions to, responsive to a completion of the training of the first model, initiate a training of a second model utilizing the one or more training batches;
• program instructions to jitter a random block size for each block of information for each of the one or more training batches for the second model;
• program instructions to unroll the second model over one or more non-overlapping contiguous jittered blocks of information;
• and
• program instructions to, responsive to the unrolling of the second model, reduce overfitting for the second model by applying twin regularization.

A computer system comprising:

• one or more computer processors;
• one or more computer readable storage media;
• and
• program instructions stored on the computer readable storage media for execution by at least one of the one or more processors, the stored program instructions comprising:
• program instructions to train a first model utilizing one or more training batches wherein each training batch of the one or more training batches comprises one or more blocks of information;
• program instructions to, responsive to a completion of the training of the first model, initiate a training of a second model utilizing the one or more training batches;
• program instructions to jitter a random block size for each block of information for each of the one or more training batches for the second model;
• program instructions to unroll the second model over one or more non-overlapping contiguous jittered blocks of information;
• and
• program instructions to, responsive to the unrolling of the second model, reduce overfitting for the second model by applying twin regularization.