Changeover from one neural network to another neural network

A system comprising:

• a computer readable medium having instructions stored there on, which, when executed by a processor, cause the system to perform a method for changing a system over from a first deep convolutional neural network (DCNN) to a second DCNN, the first DCNN trained to output a value for a first metric for a document input to the first DCNN and the second DCNN trained to output a transformation of a first transformation type for a document input to the first DCNN, by:
• for each of one or more input documents:
• determining a first value for the first metric for a first transformation of the input document by passing the first transformation to the first DCNN;
• obtaining a second transformation of the input document by passing the input document to the second DCNN;
• passing the second transformation of the input document to the first DCNN, obtaining a second value for the first metric for the second transformation of the input document, the first and second transformations being of the first transformation type;
• determining, for the input document, a difference between the first value and the second value;
• determining whether to change the system over from the first DCNN to the second DCNN based on the difference between the first value and the second value for each of the one or more input documents;
• and
• in response to a determination that the system should be changed over from the first DCNN to the second DCNN, causing, for transformations of the first transformation type, new input documents to the system to be passed to the second DCNN in lieu of being passed to the first DCNN.

A non-transitory machine-readable storage medium comprising instructions, which when implemented by one or more machines, cause the one or more machines to perform operations for changing a system over from a first deep convolutional neural network (DCNN) to a second DCNN, the first DCNN trained to output a value for a first metric for a document input to the first DCNN and the second DCNN trained to output a transformation of a first transformation type for a document input to the first DCNN, the operations comprising:

• for each of one or more input documents:
• determining a first value for the first metric for a first transformation of the input document by passing the first transformation to the first DCNN;
• obtaining a second transformation of the input document by passing the input document to the second DCNN;
• passing the second transformation of the input document to the first DCNN, obtaining a second value for the first metric for the second transformation of the input document, the first and second transformations being of the first transformation type;
• determining, for the input document, a difference between the first value and the second value;
• determining whether to change the system over from the first DCNN to the second DCNN based on the difference between the first value and the second value for each of the one or more input documents;
• and
• in response to a determination that the system should be changed over from the first DCNN to the second DCNN, causing, for transformations of the first transformation type, new input documents to the system to be passed to the second DCNN in lieu of being passed to the first DCNN.