Informative user interface for document recognizer training

A system comprising:

• data processing hardware;
• and
• memory hardware in communication with the data processing hardware, the memory hardware storing instructions that when executed on the data processing hardware cause the data processing hardware to perform operations comprising:
• receiving, from a user device associated with a user, a plurality of annotated documents, each respective annotated document of the plurality of annotated documents comprising one or more fields, each respective field of the one or more fields of the respective annotated document labeled by a respective annotation;
• for a threshold number of iterations:
• randomly selecting a respective subset of annotated documents from the plurality of annotated documents;
• training a respective model on the respective subset of annotated documents;
• processing, using the respective model, remaining annotated documents of the plurality of annotated documents not selected for the respective subset of annotated documents;
• and
• evaluating a characteristic of the respective model based on the processing to generate a respective evaluation;
• and
• modifying the plurality of annotated documents based on the respective evaluation of the respective model;
• and
• providing, to the user device, each respective evaluation.