Human-augmented artificial intelligence configuration and optimization insights

A system comprising:

• data processing hardware;
• and
• memory hardware in communication with the data processing hardware, the memory hardware storing instructions that when executed on the data processing hardware cause the data processing hardware to perform operations comprising:
• receiving a document insight request requesting document insights for a corpus of documents from a user device associated with a user, the document insight request comprising:
• the corpus of documents;
• a set of entities contained within each document of the corpus of documents;
• and
• a document insight request parameter comprising a confidence value target;
• obtaining a machine learning model based on the corpus of documents, the machine learning model trained on a training corpus of documents containing the set of entities,
• generating, using the machine learning model, the document insights for the corpus of documents based on the document insight request parameter, the document insights for the corpus of documents comprising an accuracy target indicating a ratio of correctly identified entities from the corpus of documents and a user review rate target corresponding to the accuracy target;
• and
• transmitting the document insights to the user device, the document insights, when received by the user device, causing a graphical user interface (GUI) executing on the user device to display the document insights on a display screen of the user device.

A computer-implemented method that, when executed by data processing hardware, causes the data processing hardware to perform operations comprising:

• receiving a document insight request requesting document insights for a corpus of documents from a user device associated with a user, the document insight request comprising:
• the corpus of documents;
• a set of entities contained within each document of the corpus of documents;
• and
• a document insight request parameter comprising an accuracy target;
• obtaining a machine learning model based on the corpus of documents, the machine learning model trained on a training corpus of documents containing the set of entities;
• generating, using the machine learning model, the document insights for the corpus of documents based on the document insight request parameter, the document insights for the corpus of documents comprising a confidence value target and a user review rate target, wherein generating, using the machine learning model, the document insights for the corpus of documents based on the document insight request parameter, comprises:
• generating, using the machine learning model, the user review rate target based on the training corpus of documents and the accuracy target;
• and
• generating, using the machine learning model, the confidence value target based on the training corpus of documents,
• wherein the confidence value target and the user review rate target are necessary to satisfy the accuracy target for the corpus of documents;
• and
• transmitting the document insights to the user device, the document insights, when received by the user device, causing a graphical user interface (GUI) executing on the user device to display the document insights on a display screen of the user device.

A computer-implemented method that, when executed by data processing hardware, causes the data processing hardware to perform operations comprising:

• receiving a document insight request requesting document insights for a corpus of documents from a user device associated with a user, the document insight request comprising:
• the corpus of documents;
• a set of entities contained within each document of the corpus of documents;
• and
• a document insight request parameter comprising a user review rate target;
• obtaining a machine learning model based on the corpus of documents, the machine learning model trained on a training corpus of documents containing the set of entities;
• generating, using the machine learning model, the document insights for the corpus of documents based on the document insight request parameter, the document insights for the corpus of documents comprising a confidence value target and an accuracy target, wherein generating, using the machine learning model, the document insights for the corpus of documents based on the document insight request parameter, comprises:
• generating, by the machine learning model, the confidence value target based on the training corpus of documents;
• and
• generating, by the machine learning model, the accuracy target based on the training corpus of documents and the user review rate target,
• wherein the confidence value target and the accuracy target are necessary to satisfy the accuracy target for the corpus of documents;
• and
• transmitting the document insights to the user device, the document insights, when received by the user device, causing a graphical user interface (GUI) executing on the user device to display the document insights on a display screen of the user device.