Ingesting documents using multiple ingestion pipelines

A method for analyzing a primary ingestion pipeline configured for use in natural language processing (NLP), the primary ingestion pipeline including a plurality of annotators configured for annotating documents passing through the primary ingestion pipeline, the method comprising:

• evaluating the plurality of annotators;
• evaluating a plurality of documents to be annotated by the plurality of annotators;
• generating, based on the evaluating the plurality of annotators and further based on the evaluating the plurality of documents, an ingestion risk score for each document of the plurality of documents, wherein each ingestion risk score represents a likelihood that an associated document will not successfully be annotated by the plurality of annotators while passing through the primary ingestion pipeline;
• comparing each ingestion risk score to a set of risk criteria;
• determining, based on the comparing, that each document of a first set of documents of the plurality of documents satisfies the set of risk criteria and that each document of a second set of documents of the plurality of documents does not satisfy the set of risk criteria;
• entering, in response to the determining, the first set of documents into the primary ingestion pipeline;
• and
• providing, in response to the determining, special handling to the second set of documents.