Systems and methods for developing and verifying image processing standards for mobile deposit

A system comprising:

• at least one hardware processor;
• and
• memory storing software configured to, when executed by the at least one hardware processor, benchmark a plurality of mobile document processing engines, which are each different from each other, by, for each of the plurality of mobile document processing engines,
• executing the mobile document processing engine to, for each of a plurality of test images in a test deck representing documents captured by a mobile device,
• perform an image processing transaction on the test image, wherein the image processing transaction comprises detecting a magnetic ink character (MICR) line in the test image, and detecting a payment amount in the test image, and
• produce a result comprising either an acceptance or rejection of the test image based on the image processing transaction,
• comparing the results produced by the mobile document processing engine to known results for the test deck to calculate one or more error rates for the mobile document processing engine, wherein the result produced by the mobile document processing engine for each of the plurality of test images in the test deck matches the known result for that test image when at least the mobile document processing engine successfully performed the image processing transaction for that test image, correctly detected the MICR line in the test image, and correctly detected the payment amount in the test image,
• comparing the one or more error rates with one or more accuracy criteria, and
• either verifying or rejecting the mobile document processing engine based on the comparison of the one or more error rates with the one or more accuracy criteria.