User-Assisted Processing of Receipts and Invoices

A computer-readable medium bearing computer-executable instructions which, when executed on a computing device comprising at least a processor, carry out a method on the computing device, the method comprising:

• receiving product item data from a receipt processing site, the product item data comprising one or more sets of provisional product items and, for each set of provisional product items, and further comprising a corresponding image box corresponding to an area of a receipt image from which one or more provisional product items of the set of provisional products were identified;
• presenting a first set of provisional products items and the corresponding image box from the product item data;
• receiving a user indication with regard to the first set of provisional product items;
• updating the product item data corresponding to the first set of provision product items according to the user indication;
• and
• returning the updated product item data to the receipt processing site.

A computer-implemented method for processing receipts, the method comprising:

• receiving an image of a receipt;
• generating tokens from content in the image of the receipt;
• determining potential product items of the generated tokens, wherein determining potential product items of the generated tokens includes determining a confidence score for each of the determined potential product items, wherein each confidence score is an indication of a confidence that the potential product item is an actual product item;
• identifying sets of potential product items having confidence scores less than a threshold value, wherein each set of potential product items correspond to an area of content in the image of the receipt;
• submitting product item data to a computer user for user input, wherein the product item data comprises sets of potential product items with corresponding confidence scores, and further comprises an image box of the corresponding area of content in the image of the receipt;
• receiving updated product item data from the computer user;
• update product information regarding the receipt according to the updated product item data received from the user;
• and
• storing the potential items of content in association with the image of the receipt in a data store.