Storage medium, image processing method and image processing apparatus

An image processing method comprising:

• receiving image data of a receipt image capturing a receipt;
• and
• performing the following procedures automatically after receiving the image data of the receipt image:
• acquiring, from the image data of the receipt image capturing the receipt, character string information which is information of a character string and position information which is information of a position of the character string in the receipt image by an Optical Character Recognition (OCR);
• storing an association data table in a storage unit, the storing comprising:
• acquiring value information which is information of a value corresponding to a keyword from the character string based on the acquired character string information by referring to a keyword data table, the keyword being a character string, the keyword data table storing, for each of a plurality of pieces of item information, the correspondence between the keyword, the item information, and a type of the item information, the plurality of pieces of item information corresponding to a plurality of pieces of displaying item information to be listed in a list in an information list display area of a management image, the keyword data table having been stored in the storage unit before the image data of the receipt image is received, the acquiring of the value information being performed for each keyword stored in the keyword data table;
• and
• storing, in the storage unit, the association data table in which, for each keyword stored in the keyword data table, the acquired value information corresponding to the keyword, position information corresponding to the acquired value information among the acquired position information, and the item information corresponding to the keyword are associated;
• determining, for each of the plurality of pieces of item information stored in the association data table, whether one value information is associated with the item information or a plurality of pieces of value information are associated with the item information by referring to the association data table;
• deciding, in a case where it is determined that one value information is associated with the item information, that the one value information is a displaying value information, and storing the displaying value information and the item information in association in a receipt data table;
• obtaining, in a case where it is determined that a plurality of pieces of value information are associated with the item information, one value information by executing a processing corresponding to the item information by referring to the keyword data table, deciding that the one value information is a displaying value information, and storing the displaying value information and the item information in association in the receipt data table,
• wherein, in a case where it is determined that the item information is a first type by referring to the keyword data table, a first processing is executed as the processing corresponding to the item information, and
• wherein, in a case where it is determined that the item information is a second type by referring to the keyword data table, a second processing is executed as the processing corresponding to the item information, the second processing being different from the first processing;
• and
• displaying, on a display unit capable of displaying an image, the management image by referring to the receipt data table and the association data table, the management image including the information list display area and a receipt image display area,
• wherein the information list display area displays the list of the plurality of pieces of displaying item information and the displaying value information which are stored in association in the receipt data table, and
• wherein the receipt image display area displays:
• the receipt image;
• and, for the plurality of pieces of item information stored in the association data table, a marker image at a position indicated by the position information which is stored in the association data table and is associated with the item information, the marker image indicating a status corresponding to the item information, and the marker image being different for each item information.

An image processing apparatus comprising:

• a hardware processor;
• and
• a memory storing computer executable instructions, when executed by the hardware processor, causing the image processing apparatus to perform:
• receiving image data of a receipt image capturing a receipt;
• and
• performing the following procedures automatically after receiving the image data of the receipt image:
• acquiring, from the image data of the receipt image capturing the receipt, character string information which is information of a character string and position information which is information of a position of the character string in the receipt image by an Optical Character Recognition (OCR);
• storing an association data table in a storage unit, the storing comprising:
• acquiring value information which is information of a value corresponding to a keyword from the character string based on the acquired character string information by referring to a keyword data table, the keyword being a character string, the keyword data table storing, for each of a plurality of pieces of item information, the correspondence between the keyword, the item information, and a type of the item information, the plurality of pieces of item information corresponding to a plurality of pieces of displaying item information to be listed in a list in an information list display area of a management image, the keyword data table having been stored in the storage unit before the image data of the receipt image is received, the acquiring of the value information being performed for each keyword stored in the keyword data table;
• and
• storing, in the storage unit, the association data table in which, for each keyword stored in the keyword data table, the acquired value information corresponding to the keyword, position information corresponding to the acquired value information among the acquired position information, and the item information corresponding to the keyword are associated;
• determining, for each of the plurality of pieces of item information stored in the association data table, whether one value information is associated with the item information or a plurality of pieces of value information are associated with the item information by referring to the association data table;
• deciding, in a case where it is determined that one value information is associated with the item information, that the one value information is a displaying value information, and storing the displaying value information and the item information in association in a receipt data table;
• obtaining, in a case where it is determined that a plurality of pieces of value information are associated with the item information, one value information by executing a processing corresponding to the item information by referring to the keyword data table, deciding that the one value information is a displaying value information, and storing the displaying value information and the item information in association in the receipt data table,
• wherein, in a case where it is determined that the item information is a first type by referring to the keyword data table, a first processing is executed as the processing corresponding to the item information, and
• wherein, in a case where it is determined that the item information is a second type by referring to the keyword data table, a second processing is executed as the processing corresponding to the item information, the second processing being different from the first processing;
• and
• displaying, on a display unit capable of displaying an image, the management image by referring to the receipt data table and the association data table, the management image including the information list display area and a receipt image display area,
• wherein the information list display area displays the list of the plurality of pieces of displaying item information and the displaying value information which are stored in association in the receipt data table, and
• wherein the receipt image display area displays:
• the receipt image;
• and, for the plurality of pieces of item information stored in the association data table, a marker image at a position indicated by the position information which is stored in the association data table and is associated with the item information, the marker image indicating a status corresponding to the item information, and the marker image being different for each item information.