Image identification register apparatus, image identification register system, checkout processing method, and program

An image identification register system, comprising:

• a touch panel display used as a placement surface of a product;
• an image capturing apparatus that captures the product, and generates an image of the product;
• a memory storing instructions;
• and
• one or more processors configured to execute instructions to:
• identify, by machine learning comprising pattern matching and a discriminator, the product placed on the touch panel display and captured in the image;
• display, on the touch panel display, a user interface that receives user inputs on the touch panel display and needed for checkout processing of the product, according to an identification result of the product, the user interface including a registering interface configured to receive an operation comprising at least one of the user inputs as an input registering the product as a product to be purchased;
• and
• execute unit that executes processing based on an input to the user interface, wherein the one or more processors are further configured to execute the instructions to:
• output, on the touch panel display, a mark indicating an identified product based on a position of the identified product;
• and
• change appearance of the mark when the identified product is registered as a product to be purchased by the operation of the registering interface displayed on the touch panel display on which the product is placed,
• wherein the user interface further comprises a plurality of registering interfaces, including the registering interface, each respective to ones of a plurality of products, including the product, placed on the touch panel display,
• wherein each of the registering interfaces comprises, for each of the products, a register interface button, a correct interface button, and a cancel interface button,
• wherein operating the register interface button confirms whether to proceed with a purchase of at least one of the products,
• wherein operating the correct interface button operates to correct identification of at least one of the products, and
• wherein operating the cancel interface button operates to cancel a purchase operation of at least one of the products.

An checkout processing method executed by a computer comprising:

• acquiring an image of a product placed on a touch panel display;
• identifying, by machine learning comprising pattern matching and a discriminator, the product placed on the touch panel display and captured in the image;
• displaying, on the touch panel display, a user interface that receives user inputs on the touch panel display and needed for checkout processing of the product, according to an identification result of the product, the user interface including a registering interface configured to receive an operation comprising at least one of the user inputs as an input registering the product as a product to be purchased;
• and
• executing processing based on an input to the user interface, wherein the method further comprises:
• outputting, on the touch panel display, a mark indicating an identified product based on a position of the identified product;
• and
• changing appearance of the mark when the identified product is registered as a product to be purchased by the operation of the registering interface displayed on the touch panel display on which the product is placed,
• wherein the user interface further comprises a plurality of registering interfaces, including the registering interface, each respective to ones of a plurality of products, including the product, placed on the touch panel display,
• wherein each of the registering interfaces comprises, for each of the products, a register interface button, a correct interface button, and a cancel interface button,
• wherein operating the register interface button confirms whether to proceed with a purchase of at least one of the products,
• wherein operating the correct interface button operates to correct identification of at least one of the products, and
• wherein operating the cancel interface button operates to cancel a purchase operation of at least one of the products.