Camera-based detection of non-completed payment at self- checkout

A point of sale (POS) system device, comprising:

• a terminal station apparatus;
• a bagging station apparatus having a bagging area;
• an optical sensor device having an optical sensor with a field of view that includes a region about the POS system device and configured to capture data of a successive image that includes a POS region, the POS region having a set of POS subregions including a POS subregion associated with the terminal station apparatus, a POS subregion associated with the bagging area, and a POS subregion associated with an exit region of the POS region;
• a payment terminal;
• a POS transaction logic configured to maintain transaction data for a checkout transaction by the POS system, the transaction data including one or more item entries corresponding to objects registered in the transaction and a transaction state;
• processing circuitry;
• and
• a memory operatively coupled to the processing circuitry and storing instructions that, when executed by the processing circuitry, cause the POS system device to:
• obtain successive image data of the POS region captured by the optical sensor device as a customer and one or more target objects are present in the POS region;
• determine, based on the successive image data, customer location data that represents a set of successive locations associated with the customer present in the POS region, and determine a customer location track based on the customer location data;
• determine, based on the successive image data, for each of the one or more target objects, a corresponding object movement track in the POS region;
• obtain, from the POS transaction logic, the transaction data associated with the transaction;
• obtain, from the payment terminal, payment state information associated with the transaction indicative of whether payment for the transaction has been completed;
• determine, based on the customer location track and the set of POS subregions, that the customer location track includes at least one customer location associated with the POS subregion associated with the exit region;
• identify, based on the object movement tracks and the set of POS subregions, that at least one target object is located within a possession region associated with the customer location track while the customer location track includes the at least one customer location associated with the POS subregion associated with the exit region;
• determine, based on a correlation between the at least one target object located within the possession region associated with the customer location track and the transaction data and the payment state information, that the at least one target object lacks a corresponding item entry in the transaction data or is associated with the transaction while payment for the transaction has not been completed;
• and
• responsive to determining that the at least one target object located within the possession region associated with the customer location track lacks the corresponding item entry in the transaction data or that payment for the transaction has not been completed, generate an indication of a potential non-payment event associated with the customer.

A system, comprising:

• an associate network node device;
• and
• a point of sale (POS) system device communicatively coupled over a network to the associate network node device and including:
• a terminal station apparatus;
• a bagging station apparatus having a bagging area;
• an optical sensor device having an optical sensor with a field of view that includes a region about the terminal station apparatus and the bagging station apparatus and configured to capture successive image data that includes a POS region, the POS region having a set of POS subregions including a POS subregion associated with the terminal station apparatus, a POS subregion associated with the bagging area, and a POS subregion associated with an exit region of the POS region;
• a payment terminal;
• a POS transaction logic configured to maintain transaction data for a checkout transaction by the POS system, the transaction data including one or more item entries corresponding to objects registered in the transaction and a transaction state;
• processing circuitry;
• and
• a memory operatively coupled to the processing circuitry and storing instructions that, when executed by the processing circuitry, cause the POS system to:
• obtain successive image data of the POS region captured by the optical sensor device as a customer and one or more target objects are present in the POS region;
• determine, based on the successive image data, customer location data that represents a set of successive locations associated with the customer present in the POS region, and determine a customer location track based on the customer location data;
• determine, based on the successive image data, for each of the one or more target objects, a corresponding object movement track in the POS region;
• obtain, from the POS transaction logic, the transaction data associated with the transaction;
• obtain, from the payment terminal, payment state information associated with the transaction indicative of whether payment for the transaction has been completed;
• determine, based on the customer location track and the set of POS subregions, that the customer location track includes at least one customer location associated with the POS subregion associated with the exit region;
• identify, based on the object movement tracks and the set of POS subregions, that at least one target object is located within a possession region associated with the customer location track while the customer location track includes the at least one customer location associated with the POS subregion associated with the exit region;
• determine, based on a correlation between the at least one target object located within the possession region associated with the customer location track and the transaction data and the payment state information, that the at least one target object lacks a corresponding item entry in the transaction data or is associated with the transaction while payment for the transaction has not been completed;
• responsive to determining that the at least one target object located within the possession region associated with the customer location track lacks the corresponding item entry in the transaction data or that payment for the transaction has not been completed, generate alert data associated with an indication of a potential non-payment event associated with the customer;
• and
• send, over the communication network, to the associate network node device, an indication that includes the alert data;
• and
• wherein the associate network node device includes processing circuitry and a memory storing instructions that, when executed by the processing circuitry, cause the associate network node device to:
• receive, over the communication network from the POS system, the indication and obtain the alert data from the indication;
• and
• process the alert data to cause presentation of an alert via a user interface of the associate network node device, the alert indicating the potential non-payment event associated.