Back to results
US 12,749,380 B2Granted
Item type identification for checkout verification
AssigneeNCR Voyix Corporation
InventorsGerman Capuano, Matthew K. Farrow
Life of this patent
Estimating the term…
Abstract
During a transaction at a terminal, an operator of a terminal indicates that an item is a produce item. An image of the item is provided as input to a machine learning model which determines whether the item is a consumer packaged good (CPG) item type or a produce item (e.g., a non-CPG item type). When the model determines the item is a CPG item type, the transaction is suspended for an audit of the item.
Claims20
A method, comprising:
- receiving at least one item image for an item that an operator of a terminal indicated as being a produce item during a transaction workflow that is modified to detect when the operator of the terminal enters a selection into a transaction interface which identifies the item in a transaction as being the produce item;
- preprocessing the at least one item image by cropping background image data from the at least one item image and normalizing brightness of the at least one item image before providing the at least one item image as input to a machine-learning model (MLM);
- providing the at least one item image as input to the MLM;
- receiving as output from the MLM a determination as to an item type for the item based on the at least one item image;
- causing a transaction associated with the item on the terminal to be suspended based on the item type outputted by the MLM not comporting with the item being is the produce item;
- wherein the MLM is trained on item images to classify the item as either a produce item or a non-produce item;
- and
- wherein the MLM outputs a confidence score indicative of a determined likelihood that the item is a non-produce item type and the confidence score used in the causing.
5 more elements
A method, comprising:
- training a machine-learning-model (MLM) on images of items to provide item types for the items, wherein during training, the MLM is provided an actual item type classification that is expected as output for each of the images in a training data set, and through a this training process, the MLM is configured to provide an item type classification based on an item image received during a particular transaction;
- receiving at least one item image during a transaction at a terminal responsive to an operator of the terminal indicating that a transaction item associated with the at least one item image is a produce item;
- obtaining a current item type for the transaction item from the MLM by providing the at least one item image to the MLM as input;
- making a determination to suspend the transaction for an audit of the transaction item based on the current item type not comporting with a produce item type entered for the transaction;
- wherein training further comprises training the MLM on images depicting a plurality of items, a subset of item images are of non-produce items and a subset of item images are of produce items;
- preprocessing the images prior to providing the images to the MLM for training by cropping background image data;
- and
- responsive to the determination associated with suspending the transaction, receiving an override from the terminal, the override provided from an attendant audit that confirms the transaction item is the produce item, and flagging the at least one item image as feedback to retrain the MLM using the at least one item image and an indication that the transaction item comports with the produce item type.
5 more elements
A system, comprising:
- at least one server comprising at least one processor and a non-transitory computer-readable storage medium;
- the non-transitory computer-readable storage medium comprising executable instructions;
- the executable instructions when executed by at least one processor cause the at least one processor to perform operations, comprising:
- receiving one or more images of an item from a scanner of a camera of a terminal, wherein the one or more images identified by an operator of the terminal as a produce item during a transaction at the terminal;
- preprocessing the one or more images by cropping background image data before providing the one or more images as input to a machine-learning model (MLM);
- processing the MLM a with the one or more images and receiving as output from the MLM an item type for the item;
- and
- causing the transaction to be suspended based on the item type outputted by the MLM not comporting with a produce item type associated with the produce item enabling an accurate item type classification relevant to a particular type of retail shrinkage during a self-checkout;
- wherein the MLM is specifically trained to detect the particular type of retail shrinkage caused by customer identification of non-produce items as lower-cost produce items during self-checkouts;
- and
- wherein the MLM is trained on both item images and corresponding price-lookup (PLU) codes to determine whether a particular item depicted in a particular item image corresponds to an operator-provided PLU code.
8 more elements
Dependencies are inferred from the claim text.