Back to results
US 12,008,614 B2Granted
Occluded item detection for vision-based self-checkouts
AssigneeNCR Voyix Corporation
InventorsFrank Douglas Hinek, Qian Yang
Life of this patent
Estimating the term…
Abstract
Item recognition of a given item is trained on a single item from different views. The item recognition is then trained on images of the given item partially occluded by a second item having same, similar, or different shapes and features to that of the given item. General features of the item are noted and used to detect the given item when the given item is presented with multiple different items having multiple different occluded views.
Claims20
A method, comprising:
- obtaining, by a processor, an image taken of a transaction area for multiple items present together in the image;
- identifying, by the processor, first item identifiers for first items associated with the multiple items from first features extracted from the image, wherein the first items are not occluded within the image;
- identifying, by the processor, second item identifiers for second items associated with the multiple items from second features extracted from the image, wherein the second items are occluded within the image;
- and
- providing, by the processor, the first item identifiers and the second item identifiers during a transaction at a terminal for the multiple items.
2 more elements
A method, comprising:
- obtaining, by a processor, a single image of a transaction area depicting multiple items during a transaction at a terminal;
- creating, by the processor, cropped images for each item identified in the single image, wherein each cropped image having a non-occluded view of a corresponding item;
- creating, by the processor, cropped item pair images for each pair of items identified in the single image, each cropped item pair image having an occluded view for at least one item in the corresponding pair of items;
- providing, by the processor, the cropped images to a first machine-learning algorithm and receiving first item identifiers associated with first items represented within the single image as output;
- providing, by the processor, the cropped item pair images to a second machine-learning algorithm and receiving the second item identifiers associated with second items represented within the single image as output;
- and
- providing, by the processor, the first item identifiers and the second item identifiers to a transaction manager of the terminal to process the transaction from the single image.
4 more elements
A system, comprising:
- a camera;
- a terminal;
- and
- a server comprising a processor and a memory and in communication with the camera and the terminal, the processor and the memory configured to perform operations comprising:
- obtaining a single image captured by the camera of a transaction area associated with the terminal during a transaction at the terminal;
- creating cropped images for first items identified within the single image, each first item is not associated with an occluded view within the single image;
- creating cropped item pair images for each pair of second items identified within the single image, each pair of second items associated with an occluded view within the single image;
- obtaining first item identifiers for the first items based on the cropped images;
- obtaining second item identifiers for the second items based on the cropped item pair images;
- and
- providing the first item identifiers and the second item identifiers to the terminal for processing the transaction from the single image captured by the camera.
8 more elements
Dependencies are inferred from the claim text.