# US 11,443,598 B2 · Selective treatment of shopping receptacles in checkout

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,443,598 B2
- Document ID: US11443598B2
- Status: Granted
- Kind: B2
- Application number: 17/564,505
- Filed: 2021-12-29
- Published: 2022-04-21
- Granted: 2022-09-13
- Earliest claimed: 2020-10-13
- Assignees: Trax Technology Solutions Pte Ltd.
- Applicants: Trax Technology Solutions Pte Ltd.
- Inventors: Youval Bronicki; Dan Bendler
- Web page: https://patentgrep.com/patent/US11443598B2

## CPC

- G06Q 30/06: Buying, selling or leasing transactions
- G06Q 30/0635: {replenishment orders; recurring orders}
- G06Q 10/08724: {by shelf level inventory management, e.g. planograms}
- G06Q 10/0877: {by inventory control or reporting using inventory tracking or counting}
- G06Q 20/145: {Payments according to the detected use or quantity}
- G06Q 20/203: {Inventory monitoring}
- G06Q 20/204: {comprising interface for record bearing medium or carrier for electronic funds transfer or payment credit}
- G06Q 20/208: {Input by product or record sensing, e.g. weighing or scanner processing}
- G06Q 20/321: {using wearable devices}
- G06Q 20/3821: {Electronic credentials}
- G06Q 20/40145: {Biometric identity checks}
- G06Q 20/4016: {involving fraud or risk level assessment in transaction processing}
- G06Q 30/0281: {Customer communication at a business location, e.g. providing product or service information, consulting}
- G06Q 30/0609: {Qualifying participants for shopping transactions (payment transaction verification G06Q20/401)}
- G06Q 30/0613: {using intermediate agents}
- G06Q 30/0617: {Representative agent}
- G06Q 30/0623: {by investigating goods or services}
- G06Q 30/0633: {Managing shopping lists, e.g. compiling or processing purchase lists (shipping orders G06Q10/083; order filling G06Q10/087)}
- G06Q 30/0639: {Locating goods or services, e.g. based on physical position of the goods or services within a shopping facility}
- G06V 10/764: using classification, e.g. of video objects
- G06V 10/765: {using rules for classification or partitioning the feature space}
- G06V 10/82: using neural networks
- G06V 20/44: {Event detection}
- G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69)
- G06V 40/103: {Static body considered as a whole, e.g. static pedestrian or occupant recognition}
- G06V 40/172: {Classification, e.g. identification}
- G06V 40/20: Movements or behaviour, e.g. gesture recognition (recognition of facial expressions G06V40/16)
- G07G 1/0063: {with means for detecting the geometric dimensions of the article of which the code is read, such as its size or height, for the verification of the registration}
- G07G 1/0072: {with means for detecting the weight of the article of which the code is read, for the verification of the registration (weighing combined with recording means, e.g. in weighing scale, G01G19/415)}
- G07G 1/0081: {the reader being a portable scanner or data reader (G07G1/009 takes precedence)}
- G07G 1/14: Systems including one or more distant stations co-operating with a central processing unit
- G08B 13/19613: {Recognition of a predetermined image pattern or behaviour pattern indicating theft or intrusion}
- G08B 31/00: Predictive alarm systems characterised by extrapolation or other computation using updated historic data
- G01G 19/4144: {for controlling weight of goods in commercial establishments, e.g. supermarket, P.O.S. systems}
- G01G 19/52: Weighing apparatus combined with other objects, e.g. furniture (with walking sticks A45B3/08)
- G06Q 10/08728: {of returned inventory}
- G08B 5/36: using visible light sources
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G07G: REGISTERING THE RECEIPT OF CASH, VALUABLES, OR TOKENS
- G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G01G: WEIGHING (sorting by weighing B07C5/16)

## Abstract

Methods, systems, and computer-readable media are provided for tracking frictionless shopping eligibility relative to individual shopping receptacles. In one implementation a method comprises: obtaining image data captured using a plurality of image sensors; analyzing the image data to identify a shopper at one or more locations; detecting, based on the analysis of the image data, a first product interaction event involving a first shopping receptacle associated with the shopper and a second product interaction event involving a second shopping receptacle associated with the shopper; based on the detected first product interaction event, determining whether the first shopping receptacle is eligible for frictionless checkout; based on the detected second product interaction event, determining whether the second shopping receptacle is eligible for frictionless checkout; and causing delivery of an indicator identifying which of the first shopping receptacle or the second shopping receptacle is ineligible for frictionless checkout.

## Claims

### Claim 1

A non-transitory computer-readable medium including instructions that when executed by at least one processor cause the at least one processor to perform a method for tracking frictionless shopping eligibility relative to individual shopping receptacles, the method comprising:
obtaining image data captured using a plurality of image sensors positioned in a retail store;
analyzing the image data to identify a shopper at one or more locations of the retail store;
detecting, based on the analysis of the image data, a first product interaction event involving a first shopping receptacle associated with the shopper and a second product interaction event involving a second shopping receptacle associated with the shopper;
based on the detected first product interaction event, determining that the first shopping receptacle is eligible for frictionless checkout;
based on the detected second product interaction event, determining that the second shopping receptacle is ineligible for frictionless checkout; and
in response to the determination that the second shopping receptacle is ineligible for frictionless checkout, causing delivery of an indicator identifying both that the second shopping receptacle is ineligible for frictionless checkout and that the first shopping receptacle is eligible for frictionless checkout.

### Claim 2 (depends on 1)

The non-transitory computer-readable medium of claim 1, wherein at least one of the first shopping receptacle or the second shopping receptacle is at least one of a shopping bag, a shopping cart, a section of a shopping cart and a shopping basket.

### Claim 3 (depends on 1)

The non-transitory computer-readable medium of claim 1, wherein the first shopping receptacle includes a first unique identifier and the second shopping receptacle includes a second unique identifier, the first and second unique identifiers enabling the first shopping receptacle and the second shopping receptacle to be automatically distinguished from one another.

### Claim 4 (depends on 1)

The non-transitory computer-readable medium of claim 1, wherein the indicator identifying which of the first shopping receptacle or the second shopping receptacle is ineligible for frictionless checkout is delivered to a wearable device associated with the shopper.

### Claim 5 (depends on 1)

The non-transitory computer-readable medium of claim 1, wherein the indicator identifying which of the first shopping receptacle or the second shopping receptacle is ineligible for frictionless checkout is delivered by a display associated with a shopping cart associated with the shopper.

### Claim 6 (depends on 1)

The non-transitory computer-readable medium of claim 1, wherein the indicator identifying which of the first shopping receptacle or the second shopping receptacle is ineligible for frictionless checkout is delivered to a computing device associated with a store associate of the retail store.

### Claim 7 (depends on 1)

The non-transitory computer-readable medium of claim 1, wherein the indicator identifying which of the first shopping receptacle or the second shopping receptacle is ineligible for frictionless checkout is delivered to the shopper after the shopper enters a checkout area of the retail store.

### Claim 8 (depends on 1)

The non-transitory computer-readable medium of claim 1, wherein the indicator identifying which of the first shopping receptacle or the second shopping receptacle is ineligible for frictionless checkout is delivered via a feedback device associated with at least one of the first shopping receptacle and the second shopping receptacle.

### Claim 9 (depends on 8)

The non-transitory computer-readable medium of claim 8, wherein the feedback device is at least one of: a display device, a haptic feedback device, a light emitting device, or an audio feedback device.

### Claim 10 (depends on 1)

The non-transitory computer-readable medium of claim 1, wherein if the first shopping receptacle is determined to be eligible for frictionless shopping and the second shopping receptacle is determined to be ineligible for frictionless shopping, requiring a manual checkout action with respect to only the second shopping receptacle.

### Claim 11 (depends on 1)

The non-transitory computer-readable medium of claim 1, wherein the method further comprising:
obtaining sensor data from a one or more sensors disposed on a retail shelf between the retail shelf and one or more products placed on the retail shelf; and
wherein at least one of the first or second product interaction event is detected based on analysis of the image data and the sensor data.

### Claim 12 (depends on 1)

The non-transitory computer-readable medium of claim 1, wherein determining whether the first shopping receptacle is eligible for frictionless checkout is based on at least one indicator of a degree of ambiguity associated with the first product interaction event, and determining whether the second shopping receptacle is eligible for frictionless checkout is based on at least one indicator of a degree of ambiguity associated with the second product interaction event.

### Claim 13 (depends on 12)

The non-transitory computer-readable medium of claim 12, wherein the at least one indicator of a degree of ambiguity associated with at least one of the first product interaction event and the second product interaction event is determined based on the image data and at least one sensor disposed on a surface of a retail shelf.

### Claim 14 (depends on 1)

The non-transitory computer-readable medium of claim 1, wherein determining whether the first shopping receptacle is eligible for frictionless checkout is based on whether the detected first product interaction event includes the shopper selecting a product that is designated as ineligible for frictionless checkout.

### Claim 15 (depends on 1)

The non-transitory computer-readable medium of claim 1, wherein the determination that the first shopping receptacle is ineligible for frictionless checkout is based on a determination of a product value associated with the first product interaction event.

### Claim 16 (depends on 1)

The non-transitory computer-readable medium of claim 1, wherein the method further comprising:
causing an ambiguity resolution action in response to a detection of at least one ambiguous interaction among the first product interaction event or the second product interaction event; and
causing an eligibility status for frictionless checkout for the first shopping receptacle or the second shopping receptacle to be restored based on data associated with a completion of the ambiguity resolution action.

### Claim 17 (depends on 1)

The non-transitory computer-readable medium of claim 1, wherein the first shopping receptacle corresponds to a first shopping list and the second shopping receptacle corresponds to a second shopping list, the second shopping list differs from the first shopping list, the first shopping list is used to reduce a degree of ambiguity associated with the first product interaction event, and the second shopping list is used to reduce a degree of ambiguity associated with the second product interaction event.

### Claim 18 (depends on 1)

The non-transitory computer-readable medium of claim 1, wherein the method further comprising:
detecting, based on the analysis of the image data, a third product interaction event involving an ambiguity between the first shopping receptacle and the second shopping receptacle; and
accessing data related to the first shopping receptacle and data related to the second shopping receptacle to select one of the first and second shopping receptacle; and
causing delivery of an indicator identifying that the selected shopping receptacle is ineligible for frictionless checkout.

### Claim 19

A method for tracking frictionless shopping eligibility relative to individual shopping receptacles, the method comprising:
obtaining image data captured using a plurality of image sensors positioned in a retail store;
analyzing the image data to identify a shopper at one or more locations of the retail store;
detecting, based on the analysis of the image data, a first product interaction event involving a first shopping receptacle associated with the shopper and a second product interaction event involving a second shopping receptacle associated with the shopper;
based on the detected first product interaction event, determining that the first shopping receptacle is eligible for frictionless checkout;
based on the detected second product interaction event, determining that the second shopping receptacle is ineligible for frictionless checkout; and
in response to the determination that the second shopping receptacle is ineligible for frictionless checkout, causing delivery of an indicator identifying both that the second shopping receptacle is ineligible for frictionless checkout and that the first shopping receptacle is eligible for frictionless checkout.

### Claim 20

A system for tracking frictionless shopping eligibility relative to individual shopping receptacles, the system comprising:
at least one processor programmed to:
obtain image data captured using a plurality of image sensors positioned in a retail store;
analyze the image data to identify a shopper at one or more locations of the retail store;
detect, based on the analysis of the image data, a first product interaction event involving a first shopping receptacle associated with the shopper and a second product interaction event involving a second shopping receptacle associated with the shopper;
based on the detected first product interaction event, determine that the first shopping receptacle is eligible for frictionless checkout;
based on the detected second product interaction event, determine that the second shopping receptacle is ineligible for frictionless checkout; and
in response to the determination that the second shopping receptacle is ineligible for frictionless checkout, cause delivery of an indicator identifying both that the second shopping receptacle is ineligible for frictionless checkout and that the first shopping receptacle is eligible for frictionless checkout.

### Claim 21 (depends on 1)

The non-transitory computer-readable medium of claim 1, wherein the indicator comprises an image of at least one of the first shopping receptacle or the second shopping receptacle.

### Claim 22 (depends on 21)

The non-transitory computer-readable medium of claim 21, wherein causing delivery of the indicator comprises overlaying a visual indicator over the image of at least one of the first shopping receptacle or second shopping receptacle.

### Claim 23 (depends on 21)

The non-transitory computer-readable medium of claim 21, wherein the indicator comprising the image of at least one of the first shopping receptacle or the second shopping receptacle is delivered to a computing device associated with a store associate of the retail store.
