# US 12,008,872 B2 · Enabling frictionless shopping of products from bulk packaging > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,008,872 B2 - Document ID: US12008872B2 - Status: Granted - Kind: B2 - Application number: 18/358,077 - Filed: 2023-07-25 - Published: 2023-11-16 - Granted: 2024-06-11 - Earliest claimed: 2020-10-13 - Assignees: Trax Technology Solutions Pte Ltd. - Applicants: Trax Technology Solutions Pte Ltd. - Inventors: Youval Bronicki; Dan Bendler - Web page: https://patentgrep.com/patent/US12008872B2 ## CPC - G06Q 30/06: Buying, selling or leasing transactions - G06Q 30/0635: {replenishment orders; recurring orders} - G06Q 10/08724: {by shelf level inventory management, e.g. planograms} - G06Q 10/0877: {by inventory control or reporting using inventory tracking or counting} - G06Q 20/145: {Payments according to the detected use or quantity} - G06Q 20/203: {Inventory monitoring} - G06Q 20/204: {comprising interface for record bearing medium or carrier for electronic funds transfer or payment credit} - G06Q 20/208: {Input by product or record sensing, e.g. weighing or scanner processing} - G06Q 20/321: {using wearable devices} - G06Q 20/3821: {Electronic credentials} - G06Q 20/40145: {Biometric identity checks} - G06Q 20/4016: {involving fraud or risk level assessment in transaction processing} - G06Q 30/0281: {Customer communication at a business location, e.g. providing product or service information, consulting} - G06Q 30/0609: {Qualifying participants for shopping transactions (payment transaction verification G06Q20/401)} - G06Q 30/0613: {using intermediate agents} - G06Q 30/0617: {Representative agent} - G06Q 30/0623: {by investigating goods or services} - G06Q 30/0633: {Managing shopping lists, e.g. compiling or processing purchase lists (shipping orders G06Q10/083; order filling G06Q10/087)} - G06Q 30/0639: {Locating goods or services, e.g. based on physical position of the goods or services within a shopping facility} - G06V 10/764: using classification, e.g. of video objects - G06V 10/765: {using rules for classification or partitioning the feature space} - G06V 10/82: using neural networks - G06V 20/44: {Event detection} - G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69) - G06V 40/103: {Static body considered as a whole, e.g. static pedestrian or occupant recognition} - G06V 40/172: {Classification, e.g. identification} - G06V 40/20: Movements or behaviour, e.g. gesture recognition (recognition of facial expressions G06V40/16) - G07G 1/0063: {with means for detecting the geometric dimensions of the article of which the code is read, such as its size or height, for the verification of the registration} - G07G 1/0072: {with means for detecting the weight of the article of which the code is read, for the verification of the registration (weighing combined with recording means, e.g. in weighing scale, G01G19/415)} - G07G 1/0081: {the reader being a portable scanner or data reader (G07G1/009 takes precedence)} - G07G 1/14: Systems including one or more distant stations co-operating with a central processing unit - G08B 13/19613: {Recognition of a predetermined image pattern or behaviour pattern indicating theft or intrusion} - G08B 31/00: Predictive alarm systems characterised by extrapolation or other computation using updated historic data - G01G 19/4144: {for controlling weight of goods in commercial establishments, e.g. supermarket, P.O.S. systems} - G01G 19/52: Weighing apparatus combined with other objects, e.g. furniture (with walking sticks A45B3/08) - G06Q 10/08728: {of returned inventory} - G08B 5/36: using visible light sources - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - G07G: REGISTERING THE RECEIPT OF CASH, VALUABLES, OR TOKENS - G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS - G01G: WEIGHING (sorting by weighing B07C5/16) ## Abstract A method for identifying products removed from bulk packaging includes receiving one or more images acquired by a camera arranged to capture interactions between a shopper and one or more bulk packages each configured to contain a plurality of products, analyzing the one or more images to identify the shopper and a particular bulk package among the one or more bulk packages with which the identified shopper interacted, receiving an output from at least one sensor configured to monitor changes associated with the particular bulk package, analyzing the output to determine a quantity of products removed from the particular bulk package by the identified shopper, and updating a virtual shopping cart associated with the identified shopper to include the determined quantity of products and an indication of a product type associated with the particular bulk package. ## Claims ### Claim 1 A non-transitory computer-readable medium including instructions that, when executed by a processor, cause the processor to perform a method for identifying products removed from bulk packaging, the method comprising: receiving one or more images acquired by a camera arranged to capture interactions between a shopper and one or more bulk packages each configured to contain a plurality of products; analyzing the one or more images to identify the shopper and a particular bulk package among the one or more bulk packages with which the identified shopper interacted; receiving an output from at least one sensor configured to monitor changes associated with the particular bulk package; analyzing the output to determine a quantity of products removed from the particular bulk package by the identified shopper; and updating a virtual shopping cart associated with the identified shopper to include the determined quantity of products and an indication of a product type associated with the particular bulk package. ### Claim 2 (depends on 1) The non-transitory computer-readable medium of claim 1, wherein the at least one sensor includes a weight sensor configured to monitor changes in a weight of the particular bulk package. ### Claim 3 (depends on 1) The non-transitory computer-readable medium of claim 1, wherein the one or more bulk packages include shelf-ready packages configured to hold a plurality of products each weighing less than 1 kg. ### Claim 4 (depends on 1) The non-transitory computer-readable medium of claim 1, wherein the one or more images alone are insufficient for determining whether products were removed from the particular bulk package. ### Claim 5 (depends on 1) The non-transitory computer-readable medium of claim 1, wherein the output from the at least one sensor alone is insufficient for determining whether products were removed from the particular bulk package or from another bulk package among the one or more bulk packages. ### Claim 6 (depends on 1) The non-transitory computer-readable medium of claim 1, wherein the output from the at least one sensor alone is insufficient for determining an identification of a shopper that removes a product from the particular bulk package. ### Claim 7 (depends on 1) The non-transitory computer-readable medium of claim 1, wherein the at least one sensor is disposed on a retail shelf. ### Claim 8 (depends on 1) The non-transitory computer-readable medium of claim 1, wherein the at least one sensor is disposed on a retail shelf under the particular bulk package. ### Claim 9 (depends on 1) The non-transitory computer-readable medium of claim 1, wherein the method further comprises obtaining information indicative of a first weight of a single product associated with a first bulk package among the one or more bulk packages and a second weight of a single product associated with a second bulk package among the one or more bulk packages, and wherein the determination of the quantity of the products removed from the particular bulk package by the identified shopper is based, at least in part, on the first weight and the second weight. ### Claim 10 (depends on 1) The non-transitory computer-readable medium of claim 1, wherein the method further comprises delivering a notification to the identified shopper that the identified shopper is not eligible for frictionless checkout if the quantity of products removed from the particular bulk package cannot be conclusively determined. ### Claim 11 (depends on 1) The non-transitory computer-readable medium of claim 1, wherein the method further comprises analyzing the one or more images to determine the product type associated with the particular bulk package. ### Claim 12 A system for identifying products removed from bulk packaging, the system comprising: at least one processing unit configured to: receive one or more images acquired by a camera arranged to capture interactions between a shopper and one or more bulk packages each configured to contain a plurality of products; analyze the one or more images to identify the shopper and a particular bulk package among the one or more bulk packages with which the identified shopper interacted; receive an output from at least one sensor configured to monitor changes associated with the particular bulk package; analyze the output to determine a quantity of products removed from the particular bulk package by the identified shopper; and update a virtual shopping cart associated with the identified shopper to include the determined quantity of products and an indication of a product type associated with the particular bulk package. ### Claim 13 A non-transitory computer-readable medium including instructions that when executed by a processor cause the processor to perform a method for identifying products removed from bulk packaging, the method comprising: receiving an output from one or more spatial sensors arranged to capture interactions between a shopper and one or more bulk packages each configured to contain a plurality of products; analyzing the output from the one or more sensors to identify the shopper and a particular bulk package among the one or more bulk packages with which the identified shopper interacted; receiving an output from at least one additional sensor configured to monitor changes associated with the particular bulk package; analyzing the output from the at least one additional sensor to determine a quantity of products removed from the particular bulk package by the identified shopper; and updating a virtual shopping cart associated with the identified shopper to include the determined quantity of products and an indication of a product type associated with the particular bulk package. ### Claim 14 (depends on 13) The non-transitory computer-readable medium of claim 13, wherein the one or more spatial sensors include a LIDAR system. ### Claim 15 (depends on 13) The non-transitory computer-readable medium of claim 13, wherein the one or more spatial sensors include a camera. ### Claim 16 (depends on 13) The non-transitory computer-readable medium of claim 13, wherein the one or more spatial sensors include an RFID reader. ### Claim 17 (depends on 13) The non-transitory computer-readable medium of claim 13, wherein the one or more spatial sensors include a piezoresistive sensor. ### Claim 18 (depends on 13) The non-transitory computer-readable medium of claim 13, wherein the at least one additional sensor includes a weight sensor configured to monitor changes in a weight of the particular bulk package. ### Claim 19 (depends on 13) The non-transitory computer-readable medium of claim 13, wherein the at least one additional sensor includes a pressure sensor. ### Claim 20 A method for identifying products removed from bulk packaging, the method comprising: receiving an output from one or more spatial sensors arranged to capture interactions between a shopper and one or more bulk packages each configured to contain a plurality of products; analyzing the output from the one or more sensors to identify the shopper and a particular bulk package among the one or more bulk packages with which the identified shopper interacted; receiving an output from at least one additional sensor configured to monitor changes associated with the particular bulk package; analyzing the output from the at least one additional sensor to determine a quantity of products removed from the particular bulk package by the identified shopper; and updating a virtual shopping cart associated with the identified shopper to include the determined quantity of products and an indication of a product type associated with the particular bulk package.