# US 2021/0342770 A1 · Product identification systems and methods

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0342770 A1
- Document ID: US20210342770A1
- Status: Published application
- Kind: A1
- Application number: 16/864,676
- Filed: 2020-05-01
- Published: 2021-11-04
- Earliest claimed: 2020-05-01
- Assignees: PepsiCo, Inc.
- Applicants: PepsiCo, Inc.
- Inventors: Xuejun LI; Yong Jin SEROCK; Cheuk Chi LAU
- Web page: https://patentgrep.com/patent/US20210342770A1

## CPC

- G06Q 30/0185: {Product, service or business identity fraud}
- G01G 3/14: measuring variations of electrical resistance (G01G3/13 takes precedence)
- G01G 19/42: for counting by weighing (G01G19/387 takes precedence)
- G01G 19/52: Weighing apparatus combined with other objects, e.g. furniture (with walking sticks A45B3/08)
- G01S 17/88: Lidar systems specially adapted for specific applications
- G06K 7/10722: {Photodetector array or CCD scanning}
- G06K 7/1413: {1D bar codes}
- G06Q 10/087: Inventory or stock management, e.g. order filling, procurement or balancing against orders
- G06Q 10/08778: {for managing mis-shipments, lost items or stolen goods}
- G06Q 20/18: involving self-service terminals [SST], vending machines, kiosks or multimedia terminals
- G06Q 20/208: {Input by product or record sensing, e.g. weighing or scanner processing}
- G06V 10/751: {Comparing pixel values or logical combinations thereof, or feature values having positional relevance, e.g. template matching}
- G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69)
- G06V 40/28: {Recognition of hand or arm movements, e.g. recognition of deaf sign language (static hand signs G06V40/113)}
- G07C 9/00174: {Electronically operated locks; Circuits therefor; Nonmechanical keys therefor, e.g. passive or active electrical keys or other data carriers without mechanical keys (mechanical locks with electric permutation E05B49/00; arrangements for sensing or reading record carriers G06K7/00; electronic switching H03K17/00)}
- G06Q 10/08724: {by shelf level inventory management, e.g. planograms}
- G06V 2201/10: Recognition assisted with metadata
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G01G: WEIGHING (sorting by weighing B07C5/16)
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G06K: GRAPHICAL DATA READING (image or video recognition or understanding G06V); PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G07C: TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE

## Abstract

A method for identifying a product removed from a cabinet includes detecting visual characteristics of the product removed from the cabinet by a camera within the cabinet. The method may include detecting an identifier on the product removed from the cabinet by an identifier sensor, and comparing the visual characteristics and the identifier to a database of product information. The product removed from the cabinet may be identified based on the comparison of the visual characteristics and the identifier to the database of product information.

## Claims

### Claim 1

A method for identifying a product removed from a cabinet, comprising:
detecting visual characteristics of the product removed from the cabinet by a camera within the cabinet;
detecting an identifier on the product removed from the cabinet by an identifier sensor;
comparing the visual characteristics and the identifier to a database of product information; and
identifying the product removed from the cabinet based on the comparison of the visual characteristics and the identifier to the database of product information.

### Claim 2 (depends on 1)

The method of claim 1, wherein the visual characteristics comprises a shape of the product.

### Claim 3 (depends on 1)

The method of claim 1, wherein the visual characteristics comprises a coloring of the product.

### Claim 4 (depends on 1)

The method of claim 1, wherein the identifier sensor is the camera.

### Claim 5 (depends on 1)

The method of claim 1, wherein the identifier is a barcode.

### Claim 6 (depends on 1)

The method of claim 1, further comprising:
confirming the identity of the product by determining a weight of the product removed from the cabinet with a weight sensor arranged within the cabinet.

### Claim 7 (depends on 6)

The method of claim 6, wherein determining the weight of the product removed from the cabinet comprises:
determining a first weight of products in the cabinet via the weight sensor;
determining a second weight of products in the cabinet via the weight sensor after removing the product from the cabinet; and
calculating a difference between the first weight and the second weight.

### Claim 8 (depends on 1)

The method of claim 1, further comprising
detecting a visual characteristic of the product removed from the cabinet at a location outside of the cabinet by an external camera; and
confirming the identity of the product removed based on the visual characteristic detected by the external camera.

### Claim 9 (depends on 1)

The method of claim 1, further comprising:
detecting a user by an external camera;
detecting by the external camera unauthorized conduct by the user; and
locking the cabinet when the unauthorized conduct is detected.

### Claim 10 (depends on 1)

The method of claim 1, further comprising:
detecting data relating to the product removed via an optical sensor; and
confirming the identity of the product removed using the data from the optical sensor.

### Claim 11

A method for identifying a product removed from a cabinet, comprising:
capturing a first image of a plurality of products within the cabinet by an internal camera within the cabinet;
removing a product of the plurality of products from the cabinet;
capturing a second image of the plurality of products within the cabinet by the internal camera after removing the product;
determining an identity of the product removed from the cabinet by analyzing the first image and the second image; and
confirming the identity of the product removed from the cabinet by detecting an identifier of the product removed from the cabinet.

### Claim 12 (depends on 11)

The method of claim 11, further comprising:
confirming the identity of the product by detecting a weight of the product removed from the cabinet via a weight sensor.

### Claim 13 (depends on 11)

The method of claim 11, further comprising:
detecting a visual characteristic of the product removed from the cabinet at a location outside of the cabinet by an external camera; and
confirming the identity of the product removed based on the visual characteristic detected by the external camera.

### Claim 14 (depends on 11)

The method of claim 11, further comprising:
detecting data relating to the product removed via an optical sensor; and
confirming the identity of the product removed using the data from the optical sensor.

### Claim 15 (depends on 14)

The method of claim 14, wherein the optical sensor comprises a LIDAR sensor.

### Claim 16

A method for identifying a product removed from a cabinet, comprising:
detecting a location from which the product was removed from the cabinet via at least one of a camera and a sensor;
determining a visual characteristic of the product based on data from the at least one of a camera and a sensor;
determining a predicted identity of the product based on the visual characteristic;
determining an identity of the product at the location based on a digital map of products within the cabinet; and
confirming that the predicted identity of the product corresponds to the identity of the product based on the digital map.

### Claim 17 (depends on 16)

The method of claim 16, further comprising:
updating the digital map of products within the cabinet after the product is removed from the cabinet.

### Claim 18 (depends on 16)

The method of claim 16, further comprising:
generating the digital map of the products within the cabinet using data received from the at least one of a camera or a sensor.

### Claim 19 (depends on 16)

The method of claim 16, wherein the digital map comprises a location and a model of each product within the cabinet.

### Claim 20 (depends on 16)

The method of claim 16, further comprising detecting an identifier of the product removed from the cabinet via an identifier sensor.
