# US 2026/0065221 A1 · Systems and methods for training data generation for object identification and self-checkout anti-theft

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0065221 A1
- Document ID: US20260065221A1
- Status: Published application
- Kind: A1
- Application number: 19/379,957
- Filed: 2025-11-05
- Published: 2026-03-05
- Earliest claimed: 2018-04-18
- Assignees: Maplebear Inc.
- Applicants: Maplebear Inc.
- Inventors: Lin Gao; Yilin Huang; Shiyuan Yang; Ahmed Beshry; Michael Sanzari; Jungsoo Woo; Sarang Zambare; Griffin Kelly
- Web page: https://patentgrep.com/patent/US20260065221A1

## CPC

- G06Q 10/087: Inventory or stock management, e.g. order filling, procurement or balancing against orders
- G06F 18/214: Generating training patterns; Bootstrap methods, e.g. bagging or boosting
- G06N 3/0442: characterised by memory or gating, e.g. long short-term memory [LSTM] or gated recurrent units [GRU]
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06N 3/08: Learning methods
- G06N 3/09: Supervised learning
- G06N 3/096: Transfer learning
- G06N 3/098: Distributed learning, e.g. federated learning
- G06Q 10/08778: {for managing mis-shipments, lost items or stolen goods}
- G06Q 20/201: {Price look-up processing, e.g. updating}
- G06Q 20/203: {Inventory monitoring}
- G06Q 20/208: {Input by product or record sensing, e.g. weighing or scanner processing}
- G06V 10/454: {Integrating the filters into a hierarchical structure, e.g. convolutional neural networks [CNN]}
- G06V 10/772: Determining representative reference patterns, e.g. averaging or distorting patterns; Generating dictionaries
- G06V 10/82: using neural networks
- G06V 20/20: in augmented reality scenes
- G07G 1/0063: {with means for detecting the geometric dimensions of the article of which the code is read, such as its size or height, for the verification of the registration}
- G07G 1/0081: {the reader being a portable scanner or data reader (G07G1/009 takes precedence)}
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G07G: REGISTERING THE RECEIPT OF CASH, VALUABLES, OR TOKENS

## Abstract

Disclosed are technologies for generating training data for identification neural networks. Series of images are captured of a plurality of merchandise items from different angles and with different background assortments of other merchandise items. A labeled training dataset is generated for the plurality of merchandise items. The series of captured images is normalized, where the merchandise occupies a threshold percentage of pixels in the normalized image. The training dataset is extended by applying augmentation operations to the normalized images to generate a plurality of augmented images. Each image is stored in the training dataset as a unique training data point for the given merchandise item it depicts. Labels are generated mapping each training data point to attributes associated with the depicted merchandise item. Input neural networks are trained on the labeled training dataset to perform real-time identification of selected merchandise items placed into a self-checkout apparatus by a user.

## Claims

### Claim 1

A method comprising:
obtaining, for each item of a plurality of items, a set of captured images depicting the item from multiple angles, wherein the set of captured images comprises images captured from a plurality of cameras, each camera having a point-of-view associated with one of the multiple angles;
generating labeled training datasets for the plurality of items for each of the plurality of cameras, wherein generating a labeled training dataset for a camera comprises, for a subset of the set of captured images depicting an item at one of the multiple angles:
normalizing the subset of captured images to generate a set of normalized images, wherein the item occupies at least a threshold percentage of pixels in each normalized image;
populating the training dataset with a plurality of training data points for the item, wherein each one of the normalized images is represented by at least one training data point; and
labeling the training dataset by generating one or more labels for each training data point, the one or more labels mapping the training data point to the item depicted in the training data point; and
training an input neural network for each camera of the plurality of cameras based on the labeled training dataset generated for the camera, wherein each input neural network is trained such that a resulting trained neural network can perform real-time identification of items placed into a self-checkout apparatus by a user.

### Claim 2 (depends on 1)

The method of claim 1, wherein:
each of the input neural networks is an object classification neural network; and
the labeled training dataset for each camera of the plurality of cameras is a labeled object classification training dataset containing training data points for each item belonging to an inventory of items.

### Claim 3 (depends on 2)

The method of claim 2, wherein:
the trained input neural network is a feature extraction neural network; and
the labeled training dataset is a labeled feature extraction training dataset containing training data points for only a subset of the items belonging to the inventory of merchandise items.

### Claim 4 (depends on 1)

The method of claim 1, wherein at least a portion of the labeled training dataset is automatically generated for a user-selected item, the generating triggered in response to one or more of:
a determination that the user-selected item has been placed in a self-checkout apparatus.

### Claim 5 (depends on 1)

The method of claim 1, wherein at least a portion of the labeled training dataset is automatically generated for a user-selected item, the generating triggered in response to one or more of:
an indication that a barcode, Universal Product Code (UPC), or item identifier for the user-selected item has been determined at the self-checkout apparatus.

### Claim 6 (depends on 1)

The method of claim 1, wherein normalizing the subset of captured images comprises cropping each captured image such that a given item occupies a substantially constant proportion of a frame of each normalized merchandise image.

### Claim 7 (depends on 6)

The method of claim 6, wherein cropping each captured image comprises:
cropping to a predicted bounding box representing a probable location of the given merchandise item in the frame of the captured image, wherein the predicted bounding box is generated by a computer vision object tracking system that tracks the given merchandise item as it is maneuvered into place for obtaining the set of captured images.

### Claim 8

A non-transitory computer-readable medium storing computer-executable instructions that, when executed, cause a computer system to perform operations comprising:
obtaining, for each item of a plurality of items, a set of captured images depicting the item from multiple angles, wherein the set of captured images comprises images captured from a plurality of cameras, each camera having a point-of-view associated with one of the multiple angles;
generating labeled training datasets for the plurality of items for each of the plurality of cameras, wherein generating a labeled training dataset for a camera comprises, for a subset of the set of captured images depicting an item at one of the multiple angles:
normalizing the subset of captured images to generate a set of normalized images, wherein the item occupies at least a threshold percentage of pixels in each normalized image;
populating the training dataset with a plurality of training data points for the item, wherein each one of the normalized images is represented by at least one training data point; and
labeling the training dataset by generating one or more labels for each training data point, the one or more labels mapping the training data point to the item depicted in the training data point; and
training an input neural network for each camera of the plurality of cameras based on the labeled training dataset generated for the camera, wherein each input neural network is trained such that a resulting trained neural network can perform real-time identification of items placed into a self-checkout apparatus by a user.

### Claim 9 (depends on 8)

The computer-readable medium of claim 8, wherein:
each of the input neural networks is an object classification neural network; and
the labeled training dataset for each camera of the plurality of cameras is a labeled object classification training dataset containing training data points for each item belonging to an inventory of items.

### Claim 10 (depends on 9)

The computer-readable medium of claim 9, wherein:
the trained input neural network is a feature extraction neural network; and
the labeled training dataset is a labeled feature extraction training dataset containing training data points for only a subset of the items belonging to the inventory of merchandise items.

### Claim 11 (depends on 8)

The computer-readable medium of claim 8, wherein at least a portion of the labeled training dataset is automatically generated for a user-selected item, the generating triggered in response to one or more of:
a determination that the user-selected item has been placed in a self-checkout apparatus.

### Claim 12 (depends on 8)

The computer-readable medium of claim 8, wherein at least a portion of the labeled training dataset is automatically generated for a user-selected item, the generating triggered in response to one or more of:
an indication that a barcode, Universal Product Code (UPC), or item identifier for the user-selected item has been determined at the self-checkout apparatus.

### Claim 13 (depends on 8)

The computer-readable medium of claim 8, wherein normalizing the subset of captured images comprises cropping each captured image such that a given item occupies a substantially constant proportion of a frame of each normalized merchandise image.

### Claim 14 (depends on 13)

The computer-readable medium of claim 13, wherein cropping each captured image comprises:
cropping to a predicted bounding box representing a probable location of the given merchandise item in the frame of the captured image, wherein the predicted bounding box is generated by a computer vision object tracking system that tracks the given merchandise item as it is maneuvered into place for obtaining the set of captured images.

### Claim 15

A system comprising:
a processor; and
a non-transitory computer-readable medium storing computer-executable instructions that, when executed, cause the system to perform operations comprising:
obtaining, for each item of a plurality of items, a set of captured images depicting the item from multiple angles, wherein the set of captured images comprises images captured from a plurality of cameras, each camera having a point-of-view associated with one of the multiple angles;
generating labeled training datasets for the plurality of items for each of the plurality of cameras, wherein generating a labeled training dataset for a camera comprises, for a subset of the set of captured images depicting an item at one of the multiple angles:
normalizing the subset of captured images to generate a set of normalized images, wherein the item occupies at least a threshold percentage of pixels in each normalized image;
populating the training dataset with a plurality of training data points for the item, wherein each one of the normalized images is represented by at least one training data point; and
labeling the training dataset by generating one or more labels for each training data point, the one or more labels mapping the training data point to the item depicted in the training data point; and
training an input neural network for each camera of the plurality of cameras based on the labeled training dataset generated for the camera, wherein each input neural network is trained such that a resulting trained neural network can perform real-time identification of items placed into a self-checkout apparatus by a user.

### Claim 16 (depends on 15)

The system of claim 15, wherein:
each of the input neural networks is an object classification neural network; and
the labeled training dataset for each camera of the plurality of cameras is a labeled object classification training dataset containing training data points for each item belonging to an inventory of items.

### Claim 17 (depends on 16)

The system of claim 16, wherein:
the trained input neural network is a feature extraction neural network; and
the labeled training dataset is a labeled feature extraction training dataset containing training data points for only a subset of the items belonging to the inventory of merchandise items.

### Claim 18 (depends on 15)

The system of claim 15, wherein at least a portion of the labeled training dataset is automatically generated for a user-selected item, the generating triggered in response to one or more of:
a determination that the user-selected item has been placed in a self-checkout apparatus.

### Claim 19 (depends on 15)

The system of claim 15, wherein at least a portion of the labeled training dataset is automatically generated for a user-selected item, the generating triggered in response to one or more of:
an indication that a barcode, Universal Product Code (UPC), or item identifier for the user-selected item has been determined at the self-checkout apparatus.

### Claim 20 (depends on 15)

The system of claim 15, wherein normalizing the subset of captured images comprises cropping each captured image such that a given item occupies a substantially constant proportion of a frame of each normalized merchandise image.
