US 12,602,938 B2Granted

System and method for item identification using container-based classification

Assignee7-Eleven, Inc.

InventorsSailesh Bharathwaaj Krishnamurthy, Sumedh Vilas Datar, Crystal Maung

Life of this patent

Estimating the term…

Loading patent…

Abstract

A device detects a triggering event that corresponds to a placement of an item on a platform. In response, the device captures an image of the item and generates a first encoded vector for the image. The first encoded vector describes one or more attributes of the item. The device determines that the item is associated with a first container category based on the one or more attributes of the item. The device identifies one or more items that have been identified as having placed inside a container associated with the first container category. The device displays a list of item options that comprises the one or more items on a graphical user interface (GUI). The device receives a selection of a first item from along the list of item options and identifies the first item as being inside the container.

Claims20

Dependent claims

A system, comprising:

a plurality of cameras, wherein each camera is configured to capture images of at least a portion of a platform;
a memory configured to store an encoded vector library comprising a plurality of encoded vectors, wherein:
each encoded vector describes one or more attributes of a respective item;
and
each encoded vector is associated with a respective container category for the respective item;
and
one or more processors communicatively coupled to the memory, the one or more processors configured to:
detect a triggering event at the platform, wherein the triggering event corresponds to a placement of an item on the platform;
in response to detecting the triggering event, capture an image of the item using at least one camera from among the plurality of cameras;
generate a first encoded vector for the image, wherein the first encoded vector describes one or more attributes of the item;
determine that the item is associated with a first container category based at least in part upon the one or more attributes of the item;
identify one or more items that have been identified as having been placed inside a container associated with the first container category;
display on a graphical user interface (GUI) a list of item options that comprises the one or more items;
receive a selection of a first item from among the list of item options;
and
identify the first item as being placed inside the container.

13 more elements

A non-transitory computer-readable medium storing instructions that when executed by one or more processors, cause the one or more processors to:

detect a triggering event at a platform, wherein the triggering event corresponds to a placement of an item on the platform;
in response to detecting the triggering event, capture an image of the item using at least one camera from among a plurality of cameras, wherein each camera is configured to capture images of at least a portion of the platform;
generate a first encoded vector for the image, wherein the first encoded vector describes one or more attributes of the item;
determine that the item is associated with a first container category based at least in part upon the one or more attributes of the item;
identify one or more items that have been identified as having been placed inside a container associated with the first container category;
display on a graphical user interface (GUI) a list of item options that comprises the one or more items;
receive a selection of a first item from among the list of item options;
and
identify the first item as being placed inside the container.

6 more elements

Dependencies are inferred from the claim text.

Facts

Application: 18/476,497Filed 28 Sep 2023 · continuation in part
Priority: 29 Jun 2021
Published: US 2024/0020857 A118 Jan 2024
Granted: 14 Apr 2026
Term ends: Not estimatedThe source records don’t support an estimate.

Classification21 codes

G06V 20/52
Context or environment of the image: surveillance or monitoring of activities, e.g. for recognising suspicious objects
G06V 20/68
Type of objects: food, e.g. fruit or vegetables
G06Q 30/0633
Electronic shopping [e-shopping]: managing shopping lists, e.g. compiling or processing purchase lists
G06T 7/0008
Industrial image inspection: checking presence/absence

Family

Application17/362,261Parent of this continuation-in-part · filed 29 Jun 2021
Application17/455,903Parent of this continuation-in-part · filed 19 Nov 2021
Application18/366,155Parent of this continuation-in-part · filed 7 Aug 2023
US 2024/0020993 A1Pre-grant publication · published 18 Jan 2024
US 12,217,441 B2Parent of this continuation-in-part
US 11,887,332 B2Parent of this continuation-in-part
US 12,536,673 B2Related patent
US 2022/0414899 A1Published application
US 2022/0414924 A1Published application
US 2024/0020857 A1Published application
US 12,602,938 B2This patent

From the US filing history. Foreign family members aren’t listed.