# US 12,179,822 B2 · System for registering an item stored in a shopping cart > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,179,822 B2 - Document ID: US12179822B2 - Status: Granted - Kind: B2 - Application number: 18/486,111 - Filed: 2023-10-12 - Published: 2024-09-26 - Granted: 2024-12-31 - Earliest claimed: 2023-03-24 - Assignees: Toshiba Tec Kabushiki Kaisha - Applicants: Toshiba Tec Kabushiki Kaisha - Inventors: Tetsuya Nobuoka - Web page: https://patentgrep.com/patent/US12179822B2 ## CPC - B62B 3/1424: {Electronic display devices} - G06Q 20/18: involving self-service terminals [SST], vending machines, kiosks or multimedia terminals - G06Q 20/208: {Input by product or record sensing, e.g. weighing or scanner processing} - G06Q 30/0641: {utilising user interfaces specially adapted for shopping} - G06V 10/44: Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components - G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69) - G07G 1/0036: {Checkout procedures} - G07G 1/0063: {with means for detecting the geometric dimensions of the article of which the code is read, such as its size or height, for the verification of the registration} - G06V 2201/07: Target detection - B62B: HAND-PROPELLED VEHICLES, e.g. HAND CARTS OR PERAMBULATORS; SLEDGES (characterised by animal propulsion B62C; propulsion of sledges by driver or engine B62M) - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - G07G: REGISTERING THE RECEIPT OF CASH, VALUABLES, OR TOKENS ## Abstract A system for registering an item stored in a shopping cart, includes a terminal attachable to the shopping cart and one or more cameras attached to the shopping cart and positioned to face an opening of the shopping cart through which an item is put therein by a customer. The terminal includes an interface circuit connectable to the cameras, and a processor configured to: acquire first images captured by the cameras, execute image recognition on each of the first images to identify an item and one or more feature points each corresponding to a part of a hand of the customer in said each of the first images, select one of the first images in which an item is identified and a smaller number of feature points are identified, and determine the item in the selected first image to be registered for purchase by the customer. ## Claims ### Claim 1 A system for registering an item stored in a shopping cart, comprising: a terminal attachable to the shopping cart; and one or more cameras attached to the shopping cart and positioned to face an opening of the shopping cart through which an item is put therein by a customer, wherein the terminal includes: an interface circuit connectable to the cameras, and a processor configured to: acquire first images captured by the cameras, execute image recognition on each of the first images to identify an item and one or more feature points each corresponding to a part of a hand of the customer in said each of the first images, select one of the first images in which an item is identified and a smallest number of feature points are identified, and determine that the item in the selected first image is to be registered for purchase by the customer. ### Claim 2 (depends on 1) The system according to claim 1, wherein the processor is configured to: acquire second images captured by the cameras, execute image recognition on each of the second images to identify an item and one or more feature points each corresponding to a part of a hand of the customer in said each of the second images, select one of the second images in which an item is identified and a smallest number of feature points are identified, determine whether the item in the selected first image and the item in the selected second image are identical, and upon determining that the item in the selected first image and the item in the selected second image are identical, register the item for purchase by the customer. ### Claim 3 (depends on 1) The system according to claim 1, wherein the cameras include two cameras facing different directions, and each of the two cameras captures a corresponding one of the first images at the same time. ### Claim 4 (depends on 1) The system according to claim 1, wherein the processor is configured to, when no item is identified in any first images, but one or more feature points are identified in one of the first images, issue an alert signal. ### Claim 5 (depends on 4) The system according to claim 4, wherein the terminal includes a display and a speaker from at least one of which an alert is output upon issuance of the alert signal. ### Claim 6 (depends on 1) The system according to claim 1, wherein the processor is configured to, when an item is identified in one of the first images, but no feature points are identified in any first images, determine that the item is to be registered for purchase by the customer. ### Claim 7 (depends on 1) The system according to claim 1, wherein each feature point corresponds to a finger joint, a fingertip, or a wrist. ### Claim 8 A method for registering an item stored in a shopping cart, the method comprising: capturing first images by one or more cameras attached to the shopping cart and positioned to face an opening of the shopping cart through which an item is put therein by a customer; executing image recognition on each of the first images to identify an item and one or more feature points each corresponding to a part of a hand of the customer in said each of the first images; selecting one of the first images in which an item is identified and a smallest number of feature points are identified; and determining that the item in the selected first image is to be registered for purchase by the customer. ### Claim 9 (depends on 8) The method according to claim 8, further comprising: capturing second images by the cameras; executing image recognition on each of the second images to identify an item and one or more feature points each corresponding to a part of a hand of the customer in said each of the second images; selecting one of the second images in which an item is identified and a smallest number of feature points are identified; and determining that the item in the selected first image and the item in the selected second image are identical, and registering the item for purchase by the customer. ### Claim 10 (depends on 8) The method according to claim 8, wherein the cameras include two cameras facing different directions, and each of the two cameras captures a corresponding one of the first images at the same time. ### Claim 11 (depends on 8) The method according to claim 8, further comprising: determining that no item is identified in any first images, but one or more feature points are identified in one of the first images, and issuing an alert signal. ### Claim 12 (depends on 11) The method according to claim 11, further comprising: outputting an alert from at least one of a display and a speaker upon issuance of the alert signal. ### Claim 13 (depends on 8) The method according to claim 8, further comprising: determining that an item is identified in one of the first images, but no feature points are identified in any first images, and determining that the item is to be registered for purchase by the customer. ### Claim 14 (depends on 8) The method according to claim 8, wherein each feature point corresponds to a finger joint, a fingertip, or a wrist. ### Claim 15 A terminal attachable to a shopping cart for registering an item stored therein, comprising: an interface circuit connectable to one or more cameras attached to the shopping cart and positioned to face an opening of the shopping cart through which an item is put therein by a customer; and a processor configured to: acquire first images captured by the cameras, execute image recognition on each of the first images to identify an item and one or more feature points each corresponding to a part of a hand of the customer in said each of the first images, select one of the first images in which an item is identified and a smallest number of feature points are identified, and determine that the item in the selected first image is to be registered for purchase by the customer. ### Claim 16 (depends on 15) The terminal according to claim 15, wherein the processor is configured to: acquire second images captured by the cameras, execute image recognition on each of the second images to identify an item and one or more feature points each corresponding to a part of a hand of the customer in said each of the second images, select one of the second images in which an item is identified and a smallest number of feature points are identified, determine whether the item in the selected first image and the item in the selected second image are identical, and upon determining that the item in the selected first image and the item in the selected second image are identical, register the item for purchase by the customer. ### Claim 17 (depends on 15) The terminal according to claim 15, wherein the cameras include two cameras facing different directions, and each of the two cameras captures a corresponding one of the first images at the same time. ### Claim 18 (depends on 15) The terminal according to claim 15, wherein the processor is configured to, when no item is identified in any first images, but one or more feature points are identified in one of the first images, issue an alert signal. ### Claim 19 (depends on 18) The terminal according to claim 18, further comprising: a display and a speaker, wherein the alert signal causes at least one of the display and the speaker to output an alert. ### Claim 20 (depends on 15) The terminal according to claim 15, wherein the processor is configured to, when an item is identified in one of the first images, but no feature points are identified in any first images, determine that the item is to be registered for purchase by the customer.