# US 2021/0174431 A1 · Automated object recognition kiosk for retail checkouts

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0174431 A1
- Document ID: US20210174431A1
- Status: Published application
- Kind: A1
- Application number: 17/129,296
- Filed: 2020-12-21
- Published: 2021-06-10
- Earliest claimed: 2013-10-17
- Assignees: Mashgin Inc.
- Applicants: Mashgin Inc.
- Inventors: Mukul Dhankhar
- Web page: https://patentgrep.com/patent/US20210174431A1

## CPC

- G06Q 30/0641: {utilising user interfaces specially adapted for shopping}
- G01G 19/40: with provisions for indicating, recording, or computing price or other quantities dependent on the weight (indicating means for weighing apparatus G01G23/18; recording means for weighing apparatus G01G23/18; computers in general G06)
- G06Q 20/208: {Input by product or record sensing, e.g. weighing or scanner processing}
- G07G 1/0063: {with means for detecting the geometric dimensions of the article of which the code is read, such as its size or height, for the verification of the registration}
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G01G: WEIGHING (sorting by weighing B07C5/16)
- G07G: REGISTERING THE RECEIPT OF CASH, VALUABLES, OR TOKENS

## Abstract

A system, method, and apparatus for automated object recognition and checkout at a retail kiosk is provided. The system includes a controller configured with a processor and a memory to control operations of the automated retail checkout system. The system further includes an imaging device in communication with the controller and configured to create multiple electronic images of an object, such as a product for purchase. The system also includes an object recognition device in communication with the controller and the imaging device. The processor may execute software to receive electronic images from the imaging device, extract at least one feature from the images, and recognize the object based on a predetermined model being applied to the extracted feature from the images. The system also includes a display device to display an indication of the recognized object from the object recognition device.

## Claims

### Claim 1

A system for object identification, comprising:
a measurement volume cooperatively defined by a support component, a bottom component, and a head component, wherein the support component supports the head component above the bottom component, wherein the measurement volume comprises a first side defined by the support component and three substantially open sides;
the head component that encloses a top of the measurement volume, wherein the head component comprises:
a front optical sensor that is positioned proximal a front edge of the head component, wherein a field of view of the front optical sensor encompasses a back edge of the measurement volume;
a back optical sensor that is positioned proximal a back edge of the head component, wherein a field of view of the back optical sensor encompasses a front edge of the measurement volume;
a left optical sensor that is positioned proximal a left side of the measurement volume, wherein a field of view of the left optical sensor encompasses a right edge of the measurement volume; and
a right optical sensor that is positioned proximal a right side of the measurement volume, wherein a field of view of the right optical sensor is encompasses a left edge of the measurement volume; and
a processing system configured to automatically recognize at least one food object using an image from at least one of the optical sensors.

### Claim 2 (depends on 1)

The system of claim 1, wherein the front, back, left, and right optical sensors comprise camera pairs.

### Claim 3 (depends on 1)

The system of claim 1, further comprising a first and second top optical sensor mounted to a central region of the head component, wherein a first and second field of view of the first and second top optical sensors are directed downward, respectively.

### Claim 4 (depends on 3)

The system of claim 3, wherein the first top optical sensor comprises a color camera.

### Claim 5 (depends on 4)

The system of claim 4, wherein the second top optical sensor comprises a 3D scanner.

### Claim 6 (depends on 1)

The system of claim 1, wherein the bottom component is static relative to the head component and comprises a calibration pattern.

### Claim 7 (depends on 6)

The system of claim 6, wherein the calibration pattern is embedded into the bottom component.

### Claim 8 (depends on 6)

The system of claim 6, wherein the calibration pattern is visible in the image.

### Claim 9 (depends on 6)

The system of claim 6, wherein the processing system is configured to periodically recalibrate the optical sensors based on an appearance of the calibration pattern in images captured by the optical sensors.

### Claim 10 (depends on 1)

The system of claim 1, wherein images from at least one optical sensor are used by the processing system to track a movement in the measurement volume.

### Claim 11 (depends on 10)

The system of claim 10, wherein the support component comprises an optical sensor, wherein the optical sensor of the support component is configured to capture the images for tracking the movement in the measurement volume.

### Claim 12 (depends on 1)

The system of claim 1, further comprising a light component mounted to the head component, positioned between the front, back, left and right optical sensors, and wherein the light component is configured to illuminate the measurement volume with diffused light.

### Claim 13 (depends on 1)

The system of claim 1, wherein a lateral extent of the head component is coextensive with a lateral extent of the bottom component.

### Claim 14 (depends on 1)

The system of claim 1, wherein the system further comprises a weight sensor.

### Claim 15 (depends on 14)

The system of claim 14, wherein the weight sensor is mounted to the bottom component.

### Claim 16 (depends on 1)

The system of claim 1, wherein the processing system is communicatively connected to a POS terminal, wherein the processing system is automatically configured to generate a transaction based on the recognized food object.

### Claim 17

A checkout kiosk, comprising:
a support component;
a head component comprising a 3D scanner;
a bottom component configured to receive an object, wherein the support component statically retains the bottom component below the head component;
a front optical system that is positioned proximal a front edge of the head component, wherein a field of view of the front optical system encompasses a back edge of the bottom component;
a back optical system that is positioned proximal a back edge of the head component, wherein a field of view of the back optical system encompasses a front edge of the bottom component;
a left optical system, wherein a field of view of the left optical system encompasses a right edge of the bottom component; and
a right optical system, wherein a field of view of the right optical system encompasses a left edge of the bottom component; and
a processing system configured to automatically recognize at least one food object using an image from at least one of the optical systems.

### Claim 18 (depends on 17)

The system of claim 17, wherein the bottom component comprises a calibration pattern, wherein the processing system is configured to periodically recalibrate the optical systems based on an appearance of the calibration pattern in images captured by the optical systems.

### Claim 19 (depends on 17)

The system of claim 17, wherein the front, back, left, and right optical systems comprise camera pairs.

### Claim 20 (depends on 17)

The system of claim 17, wherein the processing system is communicatively connected to a POS terminal, wherein the processing system is automatically configured to generate a transaction based on the recognized food object.
