# US 2021/0241226 A1 · Robotic arm with an auto-checkout system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0241226 A1
- Document ID: US20210241226A1
- Status: Published application
- Kind: A1
- Application number: 16/779,595
- Filed: 2020-02-01
- Published: 2021-08-05
- Earliest claimed: 2020-02-01
- Assignees: AiFi Corp
- Applicants: AiFi Corp
- Inventors: Ying Zheng; Steve Gu; Tyler Crain; Amith Iyer
- Web page: https://patentgrep.com/patent/US20210241226A1

## CPC

- B25J 9/1679: {characterised by the tasks executed}
- B25J 9/1697: {Vision controlled systems}
- B25J 19/021: {Optical sensing devices}
- B25J 19/023: {including video camera means}
- B65G 1/1373: {for fulfilling orders in warehouses}
- G06Q 10/0875: Itemisation or classification of parts, supplies or services, e.g. bill of materials
- G06Q 30/0633: {Managing shopping lists, e.g. compiling or processing purchase lists (shipping orders G06Q10/083; order filling G06Q10/087)}
- G06T 1/0014: {Image feed-back for automatic industrial control, e.g. robot with camera (robots B25J19/023)}
- G06V 10/10: Image acquisition (document image scanning and transmission H04N1/00; control of digital cameras H04N23/60)
- G05B 2219/45083: Manipulators, robot
- B25J: MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES ({manipulators specially adapted for use in surgery A61B34/70; manipulators used in cleaning hollow articles B08B9/04}; manipulators associated with rolling mills B21B39/20; manipulators associated with forging machines B21J13/10; {manipulators associated with picking-up and placing mechanisms B23P19/007}; means for holding wheels or parts thereof B60B30/00; {vehicles with ground-engaging propulsion means, e.g. walking members B62D57/02, B62D57/032; devices for picking-up and depositing articles or materials between conveyors B65G47/90, B65G47/91; manipulators with gripping or holding means for transferring packages B65H67/065}; cranes B66C; {manipulators used in the protection or supervision of pipe-line installations F17D5/00; walking equipment adapted for nuclear steam-generators F22B37/006}; manipulators specially adapted for, or associated with, nuclear reactors G21C; {apparatus used for handling wafers during manufacture or treatment of semiconductor H10P72/50})
- B65G: TRANSPORT OR STORAGE DEVICES, e.g. CONVEYORS FOR LOADING OR TIPPING, SHOP CONVEYOR SYSTEMS OR PNEUMATIC TUBE CONVEYORS (packaging B65B; handling thin or filamentary materials, e.g. paper sheets or thread, B65H; cranes B66C; portable mobile or lifting or hauling appliances, e.g. hoists, B66D; devices for lifting or lowering goods for loading or unloading purposes, e.g. fork-lift trucks, B66F9/00; emptying bottles, jars, casks, barrels or similar containers, not otherwise provided for, B67C9/00; delivering or transferring liquids B67D; filling or discharging vessels for liquefied, solidified or compressed gases F17C; pipe-line systems for fluids F17D)
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G05B: CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS (systems for controlling or regulating non-electric variables G05D; systems for regulating electric or magnetic variables G05F; control devices or systems insofar as characterised by mechanical features only G05G)

## Abstract

This application relates to systems, methods, devices, and other techniques for robotic arms that can be utilized with an auto-checkout system within a retail environment. This robotic arm is designed to have many functions within a store with auto-checkout system and sometimes can be utilized in a store without human cashier.

## Claims

### Claim 1

A method for using a robotic arm in a retail environment, comprising:
Re-stocking items by the robotic arm in at least one shelves, wherein the robotic arm comprises a rotatable turret, wherein the rotatable turret comprises at least one article-retaining compartments, wherein the rotatable turret are configured to rotate, wherein the robotic arm comprises a picking device coupled to the rotatable torrents, wherein the picking device is configured to pick up the items stocked within the at least one shelves, wherein the picking device a finger-type device, a soft silicon device or a vacuum sucker, wherein the picking device is configured to store the items in the at least one article-retaining compartments, wherein the robotic arm comprises a movement device coupled to the rotatable turret, wherein the movement device is configured to move the rotatable turret vertically and horizontally, wherein a camera system is mounted on a rail system over the ceiling or on a moving cart or on the robotic arm, wherein the camera system is configured to decide whether any items need to be restocked;
Organizing the at least one shelves by retuning misplaced items to right positions within the at least one shelves, wherein the camera system is configured to decide whether any items are misplaced;
Rotating items on the at least one shelves to show front labels of the items to customers by utilizing the rotatable turret, wherein the camera system is configured to decide whether any items have wrong face to the customers; and
Picking items that are in an online order for packaging, wherein a program on a server is configured to receive the online order, decide where items in the online order are located, and send the robotic arm to fetch the items in the online order.

### Claim 2 (depends on 1)

The method for using a robotic arm in a retail environment of claim 1, further comprising: Ordering items when the items of certain kind are in low-stock.

### Claim 3 (depends on 1)

The method for using a robotic arm in a retail environment of claim 1, further comprising: Sending real-time notification when the items of certain kind are in low-stock.

### Claim 4 (depends on 1)

The method for using a robotic arm in a retail environment of claim 1, wherein the camera system is RGB type of camera system.

### Claim 5 (depends on 1)

The method for using a robotic arm in a retail environment of claim 1, wherein the camera system is RGBD type camera system that is configured to locate items in 3D space.

### Claim 6 (depends on 1)

The method for using a robotic arm in a retail environment of claim 1, wherein the camera system is enabled to identify misplaced items.

### Claim 7

A robotic arm in a retail environment, comprising:
a control unit, wherein the control unit gives instructions to the robotic arm and receive online orders;
a rotatable turret, wherein the rotatable turret comprises at least one article-retaining compartments, wherein the rotatable turret is configured to rotate;
a picking device coupled to the rotatable turret, wherein the picking device is configured to pick up items stocked within at least one shelves, wherein the picking device a finger-type device, a soft silicon device or a vacuum sucker, wherein the picking device is configured to store the items in the at least one article-retaining compartments;
a movement device coupled to the rotatable turret, wherein the movement device is configured to move the rotatable turret vertically and horizontally, wherein a camera system is mounted on a rail system over the ceiling or on a moving cart or on the robotic arm, wherein a camera system coupled to the is configured to decide whether any items need to be restocked, wherein the camera system is configured to decide whether any items are misplaced, wherein the camera system is configured to decide whether any items have wrong face to the customers, wherein a program on a server is configured to receive the online order, decide where items in the online order, and send the robotic arm to fetch the items in the online order.

### Claim 8 (depends on 7)

The robotic arm in a retail environment of claim 7, wherein the camera system is RGB type of camera system.

### Claim 9 (depends on 7)

The robotic arm in a retail environment of claim 7, wherein the camera system is RGBD type camera system that is configured to locate items in 3D space.

### Claim 10 (depends on 7)

The robotic arm in a retail environment of claim 7, wherein the camera system is enabled to identify misplaced items.

### Claim 11

A robotic arm in a retail environment, comprising:
a control unit, wherein the control unit gives instructions to the robotic arm and receive online orders;
a rotatable turret coupled to the control unit, wherein the rotatable turret comprises at least one article-retaining compartments, wherein the rotatable turret is configured to rotate;
a picking device coupled to the rotatable turret, wherein the picking device is configured to pick up items stocked within at least one shelves, wherein the picking device a finger-type device, a soft silicon device or a vacuum sucker, wherein the picking device is configured to store the items in the at least one article-retaining compartments;
a movement device coupled to the rotatable turret, wherein the movement device is configured to move the rotatable turret vertically and horizontally, wherein a camera system is mounted on a rail system over the ceiling or on a moving cart or on the robotic arm, wherein a camera system coupled to the is configured to decide whether any items need to be restocked, wherein the camera system is configured to decide whether any items are misplaced, wherein the camera system is configured to decide whether any items have wrong face to the customers, wherein a program on a server is configured to receive the online order, decide where items in the online order, and send the robotic arm to fetch the items in the online order, wherein the robot arm is configured to be connected with an auto-checkout system to identify misplaced items, items that are cluttered together, wherein the robot arm is configured to be connected with the auto-checkout system to correct erroneous receipts generated by the auto-checkout system.
