# US 2024/0004391 A1 · Collaborative order fulfillment systems and methods

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0004391 A1
- Document ID: US20240004391A1
- Status: Published application
- Kind: A1
- Application number: 18/217,991
- Filed: 2023-07-03
- Published: 2024-01-04
- Earliest claimed: 2022-07-01
- Assignees: IAM Robotics, LLC
- Applicants: IAM Robotics, LLC
- Inventors: Thomas Galluzzo; Christopher J. Sullivan
- Web page: https://patentgrep.com/patent/US20240004391A1

## CPC

- G05D 1/0214: {in accordance with safety or protection criteria, e.g. avoiding hazardous areas (monitoring the location of vehicles within a certain area, e.g. forbidden or allowed areas, in traffic control systems for road vehicles G08G1/13)}
- B65G 1/1373: {for fulfilling orders in warehouses}
- B65G 1/1375: {the orders being assembled on a commissioning stacker-crane or truck}
- G05D 1/0274: {using mapping information stored in a memory device (navigation using map-matching G01C21/30)}
- G05D 1/246: using environment maps, e.g. simultaneous localisation and mapping [SLAM]
- G05D 1/617: Safety or protection, e.g. defining protection zones around obstacles or avoiding hazards (arrangements for controlling the position or course of two or more vehicles for avoiding collisions therebetween G05D1/693; arrangements for reacting to or preventing system or operator failure G05D1/80)
- G05D 1/6987: {by centralised control off-board any of the vehicles}
- G06Q 10/08: Logistics, e.g. warehousing, loading or distribution; Inventory or stock management
- G06Q 10/087: Inventory or stock management, e.g. order filling, procurement or balancing against orders
- G06V 10/141: Control of illumination
- G05D 2105/28: of freight
- G05D 2107/70: Industrial sites, e.g. warehouses or factories
- G05D 2109/10: Land vehicles
- G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- B65G: TRANSPORT OR STORAGE DEVICES, e.g. CONVEYORS FOR LOADING OR TIPPING, SHOP CONVEYOR SYSTEMS OR PNEUMATIC TUBE CONVEYORS (packaging B65B; handling thin or filamentary materials, e.g. paper sheets or thread, B65H; cranes B66C; portable mobile or lifting or hauling appliances, e.g. hoists, B66D; devices for lifting or lowering goods for loading or unloading purposes, e.g. fork-lift trucks, B66F9/00; emptying bottles, jars, casks, barrels or similar containers, not otherwise provided for, B67C9/00; delivering or transferring liquids B67D; filling or discharging vessels for liquefied, solidified or compressed gases F17C; pipe-line systems for fluids F17D)
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A “meet me” model of collaboration among autonomous mobile robots (AMRs) and human workers (pickers) to execute picking and putting within a logistics facility. The AMRs include an intelligent platform having an array of indicator elements that illuminate subsets of the indicator elements to indicate tote locations and numbers of items to be received therein. The pickers receive instructions from a central server on a user device that they hold or wear, and the AMRs receive a list of stop locations within the logistics facility. Selection of the picker to provide an item to an AMR as it approaches one of the stop locations may be dynamic as each picker instruction includes a single item type to be delivered to/from an AMR. Moreover, the central server determines timing for sending the instructions to a user device based on a location of the robot designated to collect an item, thus streamlining workflows for each of the AMR and picker.

## Claims

### Claim 1

An autonomous mobile robot comprising:
a mobile base comprising a processor, a memory, a remote communication interface, and sensors including forward and rear facing cameras and a navigation sensor; and
a platform positioned above and vertically separated from the mobile base, the platform comprising an array of indicators spaced along opposing first and second horizontal edges thereof, and a pick to light controller in communication with the array of indicators and the processor of the mobile base,
wherein the pick to light controller is configured to illuminate subsets of the array of indicators to define individual regions of the platform that delimit positions for tote placement based on instructions from the processor, and
wherein the memory comprises computer program instructions executable by the processor to receive data from and send data to a central server, process data received from each of the plurality of sensors, and output control signals to the mobile base for autonomous navigation and obstacle avoidance.

### Claim 2 (depends on 1)

The robot of claim 1, wherein each indicator in the array of indicators comprises a seven-segment display and an assignable selection button comprising an LED and, based on instruction received by the processor from the central server, the pick to light controller is configured to cause a target subset of indicators to define a position of a target tote on the platform, wherein the selection buttons of the target set of indicators illuminate or change color and at least one of the seven-segment displays of the target set of indicators display a number of items to be placed in the target tote.

### Claim 3 (depends on 2)

The robot of claim 2, wherein the pick to light controller is further configured to cause the selection buttons of the target set of indicators defining the position of the target tote on the platform to darken or change color when one of the selection buttons of the target set of indicators is selected, and wherein the mobile base is configured to send a pick complete signal to the central server when the one of the selection buttons is selected.

### Claim 4 (depends on 2)

The robot of claim 2, wherein the pick to light controller is configured to cause the selection buttons of each subset of the array of indicators to illuminate with a different or alternating light color to delimit positions for tote placement.

### Claim 5 (depends on 1)

The robot of claim 1, wherein the array of indicators spaced along a first horizontal edge of the platform are configured to operate separately from or in tandem with the array of indicators spaced along a second horizontal edge of the platform opposite the first horizontal edge.

### Claim 6 (depends on 1)

The robot of claim 1, comprising two or more platforms positioned above and vertically separated from the mobile base and from each other.

### Claim 7 (depends on 6)

The robot of claim 6, wherein each of the two or more platforms are supported by at least two vertical posts attached to a top surface of the mobile base, wherein each of the at least two platforms is adjustably attachable to the two or more vertical posts along opposing third and fourth horizontal edges thereof.

### Claim 8 (depends on 1)

The robot of claim 1, wherein the navigation sensor comprises a laser ranging device or a fish-eye camera.

### Claim 9 (depends on 1)

The robot of claim 1, wherein both of the mobile base and the platform are absent a display screen or user interface configured for data input.

### Claim 10 (depends on 1)

The robot of claim 1, wherein the processor of the mobile base is configured to:
receive from the central server a task list comprising a list of coordinates of stop locations, and
determine a navigation route to each of the stop locations based on a facility map of a logistics facility stored in the memory of the mobile base,
wherein the facility map defines virtual roads navigatable by the mobile base, and wherein the virtual roads include a plurality of nodes.

### Claim 11 (depends on 10)

The robot of claim 10, wherein the robot is configured to communicated with the central server at each node on the navigation route to receive a stop or proceed instruction based on traffic of other robots in the logistics facility.

### Claim 12

A system for order fulfillment in a logistics facility, the system comprising:
an autonomous mobile robot comprising:
a mobile base comprising a processor, a memory, a remote communication interface, and sensors including forward and rear facing cameras and a navigation sensor, and
a platform positioned above and vertically separated from the mobile base, the platform comprising an array of indicators spaced along opposing first and second horizontal edges thereof, and a pick to light controller in communication with the array of indicators and the processor of the mobile base,
wherein both of the mobile base and the platform are absent a display screen or user interface configured for data input,
wherein the pick to light controller is configured to illuminate subsets of the array of indicators to define individual regions of the platform that delimit positions for tote placement based on instructions from the processor, and
wherein the memory comprises computer program instructions executable by the processor to receive data from and send data to a central server, process data received from each of the plurality of sensors, and output control signals to the mobile base for autonomous navigation and obstacle avoidance; and
a user device designed to be worn or held by a human picker, the user device comprising:
a housing comprising a reader processor, a reader memory, a reader communication interface, a reader sensor, and a display screen,
wherein the user device is configured to receive from the central server identification information for a pick or put item and a number of the pick or put item, and display the identification information and number on the display screen.

### Claim 13 (depends on 12)

The system of claim 12, wherein the user device is further configured to read any one or more of: an item ID tag on the pick or put item, a shelf ID tag on a shelf holding the pick or put item, and a bin ID tag of a bin in which the pick or put item is stored on the shelf, and send information regarding the read to the central server.

### Claim 14 (depends on 12)

The system of claim 12, wherein each indicator in the array of indicators comprises a seven-segment display and an assignable selection button comprising an LED and, based on instruction received by the processor from the central server, the pick to light controller is configured to cause a target subset of indicators to define a position of a target tote on the platform, wherein the selection buttons of the target set of indicators illuminate or change color and at least one of the seven-segment displays of the target set of indicators display a number of items to be placed in the target tote.

### Claim 15 (depends on 14)

The system of claim 14, wherein the pick to light controller is further configured to cause the selection buttons of the target set of indicators defining the position of the target tote on the platform to darken or change color when one of the selection buttons of the target set of indicators is selected, and wherein the mobile base is configured to send a pick complete signal to the central server when the one of the selection buttons is selected.

### Claim 16 (depends on 14)

The system of claim 14, wherein the pick to light controller is configured to cause the selection buttons of each subset of the array of indicators to illuminate with a different or alternating light color to delimit positions for tote placement.

### Claim 17 (depends on 13)

The system of claim 13, wherein the array of indicators spaced along a first horizontal edge of the platform are configured to operate separately from or in tandem with the array of indicators spaced along a second horizontal edge of the platform opposite the first horizontal edge.

### Claim 18 (depends on 12)

The system of claim 12, wherein the navigation sensor of the mobile robot comprises a laser ranging device or a fish-eye camera.

### Claim 19 (depends on 12)

The system of claim 12, wherein the processor of the mobile base is configured to:
receive, from the central server, a task list comprising a list of coordinates of stop locations, and
determine a navigation route to each of the stop locations based on a facility map of a logistics facility stored in the memory of the mobile base,
wherein the facility map defines virtual roads navigatable by the mobile base, and wherein the virtual roads include a plurality of nodes.

### Claim 20 (depends on 19)

The system of claim 19, wherein the robot is configured to communicated with the central server at each node on the navigation route to receive a stop or proceed instruction based on traffic of other robots in the logistics facility.
