System and methods for reducing multi-container packing errors

One or more non-transitory computer-readable media storing instructions that, when executed by one or more processors, cause the one or more processors to perform operations comprising:

• receiving image data of a packing event occurring in a packing area, the packing event including a plurality of items and a first container;
• determining, based at least in part on the image data, segmented and classified image data, the segmented and classified image data including data representing a class associated with a first item of the plurality of items and data associated with the first container;
• generating, based at least in part the data associated with the first container, a pixel mapping representing the packing area, the pixel mapping including a first pixel region associated with the first container;
• determining, based at least in part on the class of the first item, the first container to receive the first item;
• determining, based at least in part on the pixel mapping and the segmented and classified image data, an area associated with a placement of the first item;
• determining, based at least in part on the pixel mapping and the area, that the first item was placed in the first container by an agent;
• and
• responsive to determining that the first item was placed in the first container by an agent:
• determining a counter metric for the first container, the counter metric indicating a number of items of the class placed in the container;
• and
• sending an alert to the agent notifying the agent to proceed with a next item of the plurality of items.

A system comprising:

• an image device to capture first image data associated with a packing event occurring in a packing area, the packing event including a first item and one or more containers;
• a display within the packing area;
• one or more processors;
• one or more non-transitory computer-readable media storing instructions that, when executed by the one or more processors, cause the one or more processors to perform operations comprising:
• receiving, from the image device, the first image data of the packing event, the packing event including a first container and a second container;
• determining, based at least in part on the first image data, segmented and classified image data, the segmented and classified image data including data representing a class associated with the first item and data associated with the two or more containers;
• generating, based at least in part the data associated with the two or more container, a pixel mapping representing the packing area, the pixel mapping including a first pixel region associated with a first container of the two or more containers and a second pixel region associated with a second container of the two or more containers;
• determining, based at least in part on the pixel mapping and the segmented and classified image data, an area location associated with the pixel mapping and a placement of the first item;
• determining, based at least in part on the area and the pixel mapping, that the first item was not placed in the first container by an agent;
• sending a first alert to the display, the first alert notifying an agent to repack the first item;
• receiving, from the image device, second image data of the packing event occurring in the packing area;
• determining, based at least in part on the second image data, that the first item was repacked in the first container by the agent;
• and
• sending a second alert to the display, the second alert notifying the agent to proceed with a next item.