# US 12,545,467 B2 · System and methods for reducing multi-container packing errors > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,545,467 B2 - Document ID: US12545467B2 - Status: Granted - Kind: B2 - Application number: 19/202,184 - Filed: 2025-05-08 - Published: 2025-08-21 - Granted: 2026-02-10 - Earliest claimed: 2023-09-15 - Assignees: KoiReader Technologies, Inc. - Applicants: KoiReader Technologies, Inc. - Inventors: Ashutosh Prasad; Vivek Prasad - Web page: https://patentgrep.com/patent/US12545467B2 ## CPC - B65B 57/14: and operating to control, or stop, the feed of articles or material to be packaged - B65B 5/06: Packaging groups of articles, the groups being treated as single articles - B65B 57/18: causing operation of audible or visible alarm signals - B65B: MACHINES, APPARATUS OR DEVICES FOR, OR METHODS OF, PACKAGING ARTICLES OR MATERIALS; UNPACKING (bundling and pressing devices for cigars A24C1/44; devices for tensioning and securing binders adapted to be supported by the article or articles to be bound B25B25/00; applying closure members to bottles, jars or similar containers B67B1/00-B67B6/00; concurrent cleaning, filling and closing of bottles B67C7/00; emptying bottles, jars, cans, casks, barrels or similar containers B67C9/00) ## Abstract A system and devices for automating and computerizing audits, tracking, and error prevention associated with container packing events and, in particular, multi-container packing events at a storage facility, yard, warehouse, or the like. In some cases, the systems and devices may be configured to monitor and detect errors or issues with packing items and send alerts and control signals to agents, such as autonomous agents, to correct the detected errors. ## Claims ### Claim 1 A method comprising: receiving first image data of a packing event occurring in a packing area, the packing event including at least a first item and at least a first container and a second container; determining, based at least in part on the first image data, that the first item was not placed in the first container by an agent; determining, based at least in part on the first image data, that the first item was placed in the second container by the agent; sending a first alert to the agent, the first alert notifying the agent to repack the first item, the first alert including an indication of the second container that the first item was placed in; receiving second image data of the packing event occurring in the packing area, the second image data including at least the first container and the second container; determining, based at least in part on the second image data, that the first item was repacked in the first container by the agent; and sending a second alert to the agent, the second alert notifying the agent to proceed with a next item. ### Claim 2 (depends on 1) The method of claim 1, further comprising: receiving third image data of the packing event occurring in the packing area, the third image data including a second item; determining, based at least in part on the third image data, that the second item was not placed in the first container by the agent; sending a third alert to the agent, the third alert notifying the agent to repack the second item; receiving fourth image data of the packing event occurring in the packing area; determining, based at least in part on the fourth image data, that the second item was not retrieved and placed in the first container by the agent; sending a fourth alert to the agent, the fourth alert re-notifying the agent to repack the second item; receiving fifth image data of the packing event occurring in the packing area; and determining, based at least in part on the fifth image data, that the second item was retrieved and placed in the first container by the agent; and sending a fifth alert to the agent, the fifth alert notifying the agent to proceed with a next item. ### Claim 3 (depends on 1) The method of claim 1, wherein: determining that the first item was not placed in the first container by the agent further comprises inputting the first image data into a one or more first machine learning models and receiving as an output of the one or more first machine learning models an indication that the first item was not placed in the first container, the one or more first machine learning models trained on first image training data of various items being placed in containers by various agents; and determining that the first item was repacked in the first container by the agent further comprises inputting the second image data into a one or more second machine learning models and receiving as an output of the one or more second machine learning models an indication that the first item was placed in the first container, the one or more second machine learning models trained on second image training data of various items being placed in containers by various agents. ### Claim 4 (depends on 3) The method of claim 3, wherein the one or more first machine learning models includes: one or more machine learning models to segment the first image data and generate segmented image data; one or more machine learning models to classify the segmented image data and generate classified image data; and one or more machine learning models to determine a packing location based at least in part on the classified image data. ### Claim 5 (depends on 1) The method of claim 1, wherein the first alert causes a display associated with the packing area to provide a visual indication that the first item was not placed in the first container. ### Claim 6 (depends on 5) The method of claim 5, further comprising causing an image to be presented on a display associated with the packing area, the image including: a visual representation of the first container; a visual representing each of the items placed in the first container; and a visual representation of a status of the agent. ### Claim 7 (depends on 1) The method of claim 1, wherein: the agent is an autonomous system; the first alert is a first control signal to cause the autonomous system to perform an action associated with the first item; and the second alert is a second control signal to cause the autonomous system to perform an action associated with another item. ### Claim 8 (depends on 1) The method of claim 1, further comprising: determining, based at least in part on the first image data, a class associated with the first item; and determining, based at least in part on the class of the first item, that the first item belongs in the first container. ### Claim 9 (depends on 1) The method of claim 1, wherein the first alert is presented on a display associated with the packing area, the first alert presented concurrently with a first display portion representing the first container associated with the packing event and a second display portion representing the agent associated with the packing event, the first display portion including an indication or an expected number of items to be placed in the first container, a detected number of items placed in the first container, a label identifying each item placed in the first container, and a label identifying a first portion of the first container and the second display portion including an operator status and a bin status. ### Claim 10 A method comprising: sending a first alert to a display associated with an agent engaged in a packing event including a first container and a second container, the first alert to indicate that a first item was packed incorrectly in the first container, the display presenting concurrently with the first alert a first display portion representing the first container and a second display portion representing the agent, the first display portion including an indication or an expected number of items to be place in the first container, a detected number of items placed in the first container; a label identifying each item placed in the first container, and a label identifying a first portion of the first container and the second display portion including an operator status and a bin status; receiving, from an image device, first image data of the packing event occurring in the packing area and including at least the first container and the second container; determining, based at least in part on the first image data, that the first item was repacked correctly in the second container by the agent; and sending a second alert to the display, the second alert notifying the agent to proceed with a next item. ### Claim 11 (depends on 10) The method of claim 10, further comprising: receiving, from the image device, second image data of the packing event occurring in the packing area, the second image data received prior to sending the first alert; and determining, based at least in part on the second image data, that the first item was packed incorrectly in the first container by the agent. ### Claim 12 (depends on 11) The method of claim 11, wherein determining that the first item was packed incorrectly in the first container by the agent further comprises: determining, based at least in part on the second image data, segmented and classified image data, the segmented and classified image data including data representing a class associated with the first item and data associated with the first container and the second container; generating, based at least in part the data associated with the first container and the second container, a pixel mapping representing the packing area, the pixel mapping including a first pixel region associated with the first container and a second pixel region associated with the second container; determining, based at least in part on the pixel mapping and the segmented and classified image data, an area location associated with the pixel mapping and a placement of the first item; and determining, based at least in part on the area and the pixel mapping, that the first item was placed in the first container by the agent. ### Claim 13 (depends on 10) The method of claim 10, wherein determining that the first item was repacked correctly in the second container by the agent further comprises: determining, based at least in part on the first image data, segmented and classified image data, the segmented and classified image data including data representing a class associated with the first item and data associated with the first container and the second container; generating, based at least in part the data associated with the first container and the second container, a pixel mapping representing the packing area, the pixel mapping including a first pixel region associated with the first container and a second pixel region associated with the second container; determining, based at least in part on the pixel mapping and the segmented and classified image data, an area location associated with the pixel mapping and a placement of the first item; and determining, based at least in part on the area and the pixel mapping, that the first item was placed in the second container by the agent. ### Claim 14 (depends on 10) The method of claim 10, wherein the first alert provides a visual indication on the display that the first item was placed in the first container. ### Claim 15 A method comprising: receiving first image data associated with a packing event occurring in a packing area, the first image data including at least a first container and a second container; generating, based at least in part on the first image data, second image data associated with the packing event, the second image data including a first display portion representing the first container and the second container associated with the packing event and a second display portion representing the agent associated with the packing event, the first display portion including an indication or an expected number of items to be place in the first container, an expected number of items to be placed in the second container, a detected number of items placed in the first container, a detected number of items placed in the second container, a label identifying each item placed in the first container, and a label identifying a first portion of the first container and the second display portion including an operator status and a bin status; presenting, to the agent, the second image data on a display. ### Claim 16 (depends on 15) The method of claim 15, wherein the first portion of the first container is a container flap. ### Claim 17 (depends on 15) The method of claim 15, wherein each item presented in the first display portion includes a designated color, the designated color indicating a class associated with the item. ### Claim 18 (depends on 15) The method of claim 15, wherein the second display position includes an item status. ### Claim 19 (depends on 15) The method of claim 15, further comprising: determining that a specific item was placed correctly in the container by the agent; and displaying an alert on the display to indicate to the agent to proceed with a next item. ### Claim 20 (depends on 15) The method of claim 15, further comprising: determining that a specific item was placed incorrectly with respect to the first container by the agent; and displaying an alert on the display to indicate to the agent to re-pack the specific item.