# US 2022/0284384 A1 · On-Shelf Image Based Barcode Reader for Inventory Management System > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2022/0284384 A1 - Document ID: US20220284384A1 - Status: Published application - Kind: A1 - Application number: 17/685,004 - Filed: 2022-03-02 - Published: 2022-09-08 - Earliest claimed: 2021-03-04 - Assignees: Focal Systems, Inc. - Applicants: Focal Systems, Inc. - Inventors: Francois Chaubard - Web page: https://patentgrep.com/patent/US20220284384A1 ## CPC - G06K 7/1443: {locating of the code in an image} - G06Q 10/087: Inventory or stock management, e.g. order filling, procurement or balancing against orders - G06K 7/1413: {1D bar codes} - G06K 7/1417: {2D bar codes} - G06K 7/1447: {extracting optical codes from image or text carrying said optical code} - G06Q 10/08724: {by shelf level inventory management, e.g. planograms} - G06Q 10/0877: {by inventory control or reporting using inventory tracking or counting} - G06T 3/4046: using neural networks - G06T 3/4053: based on super-resolution, i.e. the output image resolution being higher than the sensor resolution - G06T 3/4076: using the original low-resolution images to iteratively correct the high-resolution images - G06V 10/225: {based on a marking or identifier characterising the area} - G06V 10/25: Determination of region of interest [ROI] or a volume of interest [VOI] - G06V 10/267: {by performing operations on regions, e.g. growing, shrinking or watersheds} - G06V 10/273: {removing elements interfering with the pattern to be recognised} - G06V 10/82: using neural networks - G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69) - G06V 30/1448: {based on markings or identifiers characterising the document or the area} - G06K: GRAPHICAL DATA READING (image or video recognition or understanding G06V); PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract An inventory visibility management system that provides a user interface for managing inventories. The system may receive an electronic indication that a product designated for a given shelf space of a first space is low in stock, the indication including an identifier associated with the product. The system may determine a location of a replacement for the product in a second space (e.g., a warehouse or backroom) different from the first space based on a first image of the identifier being captured in the second space. The user interface may then display the location of the box in the second space. The system may then validate a placement of the replacement on the given shelf space, wherein the validating includes capturing a second image of the location in the second space and determining from the second image that the replacement has been removed from the location. ## Claims ### Claim 1 A method comprising: receiving an electronic indication that a product designated for a given shelf space of a first space is low in stock, the indication including an identifier associated with the product; determining a location of a replacement for the product in a second space different from the first space based on a first image of the identifier being captured in the second space; causing a display, through a user interface, of the location of the box in the second space; and validating a placement of the replacement on the given shelf space, the validating comprising: capturing a second image of the location in the second space and determining from the second image that the replacement has been removed from the location. ### Claim 2 (depends on 1) The method of claim 1, wherein the product is identified in a prioritized list of products, and wherein the prioritized list is ordered based on a level of need for restocking. ### Claim 3 (depends on 1) The method of claim 1, wherein the indication further indicates that a stock of the product is below a threshold. ### Claim 4 (depends on 1) The method of claim 1, further comprising: responsive to the identifier being detected on a box in the second space, adding an entry comprising information that the box is detected in the second space in a database. ### Claim 5 (depends on 1) The method of claim 1, further comprising: responsive to the box being delivered to the second space, adding a timestamp when the box was delivered as when the box was last detected in the second space in the database. ### Claim 6 (depends on 1) The method of claim 1, further comprising: responsive to the identifier not being detected, transmitting an alert to a client device. ### Claim 7 (depends on 1) The method of claim 1, wherein the user interface further shows the box polygon overlain on one or more images of where the box identifier was last detected. ### Claim 8 (depends on 1) The method of claim 1, further comprising: responsive to the box being successfully retrieved, adding an indication to the database indicating that the box is removed. ### Claim 9 (depends on 1) The method of claim 1, wherein the user interface further shows a location of the box on a map for the user to navigate to the location for picking up the box. ### Claim 10 (depends on 1) The method of claim 1, wherein the validating further comprises: determining whether a predetermined amount of products was taken from the second space; determining whether the predetermined amount of products is placed in the first space; responsive to determining that both the predetermined amount of products was taken from the second space, and is placed in the first space validating the placement. ### Claim 11 (depends on 10) The method of claim 10, wherein the validating further comprises: responsive to detecting an error in relocating the predetermined amount of products, transmitting an alert, through the user interface, to notify a personnel for fixing the error. ### Claim 12 A non-transitory computer-readable storage medium comprising memory with executable computer instructions encoded thereon that, when executed by one or more processors, cause the one or more processors to perform operations, the instructions comprising instructions to: receive an electronic indication that a product designated for a given shelf space of a first space is low in stock, the indication including an identifier associated with the product; determine a location of a replacement for the product in a second space different from the first space based on a first image of the identifier being captured in the second space; cause a display, through a user interface, of the location of the box in the second space; and validate a placement of the replacement on the given shelf space, the validating comprising: capturing a second image of the location in the second space and determining from the second image that the replacement has been removed from the location. ### Claim 13 (depends on 12) The non-transitory computer-readable storage medium of claim 12, wherein the product is identified in a prioritized list of products, and wherein the prioritized list is ordered based on a level of need for restocking. ### Claim 14 (depends on 12) The non-transitory computer-readable storage medium of claim 12, wherein the indication further indicates that a stock of the product is below a threshold. ### Claim 15 (depends on 12) The non-transitory computer-readable storage medium of claim 12, further comprising: responsive to the identifier being detected on a box in the second space, adding an entry comprising information that the box is detected in the second space in a database. ### Claim 16 (depends on 12) The non-transitory computer-readable storage medium of claim 12, further comprising: responsive to the box being delivered to the second space, adding a timestamp when the box was delivered as when the box was last detected in the second space in the database. ### Claim 17 (depends on 12) The non-transitory computer-readable storage medium of claim 12, further comprising: responsive to the identifier not being detected, transmitting an alert to a client device. ### Claim 18 (depends on 12) The non-transitory computer-readable storage medium of claim 12, wherein the user interface further shows the box polygon overlain on one or more images of where the box identifier was last detected. ### Claim 19 (depends on 12) The non-transitory computer-readable storage medium of claim 12, further comprising: responsive to the box being successfully retrieved, adding an indication to the database indicating that the box is removed. ### Claim 20 (depends on 12) The non-transitory computer-readable storage medium of claim 12, wherein the user interface further shows a location of the box on a map for the user to navigate to the location for picking up the box.