System and method for associating products and product labels

A system comprising:

• one or more processors;
• one or more cameras coupled to the one or more processors;
• and
• software implementing:
• a product detection neural network;
• a label detection neural network;
• and
• a shelf detection neural network;
• wherein the software causes the system to:
• obtain a representation of an aisle containing stocked products, the representation comprising one or more images of the aisle captured by the one or more cameras;
• input the one or more images to the product detection neural network to obtain bounding boxes of products detected in the one or more images;
• input the one or more images to the label detection neural network to obtain bounding boxes of labels detected in the one or more images;
• input the one or more images to the shelf detection neural network to obtain bounding boxes of shelves detected in the one or more images;
• determine that one or more product labels are shelf labels by determining that the bounding boxes for the product labels overlap a bounding box for a shelf;
• determine an area associated with each shelf label, defined as an area on a shelf defined by the shelf label and an adjacent shelf label;
• and
• associate products having bounding boxes substantially overlapping the areas associated with a shelf label with that shelf label.