System and method for surveillance of goods

A method for performing video surveillance, the method comprising:

• capturing video footage, using a plurality of video sensors, of a monitored area located within an order receiving area or an order dispatch area of a receipt/dispatch portal;
• performing, using a processing unit, event analysis on the captured video footage;
• detecting, using the processing unit, an entity in the video footage captured by the video sensors;
• detecting from a door opening event in the captured video footage, an incoming delivery from a third-party supplier using the processing unit;
• identifying, using the processing unit, the third-party supplier and implementing a check-in process for delivery persons from the third-party supplier;
• detecting, using the processing unit, an ingress/egress of merchandise through the receipt/dispatch portal and validating that detected delivered products matches with data regarding products that the third-party supplier should be delivering;
• analysing the video footage captured by the video sensors to determine whether the receipt/dispatch portal is in an open state or a closed state;
• analysing the video footage captured by the video sensors of the order checking system to detect whether a delivery person has arrived at the receipt/dispatch portal;
• tracking movements of the delivery person from the captured video footage upon their detection;
• detecting a presence of a quick response (QR) code in the captured video footage;
• and
• reading the detected QR code as output;
• comparing the detected QR code with known pre-approved QR codes for third-party suppliers/delivery persons to find a match, and wherein in the event a match is found:
• classifying a delivery person presenting the QR code as an authorized entrant to an order fulfillment facility/order receiving facility;
• and
• granting the delivery person access to the order fulfillment facility/order receiving facility;
• checking one or more contents of merchandise to be delivered from, or received into, a premises of the order fulfillment facility/order receiving facility, wherein the step of checking comprises:
• detecting a pallet using a Pallet Detector Module;
• tracking the detected pallet using a Pallet Tracker Module;
• classifying merchandise on the detected pallet using a Merchandise Classification per Pallet Module;
• estimating a quantity of merchandise on the detected pallet using a Pallet Volume Estimator;
• and
• extracting information about a total number of pallets passing through the receipt/dispatch portal using an IN-OUT counter;
• storing, using a database, at least a dataset of face images/logos for use in detecting faces/brands and a dataset of product images for use in identification of products;
• recording an outcome, using the database of an order checking process and a check out of a delivery person at an end of a delivery;
• and
• retrieving the recording, by the processing unit from the database, upon request to the processing unit.

A non-transitory computer readable medium having stored thereon computer-executable instructions which, when executed by a processing unit, causes the processing unit to:

• capture video footage, using a plurality of video sensors, of a monitored area located within an order receiving area or an order dispatch area of a receipt/dispatch portal;
• perform event analysis on the captured video footage;
• detect an entity in the video footage captured by the video sensors;
• detect, from a door opening event in the captured video footage, an incoming delivery from a third-party supplier using the processing unit;
• identify the third-party supplier and implementing a check-in process for delivery persons from the third-party supplier;
• detect an ingress/egress of merchandise through the receipt/dispatch portal and validating that detected delivered products matches with data regarding products that the third-party supplier should be delivering;
• analyse the video footage captured by the video sensors of the order checking system to determine whether the receipt/dispatch portal is in an open state or a closed state;
• analyse the video footage captured by the video sensors to detect whether a delivery person has arrived at the receipt/dispatch portal;
• track movements of the delivery person from the captured video footage upon their detection;
• detect a presence of a quick response (QR) code in the captured video footage and read the detected QR code as output;
• compare the detected QR code with known pre-approved QR codes for third-party suppliers/delivery persons to find a match, and wherein in the event a match is found:
• classify a delivery person presenting the QR code as an authorized entrant to an order fulfillment facility/order receiving facility;
• and
• grant the delivery person access to the order fulfillment facility/order receiving facility;
• check one or more contents of merchandise to be delivered from, or received into, a premises of the order fulfillment facility/order receiving facility, wherein the step of checking comprises:
• detecting a pallet using a Pallet Detector Module;
• tracking the detected pallet using a Pallet Tracker Module;
• classifying merchandise on the detected pallet using a Merchandise Classification per Pallet Module;
• estimating a quantity of merchandise on the detected pallet using a Pallet Volume Estimator;
• and
• extracting information about a total number of pallets passing through the receipt/dispatch portal using an IN-OUT counter;
• store, using a database, at least a dataset of face images/logos for use in detecting faces/brands and a dataset of product images for use in identification of products;
• and
• record, using the database, an outcome of an order checking process and a check out of a delivery person at an end of a delivery;
• and
• retrieve the recording from the database upon request by the processing unit.