System and method for vision-assisted checkout

A method for providing a computer vision assisted self-service checkout, the method comprising:

• capturing, by a processor, RGB and depth images of one or more products at a first timestamp using one or more Red Green Blue Depth (RGB-D) sensors mounted in an RGB-D housing frame, wherein the RGB-D housing frame comprises a rectangular framework walled at three sides and provided with diffused lighting forming an upside-down U-shaped tunnel, and wherein the rectangular framework is a 2×2 meter rectangular framework;
• combining, by the processor, the captured RGB and depth images to create a unified payload for the one or more products at the first timestamp;
• determining, by the processor, a count of the one or more products based on the unified payload of the one or more products;
• generating, by the processor, a unique product ID of each of the one or more products;
• identifying, by the processor, a Stock Keeping Unit (SKU) of the one or more products based on the unique product ID of each of the one or more products;
• and
• generating, by the processor, an invoice bill for the one or more products based on the identified SKU of the one or more products.

A user equipment (UE) for providing a computer vision assisted self-service checkout, the UE comprising:

• a processor;
• and
• a memory coupled to the processor, wherein the memory comprises processor-executable instructions, which on execution, causes the processor to:
• capture RGB and depth images of one or more products at a first timestamp using one or more Red Green Blue Depth (RGB-D) sensors mounted in an RGB-D housing frame, wherein the RGB-D housing frame comprises a rectangular framework walled at three sides and provided with diffused lighting forming an upside-down U-shaped tunnel, and wherein the rectangular framework is a 2×2 meter rectangular framework;
• send the captured RGB and depth images to a system,
• wherein the system is configured to;
• combine the captured RGB and depth images to create a unified payload for the one or more products at the first timestamp;
• determine a count of the one or more products based on the unified payload of the one or more products;
• generate a unique product ID of each of the one or more products;
• identify a Stock Keeping Unit (SKU) of the one or more products based on the unique product ID of each of the one or more products;
• generate an invoice bill for the one or more products based on the identified SKU of the one or more products;
• and
• display the invoice bill for the one or more products based on the identified SKU for the self-service checkout.