Method and system for augmented reality based liquid measurement and mapping

A system comprising:

• at least one memory storing programmed instructions;
• one or more Input/Output (I/O) interfaces;
• and
• one or more hardware processors operatively coupled to the at least one memory, wherein the one or more hardware processors are configured by the programmed instructions to:
• receive an image pertaining to a shelf by one or more hardware processors via an image acquisition unit, wherein the shelf comprises a plurality of glass containers with beverages;
• classify the plurality of glass containers based on a plurality characteristics associated with each of the plurality of glass containers;
• generate a plurality of potential cocktails based on the plurality of classified glass containers and a quantity of each beverage in each of the plurality of classified glass containers;
• display the generated plurality of potential cocktails and a corresponding appearance of the plurality of potential cocktails using 3 Dimensional (3D) Augmented Reality (AR) on a flat surface, wherein the flat surface is located by a pre-trained Machine Learning (ML) model;
• receive a cocktail request from a user, wherein the cocktail request is made by the user based on the plurality of potential cocktails displayed on the flat surface;
• locate a transparent glassware placed by the user on the flat surface by using the pre-trained ML model;
• dynamically display a procedure to prepare the requested cocktail near the located transparent glassware using the 3D AR;
• simultaneously compute a first set of 3D points associated with the transparent glassware using AR measurement techniques, wherein the first set of 3D points comprises a first base edge point, a second base edge point, a first top point and a second top point;
• compute a distance between the located transparent glassware and the image acquisition unit by using AR measurement techniques;
• compute a total volume of the transparent glassware based on the computed plurality of 3D points and the distance;
• dynamically determine the quantity of each of a plurality of beverages corresponding to the requested cocktail to be added in the transparent glassware based on the computed volume;
• and
• dynamically detect a quantity of each beverage added by the user in the transparent glassware each time by using dynamic liquid level detection, by:
• identifying an upper level of each beverage added in the glass based on a difference in color between the transparent glassware and the added beverage using a color mapping algorithm;
• computing a second set of 3D points on the upper level of the liquid, wherein the second set of 3D points comprises a first liquid top point, a second liquid top point;
• computing a volume of the added beverage based on the computed second set of 3D points and the distance;
• comparing the quantity of each beverage added into the transparent glassware with a corresponding predefined quantity of beverage to be added as per the dynamically displayed procedure to find any deviation in quantity of added beverage, wherein the deviation comprises one of, increase in quantity of added beverage and decrease in quantity of added beverage;
• and
• recommending the user based on the deviation, wherein the recommendation comprising:
• quantity of remaining beverages to be added, if there is increase in quantity of added beverage;
• and
• a plurality of available alternate beverages if there is any decrease in the quantity of added beverage;
• updating an availability of each beverage based on the quantity of each beverage added to the requested cocktail each time;
• and
• alarming a stock keeper when any of glass containers arranged in the shelf is emptied based on the updated information.

A non-transitory computer readable medium embodying a program executable in a computing device, the program comprising:

• receiving an image pertaining to a shelf by one or more hardware processors via an image acquisition unit, wherein the shelf comprises a plurality of glass containers with beverages;
• classifying the plurality of glass containers based on a plurality characteristics associated with each of the plurality of glass containers;
• generating a plurality of potential cocktails based on the plurality of classified glass containers and a quantity of each beverage in each of the plurality of classified glass containers;
• displaying the generated plurality of potential cocktails and a corresponding appearance of the plurality of potential cocktails using 3 Dimensional (3D) Augmented Reality (AR) on a flat surface, wherein the flat surface is located by a pre-trained Machine Learning (ML) model;
• receiving a cocktail request from a user, wherein the cocktail request is made by the user based on the plurality of potential cocktails displayed on the flat surface;
• locating a transparent glassware placed by the user on the flat surface by using the pre-trained ML model;
• dynamically displaying a procedure to prepare the requested cocktail near the located transparent glassware using the 3D AR;
• simultaneously computing a first set of 3D points associated with the transparent glassware using AR measurement techniques, wherein the first set of 3D points comprises a first base edge point, a second base edge point, a first top point and a second top point;
• computing a distance between the located transparent glassware and the image acquisition unit by using AR measurement techniques;
• computing a total volume of the transparent glassware based on the computed plurality of 3D points and the distance;
• dynamically determining the quantity of each of a plurality of beverages corresponding to the requested cocktail to be added in the transparent glassware based on the computed volume;
• and
• dynamically detecting a quantity of each beverage added by the user in the transparent glassware each time by using dynamic liquid level detection, by:
• identifying an upper level of each beverage added in the glass based on a difference in color between the transparent glassware and the added beverage using a color mapping algorithm;
• computing a second set of 3D points on the upper level of the liquid, wherein the second set of 3D points comprises a first liquid top point, a second liquid top point;
• computing a volume of the added beverage based on the computed second set of 3D points and the distance;
• comparing the quantity of each beverage added into the transparent glassware with a corresponding predefined quantity of beverage to be added as per the dynamically displayed procedure to find any deviation in quantity of added beverage, wherein the deviation comprises one of, increase in quantity of added beverage and decrease in quantity of added beverage;
• and
• recommending the user based on the deviation, wherein the recommendation comprising:
• quantity of remaining beverages to be added, if there is increase in quantity of added beverage;
• and
• a plurality of available alternate beverages if there is any decrease in the quantity of added beverage;
• updating an availability of each beverage based on the quantity of each beverage added to the requested cocktail each time;
• and
• alarming a stock keeper when any of glass containers arranged in the shelf is emptied based on the updated information.