Method and system for foodservice with instant feedback

A computer-implemented method, comprising:

• receiving, by a computer, one or more images from one or more cameras capturing a food container comprising a plurality of compartments;
• determining, by the computer using a first machine learning model based on the one or more images, a user action comprising a user taking food from a first compartment of the plurality of compartments;
• receiving, by the computer, a plurality of pieces of weight sensor data from a plurality of weight sensors coupled to a frame, wherein the frame is configured to receive the food container;
• determining, by the computer using a second machine learning model based on the plurality of pieces of weight sensor data, a second compartment of the plurality of compartments from which the user has taken food and a weight of the food taken by the user;
• obtaining, by the computer, food information of food stored in each of the plurality of compartments in the food container;
• and
• in response to the first compartment being the same as the second compartment, displaying, by the computer, the weight of the food taken by the user and the food information of the food stored in the first compartment on a first display panel of the computer.

A non-transitory computer-readable storage medium, configured with instructions executable by one or more processors to cause the one or more processors to perform operations comprising:

• receiving one or more images from one or more cameras capturing a food container comprising a plurality of compartments;
• determining, using a first machine learning model based on the one or more images, a user action comprising a user taking food from a first compartment of the plurality of compartments;
• receiving a plurality of pieces of weight sensor data from a plurality of weight sensors coupled to a frame, wherein the frame is configured to receive the food container;
• determining, using a second machine learning model based on the plurality of pieces of weight sensor data, a second compartment of the plurality of compartments from which the user has taken food and a weight of the food taken by the user;
• obtaining food information of food stored in each of the plurality of compartments in the food container;
• and
• in response to the first compartment being the same as the second compartment, displaying the weight of the food taken by the user and the food information of the food stored in the first compartment on a first display panel.