System and method for cooking appliance operation using food weight estimation

A cooking appliance, comprising:

• an imaging device configured to obtain an image at a cooking region of the cooking appliance;
• a controller configured to store instructions that, when executed, causes the cooking appliance to perform operations, the operations comprising:
• obtaining, via the imaging device, an image at the cooking region;
• determining, via a first detection model, a bounding of one or more types of objects within the image;
• setting, at a second detection model, a region of interest at the image including the objects;
• determining, via the second detection model, a quantity of segmented pixels for each type of object within the image;
• determining a weight of each type of object based on the quantity of segmented pixels corresponding to each type of object within the image;
• corresponding the weight of each type of object in the image to a cooking program;
• and
• operating the cooking appliance based on the cooking program.