Image-based kitchen tracking system with metric management and kitchen display system (KDS) integration

A system comprising:

• a first camera to capture image data comprising one or more image frames of a first field of view of a meal preparation area, the one or more image frames indicative of a state of the meal preparation area;
• a kitchen interface device configured to at least one of i) receive inputs from within the meal preparation area and ii) provide outputs to the meal preparation area;
• a memory;
• and
• a processing device, coupled to the memory, the first camera, and the kitchen interface device, wherein the processing device is to:
• receive, from the first camera, the image data;
• determine, based on the image data, a first meal preparation item or a first meal preparation action associated with the state of the meal preparation area at a first time;
• determine, based on the image data, a second meal preparation item or a second meal preparation action associated with the state of the meal preparation area at a second time, wherein an identity of the first meal preparation item or the first meal preparation action corresponds to an identity of the second meal preparation item or the second meal preparation action;
• determine, based on the image data, a performance metric associated with a meal preparation procedure corresponding to (i) the first meal preparation item or the first meal preparation action and (ii) the second meal preparation item or the second meal preparation action;
• receive order data comprising one or more pending meal orders;
• determine, based on the image data, the order data, and the performance metric, a preparation status of a first pending meal order of the one or more pending meal orders;
• and
• provide, using the kitchen interface device, a notification within the meal preparation area corresponding to the preparation status of the first pending meal order.

A non-transitory machine-readable storage medium comprising instructions that, when executed by a processing device, cause the processing device to perform operations comprising:

• receiving image data comprising one or more image frames indicative of a state of a meal preparation area;
• determining, based on the image data, a first meal preparation item or a first meal preparation action associated with the state of the meal preparation area at a first time;
• determining, based on the image data, a second meal preparation item or a second meal preparation action associated with the state of the meal preparation area at a second time, wherein an identity of the first meal preparation item or the first meal preparation action corresponds to an identity of the second meal preparation item or the second meal preparation action;
• determining, based on the image data, a performance metric associated with a meal preparation procedure corresponding to (i) the first meal preparation item or the first meal preparation action and (ii) the second meal preparation item or the second meal preparation action;
• and
• causing a notification corresponding to the performance metric to be displayed on a graphical user interface (GUI).