Image-Based Kitchen Tracking System with Order Accuracy Management Using Sequence Detection Association

A method, comprising:

• receiving, by a processing device, first image data and second image data, the first image data comprising one or more image frames indicative of a state of a meal preparation area at a first time, and the second image data comprising one or more image frames indicative of a state of the meal preparation area at a second time, after the first time;
• determining, by the processing device, (i) a first sequence of detections based on the first image data and (ii) a second sequence of detections based on the second image data, wherein each detection of the first sequence of detections and the second sequence of detections indicates at least one of a detected meal preparation item or a detected meal preparation action associated with a corresponding state of the meal preparation area;
• receiving, by the processing device, order data indicating a plurality of pending meal orders;
• determining, by the processing device, a set of meal preparation constraints associated with preparation of the plurality of pending meal orders;
• determining, by the processing device, a first association between the first sequence of detections and the second sequence of detections based at least in part on the set of meal preparation constraints;
• and
• performing, by the processing device, an action based on the first association.

A system comprising:

• one or more cameras to capture image data comprised of one or more image frames indicative of a state of a meal preparation area;
• a memory;
• and
• a processing device, coupled to the memory;
• to:
• receive, from the one or more cameras, first image data comprising one or more image frames indicative of a state of a meal preparation area at a first time;
• determine a first set of one or more detections based on the first image data, wherein each of the first set of detections indicates at least one of a detected meal preparation item or a detected meal preparation action associated with the state of the meal preparation area;
• receive order data indicating a plurality of pending meal orders;
• determine a set of meal preparation constraints associated with preparation of the plurality of pending meal orders;
• determine, based on the set of meal preparation constraints, a first association between the first set of detections and a first pending meal order of the plurality of pending meal orders;
• and
• perform an action based on the first association.