Ingredient cooking-operation recognition system and computer-readable recording medium which is recorded with ingredient cooking-operation recognition program

A computer-readable recording medium which has recorded thereon an ingredient cooking-operation recognition program, for causing a computer to function at least as:

• a sensing means for acquiring observation data which includes an image around the hands of a person who performs a cooking operation and an environment sound that is produced by the cooking operation;
• a feature-quantity template in which various cooking operations that are predetermined for various ingredients are stored together with a template certainty factor that is a certainty factor which is predetermined for each cooking operation of the ingredients;
• a cooking-flow creating means for, based on the observation data, calculating an observation certainty factor which indicates the certainty factor of at least either of an ingredient that is cooked by the person and the cooking operation of the ingredient, and based on the observation certainty factor, creating a cooking flow for a dish which is prepared by the person;
• a primary certainty-factor calculating means for, calculating a primary certainty factor which is a certainty factor for each object that makes up the cooking flow based on the template certainty factor and the observation certainty factor;
• and
• a cooking-operation recognizing means for recognizing the ingredient and the cooking operation that correspond to the observation data, based on the primary certainty factor;
• and
• a guidance means for providing guidance to the person regarding the cooking flow based on the ingredient and the cooking operation recognized by the cooking-operation recognizing means, wherein the person performs the cooking operation in accordance with the guidance.