Method and system of facial expression recognition using linear relationships within landmark subsets

A computer-implemented method of facial expression recognition, comprising:

• obtaining image data of at least one image that comprises content having at least one person's face;
• determining at least one subset of landmarks for at least one main landmark, wherein each landmark has data to indicate information about a facial feature of the face;
• determining a relationship among the at least one main landmark and the subset of landmarks;
• and
• using a discriminative model to label a facial expression class for the face by using the relationship.

A computer-implemented system of facial expression recognition comprising:

• a display;
• at least one processor communicatively coupled to the display;
• at least one memory communicatively coupled to at least one processor and storing image capture data of at least one frame of a video sequence or at least one still photograph;
• and
• at least one facial expression recognition unit communicatively coupled to the processor, and to:
• obtain image data of at least one image that comprises content having at least one person's face;
• determine at least one subset of landmarks for at least one main landmark, wherein each landmark has data to indicate information about a facial feature of the face;
• determine a relationship among the at least one main landmark and the subset of landmarks;
• and
• use a discriminative model to label a facial expression class for the face by using the relationship.

At least one computer readable article comprising a plurality of instructions that in response to being executed on a computing device, causes the computing device to:

• obtain image data of at least one image that comprises content having at least one person's face;
• determine at least one subset of landmarks for at least one main landmark, wherein each landmark has data to indicate information about a facial feature of the face;
• determine a relationship among the at least one main landmark and the subset of landmarks;
• and
• use a discriminative model to label a facial expression class for the face by using the relationship.