Facial expression recognition in educational learning systems

A computer-implemented method for conducting a learning session over a collaborative network, the method comprising:

• presenting an interface at an instructor workstation comprising a processor, the instructor interface comprising
• a current instructional content display, and
• an avatar status display;
• receiving expressive avatar information corresponding to imaging data of a user at a particular time during a presentation of instructional content from a plurality of users from an input device at a plurality of respective participant workstations, the expressive avatar information comprising a plurality of avatar identifiers and a plurality of avatar emotion identifiers;
• determining a plurality of avatar images corresponding to the plurality of users based on the received expressive avatar information, each avatar image being a representation of the corresponding user;
• altering the instructional content based on a plurality of avatar identifiers and a plurality of avatar emotion identifiers of the plurality of users, wherein the plurality of avatar identifiers comprises at least the avatar identifier, and wherein the plurality of avatar emotion identifiers comprises at least the avatar emotion identifier;
• transmitting through the collaborative network coupled to the participant and instructor workstations the altered instructional content to at least one interface of a participant workstation of the plurality of participant workstations;
• and
• receiving and displaying the altered instructional content on the current instructional content display of the participant workstation, the altered instructional content including the plurality of avatar images to the instructor interface, the plurality of avatar images being displayed in the avatar status display.

A system for participating in a learning session over a collaborative network, the system comprising:

• a processor configured to:
• present an interface at a participant workstation comprising a processor, the interface comprising a current instructional content display and an avatar status display;
• receive user image data of a plurality of users from an input device at a plurality of respective participant workstations, wherein the user image data corresponds to imaging data of a user at a particular time during a presentation of instructional content;
• convert the user image data from the particular time into expressive avatar information, the expressive avatar information comprising an avatar identifier and an avatar emotion identifier;
• determine a plurality of avatar images corresponding to the plurality of users based on the expressive avatar information, each avatar image being a representation of the corresponding user;
• transmit through the collaborative network coupled to the participant workstations the expressive avatar information to at least one interface of a participant workstation of a corresponding user of the learning session;
• alter instructional content based on a plurality of avatar identifiers and a plurality of avatar emotion identifiers of the plurality of users, wherein the plurality of avatar identifiers comprises at least the avatar identifier, and wherein the plurality of avatar emotion identifiers comprises at least the avatar emotion identifier;
• and
• receive and display the altered instructional content on the current instructional content display of the participant workstation, the altered instructional content including the plurality of avatar images to the interface, the plurality of avatar images being displayed in the avatar status display.

A system for conducting a learning session over a collaborative network, the system comprising:

• a processor configured to:
• present an interface at a participant workstation comprising a processor, the interface comprising
• a current instructional content display, and
• an avatar status display;
• receive expressive avatar information corresponding to imaging data of a user at a particular time during a presentation of instructional content from a plurality of users from an input device at a plurality of respective participant workstations, the expressive avatar information comprising a plurality of avatar identifiers and a plurality of avatar emotion identifiers;
• determine a plurality of avatar images corresponding to the plurality of users based on the received expressive avatar information, each avatar image being a representation of the corresponding user;
• alter the instructional content based on a plurality of avatar identifiers and a plurality of avatar emotion identifiers of the plurality of users, wherein the plurality of avatar identifiers comprises at least the avatar identifier, and wherein the plurality of avatar emotion identifiers comprises at least the avatar identifier;
• transmit through a collaborative network coupled to the participant workstations the altered instructional content to at least one interface of a participant workstation of the plurality of participant workstations;
• and
• receive and display the altered instructional content on the current instructional content display of the participant workstation, the altered instructional content including the plurality of avatar images to the interface, the plurality of avatar images being displayed in the avatar status display.

A non-transitory computer readable storage medium for participating in a learning session over a collaborative network, the computer-readable storage medium comprising instructions that when executed enable a computing system to:

• present an interface at a participant workstation comprising a processor, the interface comprising a current instructional content display and an avatar status display;
• receive user image data of a plurality of users from an input device at a plurality of respective participant workstations, wherein the user image data corresponds to imaging data of a user at a particular time during a presentation of instructional content;
• convert the user image data from the particular time into expressive avatar information, the expressive avatar information comprising an avatar identifier and an avatar emotion identifier for each of the plurality of users, the avatar identifier including an emotion value and the avatar emotion identifier including an avatar image;
• determine a plurality of avatar images corresponding to the plurality of users based on the expressive avatar information, each avatar image being a representation of the corresponding user;
• transmit through the collaborative network coupled to the participant workstations the expressive avatar information to at least one interface of a participant workstation of a corresponding user of the learning session;
• alter instructional content based on a plurality of avatar identifiers and a plurality of avatar emotion identifiers of the plurality of users, wherein the plurality of avatar identifiers comprises at least the avatar identifier, and wherein the plurality of avatar emotion identifiers comprises at least the avatar emotion identifier;
• and
• receive and display the altered instructional content on the current instructional content display of the participant workstation, the altered instructional content including the plurality of avatar images to the interface, the plurality of avatar images being displayed in the avatar status display.

A non-transitory computer readable storage medium comprising instructions that when executed enable a computing system to:

• present an interface at a participant workstation comprising a processor, the interface comprising
• a current instructional content display, and
• an avatar status display;
• receive expressive avatar information corresponding to imaging data of a user at a particular time during a presentation of instructional content from a plurality of users from an input device at a plurality of respective participant workstations, the expressive avatar information comprising a plurality of avatar identifiers and a plurality of avatar emotion identifiers;
• determine a plurality of avatar images corresponding to the plurality of users based on the received expressive avatar information, each avatar image being a representation of the corresponding user;
• alter the instructional content based on a plurality of avatar identifiers and a plurality of avatar emotion identifiers of the plurality of users, wherein the plurality of avatar identifiers comprises at least the avatar identifier, and wherein the plurality of avatar emotion identifiers comprise at least the avatar emotion identifier;
• transmit through a collaborative network coupled to the participant workstations the altered instructional content to at least one interface of a participant workstation of the plurality of participant workstations;
• and
• receive and display the altered instructional content on the current instructional content display of the participant workstation, the altered instructional content including the plurality of avatar images to the interface, the plurality of avatar images being displayed in the avatar status display.