Emotion recognition message system, mobile communication terminal therefor and message storage server therefor

A mobile communication terminal that connects to a mobile communication system having a message storage server and that communicates with another mobile communication terminal, the mobile communication terminal comprising:

• a transmitter-receiver configured to transmit a message containing speech or video absent any emotion recognition information provided by the mobile communication terminal, the message transmitted for receipt by the message storage server, which is configured to register the message received from the mobile communication terminal after performing emotion recognition on the received message and assign emotion data indicating the recognized emotion to the received message;
• a display that displays an image;
• an input receiver that receives input of speech or video from a user;
• and
• a controller that controls each of the transmitter-receiver, the display, and the input receiver,
• wherein the controller, in a case in which the message containing speech or video for another mobile communication terminal is received by the input receiver, transmits the message to the message storage server via the transmitter-receiver;
• wherein the controller, upon receiving, as a confirmation request, emotion data for the transmitted message from the message storage server, displays a first image corresponding to the received emotion data on the display;
• and
• wherein the controller, upon receiving, via the input receiver, an input instruction indicating that the user agrees or disagrees with a type of the emotion indicated by the image displayed on the display, transmits via the transmitter-receiver to the message storage server an approval response indicating approval of the emotion data or a disapproval response indicating disapproval of the emotion data, respectively;
• and
• wherein the controller, upon receipt from the message storage server of revised emotion data for the transmitted message, displays on the display, for approval or disapproval, a second image corresponding to the revised emotion data, wherein the revised emotion data is received from the message storage server as a subsequent confirmation request responsive to the disapproval response.

A message storage server of a mobile communication system for relaying communication between at least two mobile communication terminals,

• the message storage server comprising:
• a message receiver that receives from a first mobile communication terminal a message containing speech or video for a second mobile communication terminal absent any emotion recognition information provided by the first mobile communication terminal;
• a storage device that stores the message received by the message receiver;
• an emotion recognizer that performs emotion recognition on the message and that assigns emotion data indicating the recognized emotion to the message;
• and
• a confirmation request transmitter that transmits, as a confirmation request, emotion data assigned by the emotion recognizer to the first mobile communication terminal that has transmitted the message;
• wherein the emotion recognizer is further configured, in response to receipt from the mobile communication terminal of a response message indicating disapproval of the emotion data, to perform a second emotion recognition on the message, and assign revised emotion data indicating a second recognized emotion to the message, and the confirmation request transmitter is further configured to transmit, as a second confirmation request, the revised emotion data to the mobile communication terminal that has transmitted the message.