Integrated remote control device receiving multimodal input and method of the same

An integrated remote control system in which a control device remotely controls a controlled device using a control command, the control device comprising:

• a command database (DB) that stores commands;
• a control module that interprets a command of a user and extracts a control command corresponding to the interpreted user command from the command DB;
• and
• an output module that outputs the control command extracted by the control module, wherein the controlled device comprises:
• a receiving module that receives the control command outputted by the output module;
• and
• wherein an input module that receives inputs of at least two modalities from the user, a first modality recognition module that recognizes and interprets an input of a first modality received from the input module, and a second modality recognition module that recognizes and interprets an input of a second modality received from the input module are included in at least one of the control device and the controlled device.

An integrated remote control method receiving multi-modal inputs, comprising:

• receiving inputs of at least two modalities from a user;
• recognizing and interpreting each of the inputs of at least two modalities;
• interpreting a command of the user by synthesizing the inputs of at least two modalities;
• extracting a control command corresponding to the interpreted user command;
• and
• outputting the extracted control command.

A storage for controlling a device according to an integrated remote control method receiving multi-modal inputs, comprising:

• receiving inputs of at least two modalities from a user;
• recognizing and interpreting each of the inputs of at least two modalities;
• interpreting a command of the user by synthesizing the inputs of at least two modalities;
• extracting a control command corresponding to the interpreted user command;
• and
• outputting the extracted control command.