System and method of controlling external apparatus connected with device

A mobile device comprising:

• a memory configured to store a program;
• and
• a processor configured to control one or more external apparatuses, among a plurality of external apparatuses, by executing the program,
• wherein the program comprises commands which, when executed by the processor, cause the processor to:
• identify the one or more external apparatuses, which are communicable with and controllable by the mobile device, from the plurality of external apparatuses,
• obtain an input command of a user and biometric information of the user, wherein the input command includes a voice command;
• provide the input command of a user and the biometric information and apparatus information of the one or more external apparatuses, to a server,
• receive, from the server, a control information for controlling the one or more external apparatuses, the control information being generated based on whether a control condition for controlling a first external apparatus among the one or more external apparatuses is satisfied based on a sensing data received from a second external apparatus among the one or more external apparatuses, wherein the control condition is determined based on the apparatus information and a user's intention, and the user's intention is determined in consideration of the voice command and the biometric information, and
• transmit a control command to the first external apparatus based on the received control information,
• wherein the biometric information of the use is obtained by the mobile device when the voice command is input by the user into the mobile device.