Electronic apparatus for processing user utterance and controlling method thereof

A server for processing a user utterance, the server comprising:

• a communication interface;
• a memory including a database storing information of a plurality of applications executed by an external electronic apparatus;
• at least one processor;
• wherein the memory stores instructions that, when executed by the at least one processor, cause the at least one processor to:
• receive a voice input for performing a task and compatible information included in state information of an application executed by the external electronic apparatus, from the external electronic apparatus via the communication interface, wherein the compatible information is matched with identification information (ID), and wherein the state information includes the compatible information and incompatible information;
• generate action information for performing the task based on the voice input and the compatible information;
• and
• transmit the generated action information and the compatible information matched with the identification information, to the external electronic apparatus via the communication interface.

A system for processing a user utterance, the system comprising:

• an electronic apparatus including:
• a first communication interface;
• a first memory;
• a microphone;
• a speaker;
• a touch screen display;
• and
• a first processor, and
• a server including:
• a second communication interface;
• a second memory including a database storing information of a plurality of applications executed by the electronic apparatus;
• and
• a second processor,
• wherein the first memory stores first instructions that, when executed by the first processor, cause the first processor to:
• in response to receiving a voice input for performing a task via the microphone, obtain state information of an executing application, wherein the obtained state information includes:
• compatible information capable of being processed by another apparatus different from the electronic apparatus,
• incompatible information not capable of being processed by the another apparatus, and
• identification information (ID),
• wherein the compatible information and the incompatible information are pieces of information necessary to perform the task;
• transmit the user utterance and the identification information matched with the compatible information, to the server via the first communication interface;
• and
• store the incompatible information matched with the identification information in the first memory;
• wherein the second memory stores second instructions that, when executed by the second processor, cause the second processor to:
• receive the voice input and the compatible information matched with the identification information from the another apparatus via the second communication interface;
• generate action information for performing the task based on the voice input and the compatible information;
• and
• transmit the generated action information and the compatible information matched with the identification information, to the another apparatus via the second communication interface, and
• wherein the first instructions, when executed by the first processor, cause the first processor to:
• receive the action information from the server via the first communication interface;
• obtain the incompatible information stored in the first memory, using the identification information matched with the compatible information;
• perform the task based on the action information;
• and
• in response to performing the task, use the obtained incompatible information.

An electronic apparatus comprising:

• a touch screen display;
• at least one communication circuit;
• a microphone;
• a speaker;
• at least one processor operatively connected to the touch screen display, the communication circuit, the microphone, and the speaker;
• a volatile memory operatively connected to the processor;
• and
• at least one nonvolatile memory electrically connected to the processor,
• wherein the nonvolatile memory is configured to store a first application program including a graphic user interface, to store at least part of a voice-based intelligent assistance service program, and to store instructions,
• wherein the instructions, when executed by the at least one processor, cause the at least one processor to:
• execute the first application program to display the graphic user interface on the touch screen display;
• receive first data by a first input of a user via the graphic user interface to store the first data in the volatile memory;
• receive a second input of the user for requesting the assistance service program to perform a task associated with the first application program, via the microphone;
• transmit the second input to an external server by using the communication circuit;
• receive second data for responding to the second input, from the external server by using the communication circuit;
• and
• update the graphic user interface based at least partly on the first data and the second data.