Electronic apparatus for translating voice input using neural network models and method for controlling thereof

A method for controlling an electronic apparatus comprising:

• acquiring a first token corresponding to a first user voice input in a first language;
• acquiring a first text in a second language by inputting the first token into a first neural network model;
• acquiring a feature value corresponding to a predicted subsequent token, which is predicted to be uttered after the first token, by inputting the first text into a second neural network model;
• and
• based on a second token being acquired subsequent to the first token, acquiring a second text in the second language by inputting the first token, the second token, the first text, and the feature value into the first neural network model,
• wherein the first neural network model acquires the second text based on a first feature related to a grammatical relationship between the first token and the second token, a second feature related to a semantic relationship between the first token and the second token and the feature value corresponding to the predicted subsequent token.

A non-transitory computer-readable recording medium storing a program which, when executed by at least one processor, causes the at least one processor to:

• acquire a first token corresponding to a first user voice input in a first language;
• acquire a first text in a second language by inputting the first token into a first neural network model;
• acquire a feature value corresponding to a predicted subsequent token predicted, which is predicted to be uttered after the first token, by inputting the first text into a second neural network model;
• and
• based on a second token being acquired subsequent to the first token, acquire a second text in the second language by inputting the first token, the second token, the first text, and the feature value into the first neural network model,
• wherein the first neural network model acquires the second text based on a first feature related to a grammatical relationship between the first token and the second token, a second feature related to a semantic relationship between the first token and the second token and the feature value corresponding to the predicted subsequent token.