Method and electronic device for generating language model

A non-transitory computer-readable recording medium storing computer-readable commands that, based on the computer-readable commands being executed by at least one processor, is configured to cause an apparatus to:

• obtain a base model pre-trained with a large-scale corpus, a functional model comprising a specified function added to the base model, and a target model additionally trained on the base model with learning data of a specified domain,
• determine a first difference value between a first parameter of the functional model and a second parameter of the base model corresponding to the first parameter,
• determine a change ratio of a third parameter of the target model corresponding to the second parameter with respect to the second parameter, and
• generate, based on the first difference value and the change ratio, a new language model from the target model.

An electronic device, comprising:

• a memory;
• and
• at least one processor connected to the memory and configured to execute computer-readable commands stored in the memory,
• wherein the computer-readable commands, based on the computer-readable commands being executed by the at least one processor, are configured to cause the electronic device to:
• obtain a base model pre-trained with a large-scale corpus, a functional model comprising a specified function added to the base model, and a target model additionally trained on the base model with learning data of a specified domain,
• determine a first difference value between a first parameter of the functional model and a second parameter of the base model corresponding to the first parameter,
• determine a change ratio of a third parameter of the target model corresponding to the second parameter with respect to the second parameter, and
• generate, based on the first difference value and the change ratio, a new language model from the target model.