# US 10,770,065 B2 · Speech recognition method and apparatus > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,770,065 B2 - Document ID: US10770065B2 - Status: Granted - Kind: B2 - Application number: 15/842,430 - Filed: 2017-12-14 - Published: 2018-06-21 - Granted: 2020-09-08 - Earliest claimed: 2016-12-19 - Assignees: Samsung Electronics Co., Ltd. - Applicants: Samsung Electronics Co., Ltd. - Inventors: Sang-yoon Kim; Sung-soo Kim; Il-hwan Kim; Kyung-min Lee; Nam-hoon Kim; Jong-youb Ryu; Jae-won Lee - Web page: https://patentgrep.com/patent/US10770065B2 ## CPC - G10L 15/197: Probabilistic grammars, e.g. word n-grams - G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue - G10L 15/30: Distributed recognition, e.g. in client-server systems, for mobile phones or network applications - G10L 2015/228: {of application context} - G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING ## Abstract A speech recognition method and a speech recognition apparatus which pre-download a speech recognition model predicted to be used and use the speech recognition model in speech recognition is provided. The speech recognition method, performed by the speech recognition apparatus, includes determining a speech recognition model, based on user information downloading the speech recognition model, performing speech recognition, based on the speech recognition model, and outputting a result of performing the speech recognition. ## Claims ### Claim 1 A speech recognition method, performed by a speech recognition apparatus, the speech recognition method comprising: determining a speech recognition model, based on user information, the determining of the speech recognition model comprising determining a predictive language model included in the speech recognition model based on language models included in a range, the range being determined based on an utterance predicted to be uttered by a user of the speech recognition apparatus; downloading the speech recognition model; performing speech recognition, based on the speech recognition model; and outputting a result of performing the speech recognition. ### Claim 2 (depends on 1) The speech recognition method of claim 1, wherein the speech recognition model comprises at least one of a pre-processing model, an acoustic model, or a language model. ### Claim 3 (depends on 1) The speech recognition method of claim 1, further comprising obtaining the user information, wherein the user information comprises at least one of information about a characteristic of the user, information about an environment in which the user is located, information about a vehicle in which the user is located, information about a destination of the user, or information input by the user. ### Claim 4 (depends on 1) The speech recognition method of claim 1, wherein the predictive language model is related to the predicted utterance, and wherein the determining of the speech recognition model further comprises: determining a domain of a language model, based on the user information; determining a range of language models comprised in the domain, based on information about a characteristic of the user which is comprised in the user information; and determining at least one language model to be the predictive language model, wherein the range comprises the at least one language model. ### Claim 5 (depends on 1) The speech recognition method of claim 1, wherein the determining of the speech recognition model further comprises determining the speech recognition model by referring to a capacity of a memory in the speech recognition apparatus. ### Claim 6 (depends on 1) The speech recognition method of claim 1, wherein the determining of the speech recognition model further comprises determining the speech recognition model according to at least one of when a user input is received from the user, when there is a change in an environment in which the user is located, or when a use period of the speech recognition model has expired. ### Claim 7 (depends on 1) The speech recognition method of claim 1, wherein the downloading of the speech recognition model comprises downloading the speech recognition model from at least one of a server connected to the speech recognition apparatus or an electronic device connected to the speech recognition apparatus. ### Claim 8 (depends on 1) The speech recognition method of claim 1, wherein the speech recognition model comprises the predictive language model related to the predicted utterance, wherein the determining of the speech recognition model further comprises determining the predictive language model comprising a language model related to a first point comprised in a route, based on information about the route the user takes to move to a destination, and wherein the downloading of the speech recognition model comprises downloading the language model related to the first point before arriving at the first point, based on predicting that a network status of the speech recognition apparatus for communication at the first point will be insufficient. ### Claim 9 (depends on 1) The speech recognition method of claim 1, further comprising determining a usage method of the speech recognition model, wherein the performing of the speech recognition comprises performing the speech recognition by using the speech recognition model, based on the usage method. ### Claim 10 (depends on 1) The speech recognition method of claim 1, wherein a usage method of the speech recognition model comprises at least one of a use period of the speech recognition model, a method of processing the speech recognition model after the speech recognition model is used, or reliability of the speech recognition model. ### Claim 11 (depends on 9) The speech recognition method of claim 9, wherein the performing of the speech recognition based on the usage method comprises performing the speech recognition by using the speech recognition model, during a use period of the speech recognition model which is comprised in the usage method, and wherein the speech recognition method further comprises, after the use period of the speech recognition model is expired, deleting or deactivating the speech recognition model, based on the usage method. ### Claim 12 (depends on 9) The speech recognition method of claim 9, wherein the speech recognition model comprises the predictive language model related to the predicted utterance, wherein the determining of the speech recognition model further comprises determining the predictive language model related to a foreign language used in a region where the user is to be located, based on information about a schedule of the user which is stored in the speech recognition apparatus, wherein the determining of the usage method of the speech recognition model comprises determining to activate the predictive language model in a period during which the user is to be located in the region, based on the schedule of the user, and wherein the outputting of the result of performing the speech recognition comprises outputting a result of performing translation between the foreign language and a language used by the user, based on the predictive language model. ### Claim 13 (depends on 1) The speech recognition method of claim 1, wherein a depth indicates top and bottom ranges of language models included in the predictive language model when the language models have a hierarchical structure, and wherein a root indicates fields of the language models included in the predictive language model when the language models have a similarity therebetween. ### Claim 14 A speech recognition apparatus comprising: a receiver configured to receive speech of a user of the speech recognition apparatus; at least one processor configured to: determine a speech recognition model, based on user information, the determining of the speech recognition model comprising determining a predictive language model included in the speech recognition model based on language models included in a range, the range being determined based on an utterance predicted to be uttered by the user, and perform speech recognition on the speech of the user, based on the speech recognition model; a communicator configured to download the speech recognition model; and an output interface configured to output a result of performing the speech recognition. ### Claim 15 (depends on 14) The speech recognition apparatus of claim 14, wherein the speech recognition model comprises at least one of a pre-processing model, an acoustic model, or a language model. ### Claim 16 (depends on 14) The speech recognition apparatus of claim 14, wherein the at least one processor is further configured to obtain the user information, and wherein the user information comprises at least one of information about a characteristic of the user, information about an environment in which the user is located, information about a vehicle in which the user is located, information about a destination of the user, or information input by the user. ### Claim 17 (depends on 14) The speech recognition apparatus of claim 14, wherein the speech recognition model comprises the predictive language model related to the predicted utterance, and wherein, when the speech recognition model is determined, the at least one processor is further configured to: determine a domain of a language model, based on the user information, determine a range of language models comprised in the domain, based on information about a characteristic of the user which is comprised in the user information, and determine at least one language model to be the predictive language model, wherein the range comprises the at least one language model. ### Claim 18 (depends on 14) The speech recognition apparatus of claim 14, wherein the speech recognition model comprises the predictive language model related to the predicted utterance, and wherein, when the speech recognition model is determined, the at least one processor is further configured to: determine the predictive language model comprising a language model related to a first point comprised in a route, based on information about the route the user takes to move to a destination, and control the communicator to download the language model related to the first point before arriving at the first point, based on predicting that a network status of the speech recognition apparatus at the first point will be insufficient. ### Claim 19 (depends on 14) The speech recognition apparatus of claim 14, wherein the at least one processor is further configured to: determine a usage method of the speech recognition model, and perform the speech recognition by using the speech recognition model, based on the usage method, thereby performing the speech recognition on the speech of the user, and wherein the usage method of the speech recognition model comprises at least one of a use period of the speech recognition model, a method of processing the speech recognition model after the speech recognition model is used, or reliability of the speech recognition model. ### Claim 20 (depends on 19) The speech recognition apparatus of claim 19, wherein, when the at least one processor performs the speech recognition by using the speech recognition model based on the usage method, the at least one processor is further configured to: perform the speech recognition by using the speech recognition model, during a use period of the speech recognition model comprised in the usage method, and after the use period of the speech recognition model is expired, delete or deactivate the speech recognition model, based on the usage method. ### Claim 21 A non-transitory computer-readable recording medium having recorded thereon one or more programs comprising instructions that, when executed by a processor of an electronic apparatus, causes the electronic apparatus to: determine a speech recognition model, based on user information, the determining of the speech recognition model comprising determining a predictive language model included in the speech recognition model based on language models included in a range, the range being determined based on an utterance predicted to be uttered by a user of the electronic apparatus; download the speech recognition model; perform speech recognition, based on the speech recognition model; and output a result of performing the speech recognition.