# US 2023/0055233 A1 · Method of Training Voice Recognition Model and Voice Recognition Device Trained by Using Same Method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0055233 A1
- Document ID: US20230055233A1
- Status: Published application
- Kind: A1
- Application number: 17/798,801
- Filed: 2021-02-05
- Published: 2023-02-23
- Earliest claimed: 2020-02-11
- Assignees: Llsollu Co., Ltd.
- Applicants: Llsollu Co., Ltd.
- Inventors: Chang Jin Ji; Myeong Jin Hwang
- Web page: https://patentgrep.com/patent/US20230055233A1

## CPC

- G10L 15/063: {Training}
- G10L 15/02: Feature extraction for speech recognition; Selection of recognition unit
- G10L 15/187: Phonemic context, e.g. pronunciation rules, phonotactical constraints or phoneme n-grams
- G10L 15/183: using context dependencies, e.g. language models
- G10L 2015/025: {Phonemes, fenemes or fenones being the recognition units}
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

A method of training a voice recognition model to convert voice data to text data, according to one embodiment of the present invention, comprises the steps of: receiving the voice data input; converting the voice data into one or more grapheme data items using the voice recognition model; generating one or more word candidates corresponding to the one or more grapheme data items by using the voice recognition model; determining, on the basis of context, one of the word candidates as the text data that corresponds to the voice data, by using the voice recognition model; and adding a weight to one or more rules associated with generation of the word candidate determined as the text data, by using a back propagation value generated on the basis of the text data.

## Claims

### Claim 1

A method for learning a speech recognition model to convert speech data into text data, comprising:
receiving speech data input;
converting the speech data into one or more phonetic symbol data using the speech recognition model;
generating one or more word candidates corresponding to the one or more phonetic symbol data using the speech recognition model;
determining any one of the word candidates as the text data corresponding to the speech data, on the basis of a context, using the speech recognition model; and
assigning weighted values to one or more rules related to generation of the word candidate determined as the text data using a back-propagation value generated based on the text data,
wherein the generation of the one or more word candidates includes:
mapping one or more phonetic symbol sequence segments, which are selected in the order of frequency of appearance among the phonetic symbol sequence segments generated from the phonetic symbol data, into one or more grapheme sequence segments, which are selected in the order of the greatest number among the grapheme sequence segments generated from the general text data; and generating the one or more words using the above mapping of the one or more phonetic symbol sequence segments and the one or more grapheme sequence segments.

### Claim 2 (depends on 1)

The method according to claim 1, wherein the back-propagation value is used to assign a weighted value to a rule related to generation of phonetic symbol data serving as the basis of the word candidate determined as the text data.

### Claim 3 (depends on 1)

The method according to claim 1, wherein the back-propagation value is used to assign a weighted value to a rule related to mapping of phonetic symbol sequence segments and grapheme sequence segments, which serve as the basis of the word candidate determined as the text data.

### Claim 4 (depends on 1)

The method according to claim 1, wherein the back-propagation value is used to a weighted value to a rule related to the word candidate determined as the text data.

### Claim 5 (depends on 1)

The method according to claim 1, wherein the context includes one or more among a context including graphemes, letters or morphemes, a sentence structure, a word class (or part-of-speech) and a sentence component.

### Claim 6

A speech recognition apparatus for converting speech data into text data by executing a speech recognition model, comprising:
an input/output device for receiving speech data input;
a memory for storing information on the speech recognition model; and
a processor that executes the speech recognition model to convert the speech data into the text data,
wherein the speech recognition model:
converts the speech data into one or more phonetic symbol data using the speech recognition model;
generates one or more word candidates corresponding to the one or more phonetic symbol data using the speech recognition model;
determines any one among the word candidates as the text data corresponding to the speech data, on the basis of a context, using the speech recognition model;
assigns weighted values to one or more rules related to the generation of the word candidate determined as the text data using a back-propagation value generated based on the text data;
converts general text data distinguishable from the speech data into one or more grapheme sequence data;
maps one or more phonetic sequence segments, which are selected in the order of the largest number among the phonetic sequence segments generated from the phonetic symbol data, along with one or more grapheme sequence segments, which are selected in the order of the largest number among the grapheme sequence segments generated from the grapheme sequence data; and then, generates the one or more word candidates using the above mapping of the one or more phonetic symbol sequence segments and the one or more grapheme sequence segments.

### Claim 7 (depends on 6)

The apparatus according to claim 6, wherein the back-propagation value is used to assign a weighted value to a rule related to generation of phonetic symbol data serving as the basis of the word candidate determined as the text data.

### Claim 8 (depends on 6)

The apparatus according to claim 6, wherein the back-propagation value is used to assign a weighted value to a rule related to mapping of phonetic symbol sequence segments and grapheme sequence segments, which serve as the basis of the word candidate determined as the text data.

### Claim 9 (depends on 6)

The apparatus according to claim 6, wherein the back-propagation value is used to a weighted value to a rule related to the word candidate determined as the text data.

### Claim 10 (depends on 6)

The apparatus according to claim 6, wherein the context includes one or more among a context including graphemes, letters or morphemes, a sentence structure, a word class (or part-of-speech) and a sentence component.

### Claim 11 (depends on 1)

A computer-readable recording medium for storing a computer program,
wherein the computer program includes an instruction by which a processor executes the method according to claim 1.

### Claim 12 (depends on 1)

A computer program stored in a computer-readable recording medium,
wherein the computer program includes an instruction by which a processor executes the method according to claim 1.
