Apparatus, method, and medium for generating grammar network for use in speech recognition and dialogue speech recognition

A method of generating a grammar network for speech recognition comprising:

• forming a semantic map by clustering words forming each dialogue sentence included in a dialogue sentence corpus depending on semantic correlation;
• forming an acoustic map by clustering words forming each dialogue sentence included in the dialogue sentence corpus depending on acoustic similarity;
• activating the semantic map and generating a first candidate group formed of a plurality of words having the semantic correlation extracted for each word forming a dialogue sentence included in a dialogue history performed between a system and a user;
• activating the acoustic map and generating a second candidate group formed of a plurality of words having an acoustic similarity extracted for each word forming the dialogue sentence included in the dialogue history and each word of the first candidate group;
• and
• generating the grammar network by randomly combining the first candidate group and the second candidate group,
• wherein the method is performed using a computer.

An apparatus for speech recognition comprising:

• a feature extraction unit to extract features from a user's voice and generating a feature vector string;
• a grammar network generation unit to generate a grammar network by activating a semantic map and an acoustic map by using contents of a dialogue most recently spoken, whenever the user speaks;
• a loading unit to load the grammar network generated by the grammar network generation unit;
• and
• a searching unit to search the grammar network loaded in the loading unit, by using the feature vector string, and generating a candidate recognition sentence formed of a word string matching the feature vector string,
• wherein the grammar network generation unit comprises:
• a dialogue history storage unit to store a dialogue history between the system and the user;
• a semantic map formed by clustering words forming each dialogue sentence included in a dialogue sentence corpus depending on semantic correlation, and generating a first candidate group formed of a plurality of words having the semantic correlation extracted for each word forming a dialogue sentence provided from the dialogue history storage unit;
• an acoustic map formed by clustering words forming each dialogue sentence included in the dialogue sentence corpus depending on acoustic similarity, and generating a second candidate group formed of a plurality of words having an acoustic similarity extracted for each word forming the dialogue sentence provided from the dialogue history storage unit and each word of the first candidate group;
• and
• a grammar network construction unit to construct the grammar network by randomly combining words included in the first candidate group and the words included in the second candidate group.

A method of speech recognition comprising:

• extracting features from a user's voice and generating a feature vector string;
• generating a grammar network by activating a semantic map and an acoustic map by using contents of a dialogue most recently spoken, whenever the user speaks;
• loading the grammar network;
• and
• searching the loaded grammar network, by using the feature vector string, and generating a candidate recognition sentence formed of a word string matching the feature vector string,
• wherein the generation of the grammar network comprises:
• forming a semantic map by clustering words forming each dialogue sentence included in a dialogue sentence corpus depending on semantic correlation;
• forming an acoustic map by clustering words forming each dialogue sentence included in the dialogue sentence corpus depending on acoustic similarity;
• activating the semantic map and generating a first candidate group formed of a plurality of words having the semantic correlation extracted for each word forming a dialogue sentence included in a dialogue history performed between a system and a user;
• activating the acoustic map and generating a second candidate group formed of a plurality of words having an acoustic similarity extracted for each word forming the dialogue sentence included in the dialogue history and each word of the first candidate group;
• and
• generating the grammar network by randomly combining the first candidate group and the second candidate group.

At least one computer readable storage medium storing instructions that control at least one processor for executing a method of generating a grammar network for speech recognition, wherein the method comprises:

• forming a semantic map by clustering words forming each dialogue sentence included in a dialogue sentence corpus depending on semantic correlation;
• forming an acoustic map by clustering words forming each dialogue sentence included in the dialogue sentence corpus depending on acoustic similarity;
• activating the semantic map and generating a first candidate group formed of a plurality of words having the semantic correlation extracted for each word forming a dialogue sentence included in a dialogue history performed between a system and a user;
• activating the acoustic map and generating a second candidate group formed of a plurality of words having an acoustic similarity extracted for each word forming the dialogue sentence included in the dialogue history and each word of the first candidate group;
• and
• generating the grammar network by randomly combining the first candidate group and the second candidate group.

At least one computer readable storage medium storing instructions that control at least one processor for executing a method of speech recognition, wherein the method comprises:

• extracting features from a user's voice and generating a feature vector string;
• generating a grammar network by activating a semantic map and an acoustic map by using contents of a dialogue most recently spoken, whenever the user speaks;
• loading the grammar network;
• and
• searching the loaded grammar network, by using the feature vector string, and generating a candidate recognition sentence formed of a word string matching the feature vector string,
• wherein the generation of the grammar network comprises:
• forming the semantic map by clustering words forming each dialogue sentence included in a dialogue sentence corpus depending on semantic correlation;
• forming the acoustic map by clustering words forming each dialogue sentence included in the dialogue sentence corpus depending on acoustic similarity;
• activating the semantic map and generating a first candidate group formed of a plurality of words having the semantic correlation extracted for each word forming a dialogue sentence included in a dialogue history performed between a system and a user;
• activating the acoustic map and generating a second candidate group formed of a plurality of words having an acoustic similarity extracted for each word forming the dialogue sentence included in the dialogue history and each word of the first candidate group;
• and
• generating the grammar network by randomly combining the first candidate group and the second candidate group.

A method of speech recognition comprising:

• extracting features from a user's voice and generating a feature vector string;
• generating a grammar network by activating a semantic map and an acoustic map by using contents of a dialogue spoken by a user;
• and
• searching the grammar network, by using the feature vector string, and generating a candidate recognition sentence formed of a word string matching the feature vector string,
• wherein the generation of the grammar network comprises:
• forming the semantic map by clustering words forming each dialogue sentence included in a dialogue sentence corpus depending on semantic correlation;
• forming the acoustic map by clustering words forming each dialogue sentence included in the dialogue sentence corpus depending on acoustic similarity;
• activating the semantic map and generating a first candidate group formed of a plurality of words having the semantic correlation extracted for each word forming a dialogue sentence included in a dialogue history performed between a system and a user;
• activating the acoustic map and generating a second candidate group formed of a plurality of words having an acoustic similarity extracted for each word forming the dialogue sentence included in the dialogue history and each word of the first candidate group;
• and
• generating the grammar network by randomly combining the first candidate group and the second candidate group.

At least one computer readable storage medium storing instructions that control at least one processor for executing a method of speech recognition, wherein the method comprises:

• extracting features from a user's voice and generating a feature vector string;
• generating a grammar network by activating a semantic map and an acoustic map by using contents of a dialogue spoken by a user;
• and
• searching the grammar network, by using the feature vector string, and generating a candidate recognition sentence formed of a word string matching the feature vector string,
• wherein the generation of the grammar network comprises:
• forming the semantic map by clustering words forming each dialogue sentence included in a dialogue sentence corpus depending on semantic correlation;
• forming the acoustic map by clustering words forming each dialogue sentence included in the dialogue sentence corpus depending on acoustic similarity;
• activating the semantic map and generating a first candidate group formed of a plurality of words having the semantic correlation extracted for each word forming a dialogue sentence included in a dialogue history performed between a system and a user;
• activating the acoustic map and generating a second candidate group formed of a plurality of words having an acoustic similarity extracted for each word forming the dialogue sentence included in the dialogue history and each word of the first candidate group;
• and
• generating the grammar network by randomly combining the first candidate group and the second candidate group.