Clustering of words with multiple meanings based on generating vectors for each meaning
AssigneeFujitsu Limited
InventorYuji Mizobuchi
Life of this patent
Estimating the term…
Abstract
A clustering method, clustering program, and clustering device are described herein for clustering of words with multiple meanings based on generating vectors for each meaning of a word. The generated vectors provide a distributed representation of a word in a vector space that account for the multiple meanings of the word so as, for instance, to learn semantic representations with high accuracy.
Claims7
A non-transitory computer-readable recording medium having stored therein a clustering program for causing a computer to execute a process for generating a distributed representation of a word in a vector space, the process comprising:
- recording, before a learning of multiple words, a first vector value in the vector space for each of the multiple words in at least one sentence retrieved from a sentence storage;
- recording, after the learning, a second vector value in the vector space for each of the multiple words;
- calculating a motion vector based on a difference between the first vector value and the second vector value for each of the multiple words;
- clustering the multiple words based on the calculated motion vector;
- and
- generating vectors separated for each meaning with respect to a word with multiple meanings included among the multiple words, based on a result of the clustering.
A clustering method, performed by a computer, for generating a distributed representation of a word in a vector space, the method comprising:
- recording, before a learning of multiple words, a first vector value in the vector space for each of the multiple words in at least one sentence retrieved from a sentence storage;
- recording, after the learning, a second vector value in the vector space for each of the multiple words;
- calculating a motion vector based on a difference between the first vector value and the second vector value for each of the multiple words;
- clustering the multiple words based on the calculated motion vector;
- and
- generating vectors separated for each meaning with respect to a word with multiple meanings included among the multiple words, based on a result of the clustering.
A clustering apparatus for generating a distributed representation of a word in a vector space, the apparatus comprising:
- a memory;
- and
- a processor coupled to the memory and configured to perform a process including:
- recording, before a learning of multiple words, a first vector value in the vector space for each of the multiple words in at least one sentence retrieved from a sentence storage;
- recording, after the learning, a second vector value in the vector space for each of the multiple words;
- calculating a motion vector based on a difference between the first vector value and the second vector value for each of the multiple words;
- clustering the multiple words based on the calculated motion vector;
- and
- generating vectors separated for each meaning with respect to a word with multiple meanings included among the multiple words, based on a result of the clustering.
A clustering apparatus for improving accuracy of a distributed representation of words, comprising:
- an extractor unit configured to extract a word from sentences maintained in a sentence storage device and generate a listing of sentences including the word;
- a first recorder unit configured to assign a first vector value in a vector space for the word before a learning of the word;
- a second recorder unit configured to assign, after the learning, a second vector value in the vector space for the word based on a learning model for each of the sentences including the word;
- a motion vector calculation unit configured to compute a motion vector based on a difference between the first vector value and each of the second vector values for each of the sentences including the word;
- a sorter unit configured to cluster the word into one or more clusters based on the computed motion vectors;
- a vector generating unit configured to generate one more vectors, each separated for a different meaning of word, to determine whether the word includes one or more meanings.
Dependencies are inferred from the claim text.