Determining and discerning items with multiple meanings
AssigneeInternational Business Machines Corporation
InventorOded Shmueli
Life of this patent
Estimating the term…
Abstract
A method, system, and non-transitory compute readable medium determining and discerning items with multiple meanings in a sequence of items including producing a distributed representation for each item of the sequence of items including a word vector and a context vector, partitioning the sequence of items into classes, for an item using a representative word vector of each class, calculating a cosine distance between the word vector of said item and the class representative vector, and producing a new sequence of items by modifying the distributed representation in the producing by replacing each occurrence of an item depending on the cosine distance calculated by the calculating.
Claims6
A method of determining and discerning items with multiple meanings in a sequence of items, the method comprising:
- producing a distributed representation for each item of the sequence of items including a word vector and a context vector,
- partitioning the sequence of items into classes;
- for an item using a representative word vector of each class, calculating a cosine distance between the word vector of said item and the class representative vector,
- wherein the calculating scans the sequence of items and sets a current center item as a vocabulary word and uses an average of the word vectors of items in a window of a predetermined size surrounding the vocabulary word, and then calculates the cosine distance of the vector average with a class representative context vector.
A non-transitory computer-readable recording medium recording a program for determining and discerning items with multiple meanings in a sequence of items, the program causing a computer to perform:
- producing a distributed representation for each item of the sequence of items including a word vector and a context vector,
- partitioning the sequence of items into classes;
- for an item using a representative word vector of each class, calculating a cosine distance between the word vector of said item and the class representative vector,
- wherein the calculating scans the sequence of items and sets a current center item as a vocabulary word and uses an average of the word vectors of items in a window of a predetermined size surrounding the vocabulary word, and then calculates the cosine distance of the vector average with a class representative context vector.
A two-phase system for determining and discerning items with multiple meanings in a sequence of items, the system comprising:
- a processor, and
- a memory, the memory storing instructions to cause the processor to perform:
- producing a distributed representation for each item of the sequence of items including a word vector and a context vector,
- partitioning the sequence of items into classes;
- for an item using a representative word vector of each class, calculating a cosine distance between the word vector of said item and the class representative vector,
- wherein the calculating scans the sequence of items and sets a current center item as a vocabulary word and uses an average of the word vectors of items in a window of a predetermined size surrounding the vocabulary word, and then calculates the cosine distance of the vector average with a class representative context vector.
Dependencies are inferred from the claim text.