Systems and methods for unsupervised paraphrase mining

A method performed by a paraphrase mining system for aligning pairs of sentences, the method comprising:

• receiving a plurality of sentences;
• generating a graph for each of at least two sentences of the plurality of sentences, wherein generating a graph for each sentence of the at least two sentences comprises:
• identifying one or more tokens for the sentence;
• and
• connecting via edges the one or more tokens;
• generating a combined graph for the at least two sentences wherein generating a combined graph comprises:
• aligning the identified tokens of the at least two sentences of the plurality of sentences;
• identifying matching and non-matching tokens between the at least two sentences based on the alignment;
• and
• merging matching tokens into a combined graph node.

A paraphrase mining system comprising:

• one or more memory devices storing processor executable instructions;
• and
• one or more processors configured to execute the instructions to cause the paraphrase mining system to perform:
• receiving a plurality of sentences;
• generating a graph for each of at least two sentences of the plurality of sentences, wherein generating a graph for each sentence of the at least two sentences comprises:
• identifying one or more tokens for the sentence;
• and
• connecting via edges the one or more tokens;
• generating a combined graph for the at least two sentences wherein generating a combined graph comprises:
• aligning the identified tokens of the at least two sentences of the plurality of sentences;
• identifying matching and non-matching tokens between the at least two sentences based on the alignment;
• and
• merging matching tokens into a combined graph node.