Systems and methods for short text similarity based clustering

A short text similarity based clustering system comprising:

• one or more processors;
• one or more memory components communicatively coupled to the one or more processors;
• and
• machine-readable instructions stored in the one or more memory components that cause the short text similarity based clustering system to perform at least the following when executed by the one or more processors:
• receive a plurality of documents comprising short text data;
• preprocess the short text data of each of the plurality of documents to generate a preprocessing based on a natural language processing (NLP) tool comprising a library, the NLP tool configured to use the library to extract text information from the short text data;
• after the preprocessing, determine a plurality of forward similarity values based on the short text data in each of the plurality of documents, wherein a forward similarity of one indicates a subsequent document comprises at least the short text data of a preceding document;
• determine a plurality of reverse similarity values based on the short text data in each of the plurality of documents, wherein a reverse similarity of one indicates the preceding document comprises at least the short text data of the subsequent document;
• generate a forward and reverse similarity matrix based on the plurality of forward similarity values and the plurality of reverse similarity values;
• and
• generate a plurality of short text similarity based clusters to group the short text data of the plurality of documents based on the forward and reverse similarity matrix.

A short text similarity based clustering method comprising:

• receiving a plurality of documents comprising short text data;
• determining a plurality of forward similarity values based on the short text data in each of the plurality of documents, wherein a forward similarity of one indicates a subsequent document comprises at least the short text data of a preceding document;
• determining a plurality of reverse similarity values based on the short text data in each of the plurality of documents, wherein a reverse similarity of one indicates the preceding document comprises at least the short text data of the subsequent document;
• generating a forward and reverse similarity matrix based on the plurality of forward similarity values and the plurality of reverse similarity values;
• and
• generating a plurality of short text similarity based clusters to group the short text data of the plurality of documents based on the forward and reverse similarity matrix.