Method and device for N-gram identification and extraction

A computing device for n-gram identification and extraction, the computing device comprises:

• a processor;
• and
• a memory communicatively coupled to the processor, wherein the memory stores processor instructions, which, on execution, causes the processor to:
• identify at least one n-gram from a sentence inputted by a user based on a confidence score associated with each of the at least one n-gram, wherein a confidence score for an n-gram is computed based on comparison of the n-gram with existing word patterns;
• determine a direction context entropy coefficient for each of the at least one n-gram, based on the existing word patterns;
• iteratively expand one or more of the at least one n-gram by the smallest n-gram unit at each iteration in a predefined direction in the sentence to generate at least one expanded n-gram, based on an associated direction context entropy coefficient, wherein the one or more of the at least one n-gram is iteratively expanded until obtaining maximum meaningful n-grams in the predefined direction;
• validate, by the computing device, expansion of the n-gram in the predefined direction based on a cross context entropy coefficient and a reverse cross context entropy coefficient;
• extract at each expanding iteration one or more of the at least one expanded n-gram based on a confidence score associated with each of the one or more of the at least one expanded n-gram, wherein a confidence score for an expanded n-gram is computed based on comparison of the expanded n-gram with the existing word patterns;
• and
• group semantically linked n-grams from the one or more of the at least one expanded n-gram.

A non-transitory computer-readable storage medium having stored thereon, a set of computer-executable instructions causing a computer comprising one or more processors to perform steps comprising:

• identifying at least one n-gram from a sentence inputted by a user based on a confidence score associated with each of the at least one n-gram, wherein a confidence score for an n-gram is computed based on comparison of the n-gram with existing word patterns;
• determining a direction context entropy coefficient for each of the at least one n-gram, based on the existing word patterns;
• iteratively expanding one or more of the at least one n-gram by the smallest n-gram unit at each iteration in a predefined direction in the sentence to generate at least one expanded n-gram, based on an associated direction context entropy coefficient, wherein the one or more of the at least one n-gram is iteratively expanded until obtaining maximum meaningful n-grams in the predefined direction;
• validating, by the computing device, expansion of the n-gram in the predefined direction based on a cross context entropy coefficient and a reverse cross context entropy coefficient;
• extracting at each expanding iteration one or more of the at least one expanded n-gram based on a confidence score associated with each of the one or more of the at least one expanded n-gram, wherein a confidence score for an expanded n-gram is computed based on comparison of the expanded n-gram with the existing word patterns;
• and
• grouping semantically linked n-grams from the one or more of the at least one expanded n-gram.