Methods and apparatus to identify a count of n-grams appearing in a corpus

A method of identifying a count of n-grams in a corpus, the method comprising:

• identifying a token that frequently begins a suffix found in the corpus;
• identifying first suffixes and second suffixes within the corpus;
• detecting that the first suffixes begin with the token and that the second suffixes do not begin with the token;
• performing, by executing an instruction with at least one processor, a first counting algorithm to identify a first count of n-grams in the first suffixes;
• and
• performing, by executing an instruction with at the least one processor, a second counting algorithm to identify a second count of n-grams in the second suffixes, the second counting algorithm different from the first counting algorithm, the second count of n-grams used as a statistic for computational linguistics.

A non-transitory machine-readable medium comprising instructions which, when executed, cause at least one processor to at least:

• identify a token that frequently begins a suffix found in the corpus;
• identify first suffixes and second suffixes within the corpus;
• detect that the first suffixes begin with the token and that the second suffixes do not begin with the token;
• perform a first counting algorithm to identify a first count of n-grams in the first suffixes;
• and
• perform a second counting algorithm to identify a second count of n-grams in the second suffixes, the second counting algorithm different from the first counting algorithm, the second count of n-grams used as a statistic for computational linguistics.