Language processing using quantum and quantum-inspired language models

Abstract

A system and method for determining a probability distribution of a sentence are described herein. The system includes a processor determining a syntactic tensor network, which includes correlated syntactic elements, for the sentence. Each syntactic element includes words and linguistic information for each syntactic element. The processor determines a probability tensor which includes a probability distribution for each syntactic element in the sentence based on the linguistic information for the syntactic element. The processor determines the probability distribution of the sentence based on the probability tensor of each syntactic element in the sentence. In an embodiment, the processor determines a probability tensor of a word in the sentence, based on a syntactic neighborhood of the word and a linguistic group associated with its immediate neighbors. In another embodiment, the processor determines that an element is correlated with other elements and fuses the index of the probability tensor of each element.

Dependencies are inferred from the claim text.