Method and Apparatus for Discovering and Classifying Polysemous Word Instances in Web Documents
AssigneeYahoo! Inc.
InventorRichard Michael KING
Life of this patent
Estimating the term…
Loading patent…
AssigneeYahoo! Inc.
InventorRichard Michael KING
Estimating the term…
A method and apparatus for discovering polysemous words and classifying polysemous words found in web documents. All document corpi in any natural language have words that have multiple usage contexts or words that have multiple meanings. Semantic analysis is not feasible for classifying all word occurrences in all documents on the web, which contain trillions of words in total. In addition, semantic analysis typically cannot distinguish multiple usages of a given meaning of a given word. In one embodiment of this invention, polysemous words in natural languages can be discovered by analyzing the co-occurrence of other words with the polysemous word in web documents. In one embodiment, the multiple meanings and usages of a polysemous word can be determined by analyzing the co-occurrences of other words with the polysemous word. In one embodiment, counting overcorrelations is achieved probabilistically to minimize use of network bandwidth.
A computer-implemented method for determining overcorrelation of words in a plurality of documents, the method comprising the steps of:
A computer-readable storage medium storing one or more sequences of instructions for determining overcorrelation of words in a plurality of documents, which instructions, when executed by one or more processors, causes the one or more processors to carry out the steps of:
Dependencies are inferred from the claim text.