Method, device and system for part-of-speech disambiguation
AssigneeMotorola, Inc.
InventorsOrhan Karaali, Andrew William Mackie
Life of this patent
Estimating the term…
Abstract
A method (300), device (408), and system (400) provide part-of-speech disambiguation for words based on hybrid neural-network and stochastic processing. The method disambiguates the part-of-speech tags of text tokens by obtaining a set of probabilistically annotated tags for each text token, determining a locally predicted tag for each text token based on the local context of the text token, determining an alternative tag for each text token based on the expanded context of the text token, and choosing between the locally predicted tag and the alternative tag when the locally predicted tag and the alternative tag are different.
Claims11
A method for providing unambiguous part-of-speech tags to text tokens in an input text, comprising the steps of:
- A) obtaining a set of probabilistically annotated tags for a text token;
- B) determining a locally predicted tag for the text token based on a local context of at least one tag of another text token adjacent to the text token and determining an alternative tag for the text token based on an expanded context of the text token consisting of tags, features and boundaries;
- and
- C) choosing, utilizing a discriminator, between the locally predicted tag and the alternative tag when the locally predicted tag and the alternative tag are different.
An article of manufacture/computer program/computer/speech synthesizer for disambiguating the parts-of-speech of text tokens, having a computer usable medium with a computer readable program code thereon wherein the computer readable program code implements the steps of:
- A) determining a locally predicted tag for a text token based on a local context of at least one tag of another text token adjacent to the text token;
- B) determining an alternative tag for the text token based on an expanded context of the text token consisting of tags, features and boundaries;
- and
- C) choosing, using a discriminator routine, between the locally predicted tag and the alternative tag for the text token, when A locally predicted tag and the alternative tag are different.
An article of manufacture/application specific integrated circuit/microprocessor for disambiguating the parts-of-speech of text tokens, comprising:
- A) a local-context tagger, coupled to receive a sequence of probabilistically tagged text tokens, for determining a locally predicted tag for a text token based on a local context of at least one tag of another text token adjacent to the text token;
- B) an expanded-context tagger, coupled to receive the sequence of probabilistically tagged text tokens, for determining an alternative tag for the text token based on an expanded context of the text token consisting of tags, features and boundaries;
- and
- C) a discriminator, coupled to the local-context tagger and the expanded-context tagger, for choosing between the locally predicted tag and the alternative tag for the text token, when the locally predicted tag and the alternative tag are different.
Dependencies are inferred from the claim text.