Method and system for reducing lexical ambiguity
OwnerLei Duan, Alexander Franz +1inventors
InventorsLei Duan, Alexander Franz, Keiko Horiguchi
Life of this patent
Estimating the term…
Abstract
A method and system for reducing lexical ambiguity in an input stream are described. In one embodiment, the input stream is broken into tokens. The tokens are used to create a connection graph comprising a number of paths. Each of the paths is assigned a cost. At least one best path is defined based upon a corresponding cost to generate an output graph. The generated output graph is provided to reduce lexical ambiguity.
Claims49
A method for reducing lexical ambiguity in an input stream, comprising:
- breaking the input stream into at least two tokens;
- creating a connection graph using the at least two tokens, the connection graph comprising a plurality of paths;
- assigning a cost to each of the plurality of paths;
- defining at least one best path based upon a corresponding cost to generate an output graph;
- and
- providing the output graph to a syntactic analysis module to reduce lexical ambiguity.
A method for providing segmentation of an input stream having at least two tokens, comprising:
- creating a plurality of segments from the at least two tokens based upon lexical information and lexical functions;
- and
- generating a connection graph using the plurality of segments.
An apparatus for reducing lexical ambiguity in an input stream, comprising:
- means for breaking the input stream into at least two tokens;
- means for creating a connection graph using the at least two tokens, the connection graph comprising a plurality of paths;
- means for assigning a cost to each of the plurality of paths;
- means for defining at least one best path based upon a corresponding cost to generate an output graph;
- and
- means for providing the output graph to a syntactic analysis module to reduce lexical ambiguity.
An apparatus for providing segmentation of an input stream having at least two tokens, comprising:
- means for creating a plurality of segments from the at least two tokens based upon lexical information and lexical functions;
- and
- means for generating a connection graph using the plurality of segments.
An apparatus for reducing lexical ambiguity in an input stream, comprising:
- a tokenizer for breaking the input stream into at least two tokens;
- a token connector for creating a connection graph using the at least two tokens, the connection graph comprising a plurality of paths;
- a cost assignor for assigning a cost to each of the plurality of paths;
- a path calculator for defining at least one best path based upon a corresponding cost to generate an output graph;
- and
- a graph provider for providing the output graph to a syntactic analysis module to reduce lexical ambiguity.
An apparatus for providing segmentation of an input stream having at least two tokens, comprising:
- a segmentation engine for creating a plurality of segments from the at least two tokens based upon lexical information and lexical functions;
- and
- a graph generator for generating a connection graph using the plurality of segments.
A system for reducing lexical ambiguity, comprising:
- a processor;
- an input coupled to the processor, the input capable of receiving an input stream, the processor configured to break the input stream into at least two tokens, create a connection graph comprising a plurality of paths using the at least two tokens, assign a cost to each of the plurality of paths, and define at least one best path based upon a corresponding cost to generate an output graph;
- and
- an output coupled to the processor, the output capable of providing the output graph to a syntactic analysis module to reduce lexical ambiguity.
A system for providing segmentation of an input stream, comprising:
- a processor;
- an input coupled to the processor, the input capable of receiving an input stream having at lest two tokens, the processor configured to create a plurality of segments from the at least two tokens based upon lexical information and lexical functions, and generate a connection graph using the plurality of segments;
- and
- an output coupled to the processor, the output capable of providing segmentation of the input stream.
A computer readable medium comprising instructions, which when executed on a processor, perform method for reducing lexical ambiguity in an input stream, comprising:
- breaking an input stream into at least two tokens;
- creating a connection graph using the at least one token, the connection graph comprising a plurality of paths;
- assigning a cost to each of the plurality of paths;
- defining at least one best path based upon a corresponding cost to generate an output graph;
- and
- providing the output graph to a syntactic analysis module to reduce lexical ambiguity.
A computer readable medium comprising instructions, which when executed on a processor, perform method for providing segmentation of an input stream having at least two tokens, comprising:
- creating a plurality of segments from the at least two tokens based upon lexical information and lexical functions;
- and
- generating a connection graph using the plurality of segments.
A memory for storing data for access by an application program being executed on a data processing system, comprising:
- a data structure stored in said memory, said data structure including information resident in a file used by said application program and including:
- a plurality of packet structures used for the transmission of data, wherein each packet structure includes
- a set of nodes,
- a set of arcs connecting at least two of the set of nodes, and
- a value data object for each of the set of arcs having a value that represents a corresponding part of speech tag.
Dependencies are inferred from the claim text.