Automated data parsing
AssigneeWolfram Alpha LLC
InventorsStephen Wolfram, Taliesin Sebastian Beynon
Life of this patent
Estimating the term…
Abstract
A framing technique included in a set of framing techniques is applied to at least a portion of a target data set. When a result of the application of the framing technique meets a first condition, a typing technique included in a set of typing techniques is applied to the target data set. When a result of the application of the typing technique meets a second condition, a tokenization technique included in a set of tokenization techniques is applied to the target data set. When a result of the application of the tokenization technique meets a third condition, a parsing technique for the target data set is determined to include the framing technique, the typing technique and the tokenization technique. An indication of the parsing technique is generated.
Claims31
A method for determining a parsing technique for a target data set, the method comprising:
- receiving, via a communication link at one or more computing devices, a target data set;
- applying a framing technique included in a set of framing techniques to at least a portion of the target data set;
- when a result of the application of the framing technique meets a first condition across the at least the portion of the target data set, applying a typing technique included in a set of typing techniques to the at least the portion of the target data set, the typing technique corresponding to the framing technique;
- when a result of the application of the typing technique meets a second condition across the at least the portion of the target data set, applying a tokenization technique included in a set of tokenization techniques to the at least the portion of the target data set, the tokenization technique corresponding to the typing technique;
- and
- when a result of the application of the tokenization technique meets a third condition across the at least the portion of the target data set,
- determining the parsing technique for the target data set to include the framing technique, the typing technique and the tokenization technique;
- and
- causing an indication of the parsing technique to be generated by the one or more computing devices,
- wherein the set of framing techniques, the set of typing techniques and the set of tokenization techniques are included in a set of defined parsing techniques.
An automated data parsing system for automatically parsing a target data set, the system comprising:
- an interface to a communication link, the interface configured to receive the target data set;
- an evaluator engine configured to determine a parsing technique for the target data set, the determination based on an evaluation of at least one candidate parsing technique against the target data set, the at least one candidate parsing technique included in a set of candidate parsing techniques;
- a register configured to store a set of confidence indicators corresponding to the set of candidate parsing techniques, wherein a set of values of the set of confidence indicators are updated based on a result of an application of the at least one candidate parsing technique to the target data set;
- and
- an output engine configured to provide an output corresponding to the parsing technique.
Dependencies are inferred from the claim text.