Parser for schema-free data exchange format
AssigneeMicrosoft Technology Licensing, LLC
InventorsYinan Li, Nikolaos Romanos Katsipoulakis, Badrish Chandramouli, Jonathan D Goldstein, Donald Kossmann
Life of this patent
Estimating the term…
Abstract
A method includes obtaining a query containing at least one field from which data is being queried, obtaining a dataset having a schema-free data exchange format having multiple fields of data at different physical positions in the dataset, and parsing the dataset by obtaining a structural index that maps logical locations of fields to physical locations of the fields of the dataset, accessing the structural index with logical locations of the fields that index to the physical locations, and providing data from the fields based on the physical locations responsive to the query.
Claims20
A computer implemented method of generating a structural index identifying locations of fields in a dataset having a schema-free data exchange format having multiple fields of data at different physical positions in the dataset, the method comprising:
- detecting key/value structural character separators of data fields in the dataset;
- detecting object begin and object end characters in the dataset;
- detecting when the structural character separators occur within dataset strings and do not define a structure of the dataset;
- creating a bitmap corresponding to structural character separators of the data fields that define the structure of the dataset, wherein the bitmap includes a bit for each character in the dataset and identifies physical locations of such data fields from logical locations of such data fields;
- executing a query on the dataset using the bitmap to identify data from data fields responsive to the query.
A machine readable storage device having instructions for execution by a processor of a machine to cause the processor to perform operations to perform a method of generating a structural index identifying locations of fields in a dataset having a schema-free data exchange format having multiple fields of data at different physical positions in the dataset, the method comprising:
- detecting key/value structural character separators of data fields in the dataset;
- detecting object begin and object end character separators in the dataset;
- detecting when the structural characters occur within dataset strings and do not define a structure of the dataset;
- creating a bitmap corresponding to structural character separators of the data fields that define the structure of the dataset, wherein the bitmap includes a bit for each character in the dataset and identifies physical locations of such data fields from logical locations of such data fields;
- executing a query on the dataset using the bitmap to identify data from data fields responsive to the query.
A device comprising:
- a processor;
- and
- a memory device coupled to the processor and having a program stored thereon for execution by the processor to perform operations comprising:
- detecting key/value structural character separators of data fields in the dataset;
- detecting object begin and object end structural character separators in the dataset;
- detecting when the structural characters occur within dataset strings and do not define a structure of the dataset;
- creating a bitmap corresponding to structural character separators of the data fields that define the structure of the dataset, wherein the bitmap includes a bit for each character in the dataset and identifies physical locations of such data fields from logical locations of such data fields;
- executing a query on the dataset using the bitmap to identify data from data fields responsive to the query.
Dependencies are inferred from the claim text.