Processing encoded data elements using an index stored in a file
AssigneeInternational Business Machines Corporation
InventorsWilliam Bittles, Lucas W. Partridge
Life of this patent
Estimating the term…
Abstract
An index of data elements is stored with a file. The file encodes the data elements. The index indicates memory locations of the data elements within the file. The index and the file are stored in a storage device. A parser or decoder accesses the index to identify data elements. At least one of the storing and accessing are performed by a computing device.
Claims23
A method comprising:
- encoding, by an encoder, data as data elements according to a schema, wherein the schema comprises metadata elements associated with the data elements;
- creating, by the encoder, an index of the data elements;
- storing the index of the data elements within a file, said index indicating memory locations of the data elements within the file, said index and said file being stored in a storage device, wherein the index indexes the metadata elements to the corresponding memory locations of the data elements within the file;
- and
- accessing, by a parser or decoder, the index to identify the data elements, wherein at least one of the encoding, creating, storing and accessing are performed by a computing device.
A method comprising:
- encoding data as one or more data elements in accordance with a first data format, wherein the first data format comprises metadata elements associated with the data elements;
- saving the encoded data to a file in a storage device;
- creating an index of the data elements, the index indicating the memory locations of one or more of the data elements within the file, wherein the index indexes the metadata elements to the corresponding memory locations of the data elements within the file;
- and
- embedding the index within the file, wherein the index is embedded in a part of the file that is not used by a parser or decoder for extraction of the data elements from the file, wherein at least one of the encoding, saving, creating, and embedding are performed by a computing device.
A computer implemented system for processing data encoded as one or more data elements in a data format, said computer implemented system comprising a processor being operable to:
- store an index of the data elements within a file, said data format comprising metadata elements associated with the data elements, said file encoding the data elements, said index indicating memory locations of the data elements within the file, said index indexes the metadata elements to the corresponding memory locations of the data elements within the file, said index and said file being stored in a storage device, wherein the index is embedded in a comment section of the file;
- access the index to identify the data elements, wherein at least one of the storing and accessing are performed by a computing device.
A computer implemented system for processing data encoded as one or more data elements in a data format, said data format being arranged for further processing by a parser to extract said encoded data elements, said computer implemented system comprising a processor being operable to:
- encode data as the one or more data elements in accordance with a first data format, wherein the first data format comprises metadata elements associated with the data elements;
- save the encoded data to a file in a storage device;
- create an index of the data elements, wherein the index indexes the metadata elements to the corresponding memory locations of the data elements within the file, the index indicating the locations of the one or more of the data elements within the file, wherein the index comprises offset data defining the start and end location of each data element;
- and
- embed the index within the file or append the index to the file.
Dependencies are inferred from the claim text.