Generating data feed specific parser circuits

A computer system for generating a data feed specific parser circuit, the computer system comprising:

• a bus system;
• a storage device connected to bus system, wherein the storage device stores computer readable program code;
• and
• a processor connected to the bus system, wherein the processor executes the computer readable program code to receive an input of a number of bytes of feed data associated with a particular data feed that the data feed specific parser circuit is to process;
• parse a feed format specification file that describes a data format of the particular data feed using a compiler to generate an internal data structure of the feed format specification file;
• determine a minimum number of parallel pipeline stages in the data feed specific parser circuit to process the number of bytes of feed data associated with the particular data feed in parallel during a hardware clock cycle based on the generated internal data structure of the feed format specification file;
• determine a minimum memory contents and block size in the data feed specific parser circuit to process the number of bytes of feed data associated with the particular data feed in parallel during the hardware clock cycle based on the generated internal data structure of the feed format specification file;
• generate a description of the data feed specific parser circuit with the determined minimum number of parallel pipeline stages;
• and configure a configurable hardware chip using the generated description of the data feed specific parser circuit with the determined minimum number of parallel pipeline stages and the determined minimum memory contents and block size to process the number of bytes of feed data associated with the particular data feed in parallel per hardware clock cycle.

A computer program product stored on a computer readable storage device having computer readable program code embodied thereon that is executable by a computer for generating a data feed specific parser circuit, the computer program product comprising:

• computer readable program code for receiving an input of a number of bytes of feed data associated with a particular data feed that the data feed specific parser circuit is to process;
• computer readable program code for parsing a feed format specification file that describes a data format of the particular data feed using a compiler to generate an internal data structure of the feed format specification file;
• computer readable program code for determining a minimum number of parallel pipeline stages in the data feed specific parser circuit to process the number of bytes of feed data associated with the particular data feed in parallel during a hardware clock cycle based on the generated internal data structure of the feed format specification file;
• computer readable program code for determining a minimum memory contents and block size in the data feed specific parser circuit to process the number of bytes of feed data associated with the particular data feed in parallel during the hardware clock cycle based on the generated internal data structure of the feed format specification file;
• computer readable program code for generating a description of the data feed specific parser circuit with the determined minimum number of parallel pipeline stages;
• and
• computer readable program code for configuring a configurable hardware chip using the generated description of the data feed specific parser circuit with the determined minimum number of parallel pipeline stages and the determined minimum memory contents and block size to process the number of bytes of feed data associated with the particular data feed in parallel per hardware clock cycle.

A computer implemented method for processing a particular data feed, the computer implemented method comprising:

• receiving, by a generated data feed specific parser circuit, a particular data feed that corresponds to the generated data feed specific parser circuit, wherein the generated data feed specific parser circuit includes a pre-determined minimum number of parallel pipeline stages and a pre-determined minimum memory contents and block size to process a pre-determined number of bytes of feed data associated with the particular data feed;
• parsing, by the generated data feed specific parser circuit, payload data associated with the pre-determined number of bytes of feed data to extract one message field for each of the pre-determined minimum number of parallel pipeline stages from the pre-determined number of bytes of feed data using metadata associated with the pre-determined number of bytes of feed data;
• processing, by the generated data feed specific parser circuit, all of a plurality of extracted message fields in parallel using the pre-determined minimum number of parallel pipeline stages during a hardware clock cycle to extract a field identifier and a field value from each processed message field;
• outputting, by the generated data feed specific parser circuit, the field identifier and the field value of each processed message field;
• determining, by the generated data feed specific parser circuit, whether the pre-determined number of bytes of feed data includes message header data;
• responsive to the generated data feed specific parser circuit determining that the pre-determined number of bytes of feed data includes message header data, parsing, by the generated data feed specific parser circuit, the message header data to extract a message type from the message header data;
• using, by the generated data feed specific parser circuit, the extracted message type to lookup a content addressable memory location that corresponds to an encoded message type address within a pointer read only memory;
• using, by the generated data feed specific parser circuit, the encoded message type address within the pointer read only memory to lookup an address of the metadata associated with the pre-determined number of bytes of feed data within a metadata read only memory, wherein the metadata read only memory stores the metadata associated with the pre-determined number of bytes of feed data;
• and
• passing, by the generated data feed specific parser circuit, the metadata associated with the pre-determined number of bytes of feed data to a data payload parsing stage of the generated data feed specific parser circuit.