Method and System for Processing Raw Financial Data Streams to Produce and Distribute Structured and Validated Product Offering Data to Subscribing Clients

A system for processing raw data streams carrying a plurality of raw data objects containing information related to financial product offerings and subject to periodic updates, and for delivering substantially real-time offer updates to a plurality of clients via a data communication network, the system comprising:

• at least one information manager connected to the raw data streams and providing at least one broadcast data stream as output;
• and
• at least one client manager receiving at least one broadcast data stream as input and transmitting the offer updates to the plurality of clients;
• the information manager comprising:
• (a) a translator configured to receive the raw data objects as input and generate raw events comprising a set of name-value pairs derived from data in the raw data objects;
• (b) a processing database having object typing and formatting rules stored therein;
• (c) an offer processor connected to the processing database and configured to, in response to the receipt of a raw event:
• determine an object type associated with the raw event;
• and
• generate an external event containing a formatted data object derived from the contents of the received raw event in accordance with the formatting rules;
• an object storage pool configured to store a plurality of formatted data objects therein;
• (d) an offer pool manager connected to the object storage pool and configured to, upon receipt of an external event:
• determine if a prior version of the formatted data object is present in an object storage pool;
• if a prior version is present in the object storage pool:
• determine a data differential between the formatted data object and the prior version,
• update the prior version of the formatted data object to correspond with the generated formatted data object, and
• broadcast the data differential on a broadcast data stream;
• otherwise, if no prior version is present in the object storage pool:
• provide the formatted data object to the connected client manager, and
• store the formatted data object in the object storage pool;
• the client manager comprising:
• (a) at least one object state manager, each object state manager connected to a respective broadcast data stream, comprising an associated object cache and subscriber data indicating subscribers to the respective data input stream, and configured to:
• receive a data object on the connected input data stream related to a specific product offering, update the state of the specific product offering in associated object pool cache in accordance with the state changed indicated in the received data object, and generate an object event directed to subscribers of the respective data input stream indicating the state change for the specific product offering in accordance with the subscriber data;
• (b) a plurality of client session modules, each client session module being in communication with a respective client and configured to:
• receive object events generated by object state managers connected to an broadcast data stream to which the respective client has subscribed, upon receiving an object event, evaluate client object rules against the object event, the object rules selected in accordance with the particular broadcast data stream associated with the object event, and generate a state event from the object event indicating the changed state of the specific data object to the respective client in response to a positive evaluation;
• (c) a plurality of delivery managers, each delivery manager being associated with a respective client session module and configured to:
• receive state events generated by the associated client session module, and
• send client events derived from the received state events to the respective client;
• and
• (d) a client session manager having access to a plurality of client profiles, each client profile containing data stream subscription information and related client object rules, the client manager configured to:
• receive an initial communication from a new client;
• associate the new client with a new client session module;
• retrieve the client profile associated with the new client;
• identify a set of data stream subscriptions indicated in the client profile;
• and
• add the new client session module to the subscription data for each object state manager connected to an input data stream to which the new client is subscribed.