Optimal Strategy for Data Replay in A Complex Multiplexing Network

A system, including memory loaded with computer program instructions and one or more processors operable to execute instructions stored in the memory, the instructions, when executed on the processors, implement a method of accelerating replay access to numerous streams via a channel aggregation hierarchy, including

• muxing events from at least 50 input buffers that receive event streams, into a physically aggregated stream in memory, wherein a subscriber is permitted to access events from the streams via a stream level channel, a physical aggregate level channel or an intermediate level channel that aggregates stream level channels and contributes to the physical aggregate level channel;
• demuxing the physical aggregated stream and caching the events from the physical aggregated stream into event cache memory;
• caching references to selected events, which belong to active channels that have subscribers, in a caching structure including channel cache lists of the references, the caching structure representing the channel aggregation hierarchy, including stream level channel cache lists, intermediate level channel cache lists, and, if the physical aggregate channel has subscribers, a physical aggregated channel cache list;
• and
• receiving a replay access request that specifies a channel at one of the stream level, intermediate level or physical aggregate channel and that specifies a starting point for the replay, and responsively delivering events from the event cache memory using a cache list corresponding to the specified channel.

A tangible non-transitory computer readable storage medium impressed with computer program instructions executable by a processor, the instructions, when executed on a processor, implement a method of accelerating replay access to numerous streams via a channel aggregation hierarchy, comprising:

• muxing events from at least 100 input buffers that receive event streams, into a physically aggregated stream in memory, wherein a subscriber is permitted to access events from the streams via a stream level channel, a physical aggregate level channel or an intermediate level channel that aggregates stream level channels and contributes to the physical aggregate level channel;
• demuxing the physical aggregated stream and caching the events from the physical aggregated stream into event cache memory;
• caching references to selected events, which belong to active channels that have subscribers, in a caching structure including channel cache lists of the references, the caching structure representing the channel aggregation hierarchy, including stream level channel cache lists, intermediate level channel cache lists, and, if the physical aggregate channel has subscribers, a physical aggregated channel cache list;
• and
• receiving a replay access request that specifies a channel at one of the stream level, intermediate level or physical aggregate channel and that specifies a starting point for the replay, and responsively delivering events from the event cache memory using a cache list corresponding to the specified channel.

A method of reducing computational complexity and latency when responding to queries for events multiplexed through a hierarchy of injection channels, intermediate aggregate channels, and physical aggregate channels, the method including:

• multiplexing events through a hierarchy of injection channels, intermediate aggregate channels, and physical aggregate channels, wherein events in the physical aggregate channels are persisted in storage;
• receiving a multitude of queries for events, wherein each query requests events multiplexed from at least one channel in the hierarchy;
• establishing separate pointer structures for subscribed to channels, wherein the pointer structures reference, for the respective subscribed to channels, demultiplexed events harvested to a cache from one or more active physical aggregate channels, wherein an active physical aggregate channel is a physical aggregate channel that has events multiplexed from at least one requested, unique channel;
• block demultiplexing events in the active physical aggregate channels;
• based on the block demultiplexing, identifying events multiplexed from the respective subscribed to channels and not previously harvested to the cache;
• harvesting the identified demultiplexed events from the active physical aggregate channels to the cache and updating the pointer structures to reference, for the respective requested, unique channels, the harvested demultiplexed events;
• and
• responding to the queries using the pointer structures and the demultiplexed events in the cache, without requiring separate demultiplexing and harvesting for each of the queries.