Low latency architecture with directory service for integration of transactional data system with analytical data structures

A method of low latency tasking and task monitoring system, the method including:

• an analytic data store creation task request maker running on hardware that generates creation task requests and specifies creation of an analytic data store based on at least one data set stored by at least one transactional data management system;
• queuing the task request to a named key-value task start queue;
• a worker thread picking up the task request from the named key-value task start queue;
• the worker thread reporting progress on the task request to a monitoring data structure independent of the task start queue;
• the worker thread registering a completed analytic data store with the transaction processing system;
• and
• upon completion of creating the analytic data store specified by the task request, the worker thread queuing a task complete report to a named key-value task complete queue complementary to the named key-value start queue.

A method of low latency query tasking and query processing monitoring between a transaction processing system and an analytics processing system, the method including:

• a transaction processing system generating a query task request that specifies querying a read-only analytic data store that stores a data set retrieved from at least one transactional data management system;
• queuing the task request to a named key-value task start queue;
• a worker thread picking up the task request from the named key-value task start queue;
• and
• upon completion of assembling query results specified by the task request, the worker thread queuing a task complete report to a named key-value task complete queue complementary to the named key-value start queue and reporting the assembled query results.