Big data propagation agent framework

A federated data distribution computer system, comprising:

• a data store;
• a non-transitory memory;
• a processor;
• and
• a data propagation application stored in the non-transitory memory that, when executed by the processor,
• receives a plurality of requests from a plurality of data consumers to initiate a plurality of data propagation agents, wherein each of the plurality of requests comprises a requested number of instances of a data propagation agent to be executed in a restricted runtime environment,
• in response to receiving the plurality of requests, instantiates the plurality of data propagation agents associated with the plurality of data consumers in the restricted runtime environment, wherein for at least one of the plurality of requests a number of instances of the data propagation agent instantiated for a data consumer is restricted by initiating a lesser number of instances of the data propagation agent than the requested number of instances so as to maintain equitable availability of data-as-a-service access to the data store among the data consumers,
• registers instantiated agents in an agent registry,
• schedules execution of the agents listed in the agent registry,
• establishes a communication connection with the data store,
• promotes discovery of data contained in the data store by extending a discovery application programming interface (API) to the agents,
• brokers requests from the agents to read data from the data store, wherein the agents have no communication connection with the data store, and the data propagation application restricts access of each agent based on a per-agent access policy,
• reads data from the data store via the communication connection, and
• provides the data read from the data store to the agents as a marked text document.