Back to results
US 10,949,414 B2Granted
Managing a computing cluster interface
AssigneeAb Initio Technology LLC
InventorsBryan Phil Douros, Craig W. Stanfill
Life of this patent
Estimating the term…
Abstract
A method for processing data using a distributed data processing system includes providing input data to the distributed data processing system from a distributed data processing system interface component in communication with the distributed data processing system. The distributed data processing system processes the input data to generate a response, which it provides to the distributed data processing system interface component. The distributed data processing system interface component holds the response in escrow until it receives an indication from the distributed data processing system that the response has reached a sufficient level of durability.
Claims16
A method for processing data using a distributed data processing system including a plurality of processing nodes, the method including:
- receiving input data at a distributed data processing system interface component in communication with the distributed data processing system;
- providing the received input data to the distributed data processing system, wherein the distributed data processing system assigns an indicator associated with a first time interval of a plurality of time intervals to the input data;
- generating state information within the distributed data processing system in response to receiving the input data, wherein the state information includes the indicator associated with the first time interval;
- receiving and storing, at the distributed data processing system interface component, result data associated with the input data from the distributed data processing system, wherein the result data includes an indicator associated with a second time interval later than the first time interval;
- determining, at a first processing node of the plurality of processing nodes, an indicator of an earliest time interval of the plurality of time intervals for which all state information that includes the indicator associated with the second time interval is stored at a first level of durability;
- providing the indicator of the earliest time interval to the distributed data processing system interface component;
- and
- determining whether to release the result data from the distributed data processing system interface based on a comparison, at the distributed data processing system interface component, of the indicator of the earliest time interval to the indicator associated with the second time interval associated with the result data.
5 more elements
A non-transitory computer-readable medium having software stored thereon, the software for processing data using a distributed data processing system including a plurality of processing nodes, the software including instructions for causing a computing system to:
- receive input data at a distributed data processing system interface component in communication with the distributed data processing system;
- provide the received input data to the distributed data processing system, wherein the distributed data processing system assigns an indicator associated with a first time interval of a plurality of time intervals to the input data;
- generate state information within the distributed data processing system in response to receiving the input data, wherein the state information includes the indicator associated with the first time interval;
- receive and store, at the distributed data processing system interface component, result data associated with the input data from the distributed data processing system, wherein the result data includes an indicator associated with a second time interval later than the first time interval;
- determine, at a first processing node of the plurality of processing nodes, an indicator of an earliest time interval of the plurality of time intervals for which all state information that includes the indicator associated with the second time interval is stored at a first level of durability;
- provide the indicator of the earliest time interval to the distributed data processing system interface component;
- and
- determine whether to release the result data from the distributed data processing system interface based on a comparison, at the distributed data processing system interface component, of the indicator of the earliest time interval to the indicator associated with the second time interval associated with the result data.
5 more elements
An apparatus for processing data, the apparatus including:
- a distributed data processing system including a plurality of processing nodes, each processing node including at least one processor;
- a distributed data processing system interface component in communication with the distributed data processing system;
- and
- a communication medium connecting the plurality of processing nodes for sending and receiving information between processing nodes of the plurality of processing nodes;
- wherein the apparatus is configured to:
- receive input data at the distributed data processing system interface component in communication with the distributed data processing system;
- provide the received input data to the distributed data processing system, wherein the distributed data processing system assigns an indicator associated with a first time interval of a plurality of time intervals to the input data;
- generate state information within the distributed data processing system in response to receiving the input data, wherein the state information includes the indicator associated with the first time interval;
- receive and store, at the distributed data processing system interface component, result data associated with the input data from the distributed data processing system, wherein the result data includes an indicator associated with a second time interval later than the first time interval;
- determine, at a first processing node of the plurality of processing nodes, an indicator of an earliest time interval of the plurality of time intervals for which all state information that includes the indicator associated with the second time interval is stored at a first level of durability;
- provide the indicator of the earliest time interval to the distributed data processing system interface component;
- and
- determine whether to release the result data from the distributed data processing system interface based on a comparison, at the distributed data processing system interface component, of the indicator of the earliest time interval to the indicator associated with the second time interval associated with the result data.
10 more elements
A computing system for processing data using a distributed data processing system including a plurality of processing nodes, the computing system including:
- means for receiving input data at a distributed data processing system interface component in communication with the distributed data processing system;
- means for providing the received input data to the distributed data processing system, wherein the distributed data processing system assigns an indicator associated with a first time interval of a plurality of time intervals to the input data;
- means for generating state information within the distributed data processing system in response to receiving the input data, wherein the state information includes the indicator associated with the first time interval;
- means for receiving and storing, at the distributed data processing system interface component, result data associated with the input data from the distributed data processing system, wherein the result data includes an indicator associated with a second time interval later than the first time interval;
- means for determining, at a first processing node of the plurality of processing nodes, an indicator of an earliest time interval of the plurality of time intervals for which all state information that includes the indicator associated with the second time interval is stored at a first level of durability;
- means for providing the indicator of the earliest time interval to the distributed data processing system interface component;
- and
- means for determining whether to release the result data from the distributed data processing system interface based on a comparison, at the distributed data processing system interface component, of the indicator of the earliest time interval to the indicator associated with the second time interval associated with the result data.
5 more elements
Dependencies are inferred from the claim text.