Back to results
US 2024/0202602 A1Published application
Dynamic predictive analysis of data sets using an actor-driven distributed computational graph
AssigneeQomplx LLC
InventorsJason Crabtree, Andrew Sellers
Life of this patent
Estimating the term…
Abstract
A system for dynamic predictive analysis of data sets using an actor-driven distributed computational graph, wherein a pipeline orchestrator creates and manages individual data pipelines while providing data caching to enable interactions between specific activity actors within pipelines. Each pipeline then comprises a pipeline manager that creates and manages individual activity actors and directs operations within the pipeline while reporting back to the pipeline orchestrator.
Claims32
A computing system for dynamic predictive analysis of data sets using an actor-driven distributed computational graph, the computing system comprising:
- one or more hardware processors configured for:
- creating a directed computational graph comprising nodes representing data transformation activities and edges representing messaging between the nodes, and further comprising a plurality of paths between the nodes along edges, wherein:
- each path represents a transformation pipeline comprising a pipeline manager and one or more activity actors;
- each node in the directed computational graph stores information comprising one or more of the paths including information about a plurality of adjacent nodes;
- and
- at least one of the paths is a cyclical path which allows for solving of a problem requiring an iterative and recursive solution;
- caching a plurality of data contexts provided by a pipeline manager of at least one of the plurality of transformation pipelines;
- providing at least a portion of the plurality of data contexts to a pipeline manager of at least one of the plurality of transformation pipelines, wherein at least two transformation pipelines of the directed computational graph are configured to use different messaging protocols from one another;
- and
- creating a plurality of activity actors that:
- receive at least a set of data as a transformation input;
- perform an individual transformation upon a set of data;
- produce a data context based at least in part on the individual transformation;
- provide the transformed set of data as a transformation output;
- and
- provide the data context as a context output;
- providing reporting data to the pipeline orchestrator;
- receiving a data context from at least one of either the pipeline orchestrator or one of the plurality of activity actors;
- and
- providing the data context to at least one of either the pipeline orchestrator or one of the plurality of activity actors;
- wherein at least one data context receives data from a different data context or activity actor;
- and
- wherein at least one activity actor acts on a data context downstream of itself.
20 more elements
A computer-implemented method executed on a collaborative platform for dynamic predictive analysis of data sets using an actor-driven distributed computational graph, the computer-implemented method comprising:
- creating a directed computational graph comprising nodes representing data transformation activities and edges representing messaging between the nodes, and further comprising a plurality of paths between the nodes along edges, wherein:
- each path represents a transformation pipeline comprising a pipeline manager and one or more activity actors;
- each node in the directed computational graph stores information comprising one or more of the paths including information about a plurality of adjacent nodes;
- and
- at least one of the paths is a cyclical path which allows for solving of a problem requiring an iterative and recursive solution;
- caching a plurality of data contexts provided by a pipeline manager of at least one of the plurality of transformation pipelines;
- providing at least a portion of the plurality of data contexts to a pipeline manager of at least one of the plurality of transformation pipelines, wherein at least two transformation pipelines of the directed computational graph are configured to use different messaging protocols from one another;
- and
- creating a plurality of activity actors that:
- receive at least a set of data as a transformation input;
- perform an individual transformation upon a set of data;
- produce a data context based at least in part on the individual transformation;
- provide the transformed set of data as a transformation output;
- and
- provide the data context as a context output;
- providing reporting data to the pipeline orchestrator;
- receiving a data context from at least one of either the pipeline orchestrator or one of the plurality of activity actors;
- and
- providing the data context to at least one of either the pipeline orchestrator or one of the plurality of activity actors;
- wherein at least one data context receives data from a different data context or activity actor;
- and
- wherein at least one activity actor acts on a data context downstream of itself.
19 more elements
A system for management and tracking of collaborative projects employing a collaborative platform, comprising one or more computers with executable instructions that, when executed, cause the system to:
- create a directed computational graph comprising nodes representing data transformation activities and edges representing messaging between the nodes, and further comprising a plurality of paths between the nodes along edges, wherein:
- each path represents a transformation pipeline comprising a pipeline manager and one or more activity actors;
- each node in the directed computational graph stores information comprising one or more of the paths including information about a plurality of adjacent nodes;
- and
- at least one of the paths is a cyclical path which allows for solving of a problem requiring an iterative and recursive solution;
- cache a plurality of data contexts provided by a pipeline manager of at least one of the plurality of transformation pipelines;
- provide at least a portion of the plurality of data contexts to a pipeline manager of at least one of the plurality of transformation pipelines, wherein at least two transformation pipelines of the directed computational graph are configured to use different messaging protocols from one another;
- and
- create a plurality of activity actors that:
- receive at least a set of data as a transformation input;
- perform an individual transformation upon a set of data;
- produce a data context based at least in part on the individual transformation;
- provide the transformed set of data as a transformation output;
- and
- provide the data context as a context output;
- providing reporting data to the pipeline orchestrator;
- receive a data context from at least one of either the pipeline orchestrator or one of the plurality of activity actors;
- and
- provide the data context to at least one of either the pipeline orchestrator or one of the plurality of activity actors;
- wherein at least one data context receives data from a different data context or activity actor;
- and
- wherein at least one activity actor acts on a data context downstream of itself.
19 more elements
Non-transitory, computer-readable storage media having computer instructions embodied thereon that, when executed by one or more processors of a computing system employing a collaborative platform for management and tracking of collaborative projects, cause the computing system to:
- create a directed computational graph comprising nodes representing data transformation activities and edges representing messaging between the nodes, and further comprising a plurality of paths between the nodes along edges, wherein:
- each path represents a transformation pipeline comprising a pipeline manager and one or more activity actors;
- each node in the directed computational graph stores information comprising one or more of the paths including information about a plurality of adjacent nodes;
- and
- at least one of the paths is a cyclical path which allows for solving of a problem requiring an iterative and recursive solution;
- cache a plurality of data contexts provided by a pipeline manager of at least one of the plurality of transformation pipelines;
- provide at least a portion of the plurality of data contexts to a pipeline manager of at least one of the plurality of transformation pipelines, wherein at least two transformation pipelines of the directed computational graph are configured to use different messaging protocols from one another;
- and
- create a plurality of activity actors that:
- receive at least a set of data as a transformation input;
- perform an individual transformation upon a set of data;
- produce a data context based at least in part on the individual transformation;
- provide the transformed set of data as a transformation output;
- and
- provide the data context as a context output;
- providing reporting data to the pipeline orchestrator;
- receive a data context from at least one of either the pipeline orchestrator or one of the plurality of activity actors;
- and
- provide the data context to at least one of either the pipeline orchestrator or one of the plurality of activity actors;
- wherein at least one data context receives data from a different data context or activity actor;
- and
- wherein at least one activity actor acts on a data context downstream of itself.
19 more elements
Dependencies are inferred from the claim text.