Computer-aided parallelizing of computation graphs
AssigneeAb Initio Technology LLC
InventorCraig W. Stanfill
Life of this patent
Estimating the term…
Abstract
An approach to automatically specifying, or assisting with the specification of, a parallel computation graph involves determining data processing characteristics of the linking elements that couple data processing elements of the graph. The characteristics of the linking elements are determined according to the characteristics of the upstream and/or downstream data processing elements associated with the linking element, for example, to enable computation by the parallel computation graph that is equivalent to computation of an associated serial graph.
Claims12
-37. (canceled)
A method for processing data that is sorted according to a sort order in a computation graph, including:
- partitioning sorted data among a plurality of flows in the computation graph, the sorted data including work elements, each work element including a value, wherein the sorted data is sorted based on the values;
- and
- passing a sort value indicator on each of the plurality of flows, the sort value indicator including a value that was included in a work element passed on at least one of the plurality of flows;
- wherein the sort value indicator identifies a place in the sort order for the data such that subsequent data partitioned among the flows occurs no earlier than the identified place in the sort order.
A computer program, stored on a computer-readable medium, for processing data that is sorted according to a sort order in a computation graph, the computer program including instructions for causing a computer system to:
- partition sorted data among a plurality of flows in the computation graph, the sorted data including work elements, each work element including a value, wherein the sorted data is sorted based on the values;
- and
- pass a sort value indicator on each of the plurality of flows, the sort value indicator including a value that was included in a work element passed on at least one of the plurality of flows;
- wherein the sort value indicator identifies a place in the sort order for the data such that subsequent data partitioned among the flows occurs no earlier than the identified place in the sort order.
Dependencies are inferred from the claim text.