Identifying request-level critical paths in multi-phase parallel tasks
AssigneeLinkedIn Corporation
InventorsJiayu Gong, Xiaohui Long, Wing H. Li, Joel D. Young
Life of this patent
Estimating the term…
Abstract
The disclosed embodiments provide a system for processing data. During operation, the system obtains a set of latencies for a set of requests in a multi-phase parallel task. Next, the system includes the latencies in a graph-based representation of the multi-phase parallel task. The system then analyzes the graph-based representation to identify a set of high-latency paths in the multi-phase parallel task. Finally, the system uses the set of high-latency paths to output an execution profile for the multi-phase parallel task, wherein the execution profile includes a subset of the requests associated with the high-latency paths.
Claims20
A method, comprising;
- obtaining a set of latencies for a set of requests in a multi-phase parallel task;
- including the latencies in a graph-based representation of the multi-phase parallel task;
- analyzing, by a computer system, the graph-based representation to identify a set of high-latency paths in the multi-phase parallel task;
- and
- using the set of high-latency paths to output an execution profile for the multi-phase parallel task, wherein the execution profile comprises a subset of the requests associated with the high-latency paths.
An apparatus, comprising:
- one or more processors;
- and
- memory storing instructions that, when executed by the one or more processors, cause the apparatus to:
- obtain a set of latencies for a set of requests in a multi-phase parallel task;
- include the latencies in a graph-based representation of the multi-phase parallel task;
- analyze the graph-based representation to identify a set of high-latency paths in the multi-phase parallel task;
- and
- use the set of high-latency paths to output an execution profile for the multi-phase parallel task, wherein the execution profile comprises a subset of the requests associated with the high-latency paths.
A system, comprising:
- an analysis module comprising a non-transitory computer-readable medium comprising instructions that, when executed, cause the system to:
- obtain a set of latencies for a set of requests in a multi-phase parallel task;
- include the latencies in a graph-based representation of the multi-phase parallel task;
- analyze the graph-based representation to identify a set of high-latency paths in the multi-phase parallel task;
- and
- a management module comprising a non-transitory computer-readable medium comprising instructions that, when executed, cause the system to use the set of high-latency paths to output an execution profile for the multi-phase parallel task, wherein the execution profile comprises a subset of the requests associated with the high-latency paths.
Dependencies are inferred from the claim text.