Injection method of monitoring and controlling task execution in a distributed computer system
AssigneeInternational Business Machines Corporation
InventorsPeng Hui Jiang, Rongsong Shen, Hang Xiao, Jian Feng Zhang
Life of this patent
Estimating the term…
Abstract
An injection system and method for monitoring and controlling task execution in a distributed computer system. The distributed computing environment is comprised of a plurality of computing nodes for executing an application, wherein the application is divided into tasks that are executed within containers on each of the nodes, and the tasks process vectors comprised of one or more data elements. A control plug-in injected into a specified container for execution with the tasks, wherein the control plug-in profiles footprint information for a targeted vector operated on by the tasks executed within the specified container.
Claims19
A system, comprising:
- a distributed computing environment comprised of a plurality of computing nodes for executing an application, wherein the application is divided into a plurality of tasks that are executed within one or more containers on each of the computing nodes, and each of the tasks process sectors comprised of one or more data elements;
- a control plug-in injected into the containers for execution with the tasks that are executed within the containers, wherein the execution and operation of the control plug-in within the containers is transparent to the tasks executed within the containers and the control plug-in profiles footprint information for one or more vectors processed by the tasks executed within the containers;
- and
- a monitor system for collecting the footprint information from the control plug-in executed within the containers to monitor the tasks' processing of the vectors, wherein the monitor system detects problems using the footprint information and then sends instructions to the control plug-in to adjust the execution of the tasks or containers,
- wherein the footprint information includes one or more of:
- vectors being operated on, iterating vector depth, vector length, vector invocation count, and vector processing time.
A method, comprising:
- executing an application in a distributed computing environment comprised of a plurality of computing nodes, wherein the application is divided into a plurality of tasks that are executed within one or more containers on each of the computing nodes, and each of the tasks process vectors comprised of one or more data elements;
- injecting a control plug-in into the containers for execution with the tasks that are executed within the containers, wherein the execution and operation of the control plug-in within the containers is transparent to the tasks executed within the containers and the control plug-in profiles footprint information for one or more vectors processed by the tasks executed within the containers;
- and
- executing a monitor system for collecting the footprint information from the control plug-in executed within the containers to monitor the tasks' processing of the vectors, wherein the monitor system detects problems using the footprint information and then sends instructions to the control plug-in to adjust the execution of the tasks or containers,
- wherein the footprint information includes one or more of:
- sectors being operated on, iterating vector depth, vector length, vector invocation count, and vector processing time.
A computer program product, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a processor to cause the processor to:
- execute an application in a distributed computing environment comprised of a plurality of computing nodes, wherein the application is divided into a plurality of tasks that are executed within one or more containers on each of the computing nodes, and each of the tasks process vectors comprised of one or more data elements;
- inject a control plug-in into the containers for execution with the tasks that are executed within the containers, wherein the execution and operation of the control plug-in within the containers is transparent to the tasks executed within the containers and the control plug-in profiles footprint information for one or more vectors operated on by the tasks executed within the containers;
- and
- execute a monitor system for collecting the footprint information from the control plug-in executed within the containers to monitor the tasks' processing of the vectors, wherein the monitor system detects problems using the footprint information and then sends instructions to the control plug-in to adjust the execution of the tasks or containers,
- wherein the footprint information includes one or more of:
- vectors being operated on, iterating vector depth, vector length, vector invocation count, and vector processing time.
Dependencies are inferred from the claim text.