Mapping components of a non-distributed environment to a distributed environment

A computer program product for mapping one or more components of a data pipeline from a non-distributed computing environment to a distributed computing environment, the computer program product comprising:

• one or more computer-readable storage devices and program instructions stored on at least one of the one or more tangible storage devices, the program instructions comprising:
• program instructions to identify at least one bottleneck component of one or more components comprising the data pipeline when implemented within the non-distributed computing environment, wherein identifying the at least one bottleneck component is based on a hybrid approach comprising a memory driven approach and a performance driven approach, wherein the memory driven approach uses top command and other memory commands to identify which components are taking a longest time to perform a task, wherein the performance driven approach utilizes system timing commands to identify statistics describing how long various functions take to perform, wherein the hybrid approach sets thresholds through parameters for each component to complete a task and such thresholds include a maximum memory available for a component within the pipeline and a maximum acceptable time for completion of a component within the data pipeline;
• program instructions to increase an input to the one or more components comprising the data pipeline;
• program instructions to determine that a performance of the at least one component is less than proportional to the increase of the input;
• program instructions to convert data corresponding to the at least one bottleneck component from a format compatible with the non-distributed computing environment to a format compatible with the distributed computing environment;
• program instructions to install libraries corresponding to an architecture of the distributed computing environment;
• and
• program instructions to convert code of the at least one bottleneck component from a format compatible with the non-distributed computing environment to a format compatible with the distributed computing environment.

A computer system for mapping one or more components of a data pipeline from a non-distributed computing environment to a distributed computing environment, the computer system comprising:

• one or more processors, one or more computer-readable memories, one or more computer-readable tangible storage devices, and program instructions stored on at least one of the one or more storage devices for execution by at least one of the one or more processors via at least one of the one or more memories, the program instructions comprising:
• program instructions to identify at least one bottleneck component of one or more components comprising the data pipeline when implemented within the non-distributed computing environment, wherein identifying the at least one bottleneck component is based on a hybrid approach comprising a memory driven approach and a performance driven approach, wherein the memory driven approach uses top command and other memory commands to identify which components are taking a longest time to perform a task, wherein the performance driven approach utilizes system timing commands to identify statistics describing how long various functions take to perform, wherein the hybrid approach sets thresholds through parameters for each component to complete a task and such thresholds include a maximum memory available for a component within the pipeline and a maximum acceptable time for completion of a component within the data pipeline;
• program instructions to increase an input to the one or more components comprising the data pipeline;
• program instructions to determine that a performance of the at least one component is less than proportional to the increase of the input;
• program instructions to convert data corresponding to the at least one bottleneck component from a format compatible with the non-distributed computing environment to a format compatible with the distributed computing environment;
• program instructions to install libraries corresponding to an architecture of the distributed computing environment;
• and
• program instructions to convert code of the at least one bottleneck component from a format compatible with the non-distributed computing environment to a format compatible with the distributed computing environment.