Management of diverse data analytics frameworks in computing systems

A computing system that includes one or more processors providing a Data Analytics Engine Manager that manages data analytics of the first data analytics platform and a second data analytics platform, wherein the Data Analytics Engine Manager:

• operates on multiple data analytics platforms that vary from each other with respect to at least one criterion wherein the multiple data analytics platforms include a first data analytics platform and a second data analytics platform;
• obtains multiple engine definitions of multiple data analytics engines, including a first obtained data analytics engine definition and a second obtained analytics engine definition, wherein the first data analytics engine definition includes one or more Application Program Interfaces that define a first data analytics engine designated to perform data analytics on the first data analytics platform, wherein the one or more Application Program Interfaces include one or more declarative application program interfaces each defining multiple resources, wherein the multiple defined resources include:
• (i) one or more job definitions defining one or more executable jobs that are supported by the first data analytics engine, (ii) one or more artifact definitions including a description of the properties supported by the first data analytics engine and one or more associated validation requirements of the first data analytics engine, (iii) one or more runner definitions executing the job definitions supported by the first data analytics engine, and (iv) one or more runner containers supporting the execution of the job definitions by the one or more runner definitions, and wherein the second data analytics data definition is a definition of a second data analytics engine designated to perform data analytics on the second data analytics platform;
• generates, based on the obtained first data analytics engine, a version of the first data analytics engine for the first data analytics platform as a first pluggable engine, wherein the generating of the version of the first data analytics engine for the first data analytics platform further comprises:
• generating the version of the first data analytics engine, at least in part, based on the following:
• (a) one or more runner definitions, (b) one or more runner containers, (c) one or more job definitions, and (d) one or more artifact definitions, wherein the first data analytics engine includes at least one runner resource manager and at least one runner resource component, wherein the at least one runner resource component is provided as an abstraction of an execution unit of the first data analytics engine of the first pluggable engine and further defines a data analytic environment, including one or more jobs that the data analytics environment supports, and wherein the at least one runner resource manager at least:
• (i) dynamically registers and unregisters at least one other runner definition, and (ii) manages execution of the one or more runner definitions and the at least one other runner definition;
• and
• plugs the generated first pluggable data analytics engine into the first data analytics platform, wherein the first pluggable data analytics engine thereafter performs one or more data analytics operations.

A non-transitory computer readable storage medium storing at least executable computer code for managing a data analytics environment that includes multiple data analytics platforms, wherein the multiple data analytics platforms include a first data analytics platform and a second data analytics platform that differ from each other with respect to at least one criterion, wherein the executable computer code includes:

• providing a data analytics engine manager, wherein the data analytics manager manages data analytics of the first data analytics platform and the second data analytics platform;
• obtaining a first data analytics engine definition that is a definition of a first data analytics engine designated to perform data analytics on the first data analytics platform of the multiple data analytics platforms, the first data analytics engine definition including one or more Application Program Interfaces that define the first data analytics engine, wherein the one or more Application Program Interfaces include one or more declarative application program interfaces each defining multiple resources, wherein the multiple defined resources include:
• (i) one or more job definitions defining one or more executable jobs that are supported by the first data analytics engine, (ii) one or more artifact definitions including a description of the properties supported by the first data analytics engine and one or more associated validation requirements of the first data analytics engine, (iii) one or more runner definitions executing the job definitions supported by the first data analytics engine, and (iv) one or more runner containers supporting the execution of the job definitions by the one or more runner definitions;
• generating, based on the obtained first definition engine, a version of the first data analytics engine for the first data analytics platform, wherein the generating generates the version of the first data analytics engine, at least in part, based on the following:
• (a) one or more runner definitions, (b) one or more runner containers, (c) one or more job definitions, and (d) one or more artifact definitions, wherein the first data analytics engine includes at least one runner resource manager and at least one runner resource component, wherein the at least one runner resource component is provided as an abstraction of an execution unit of the first data analytics engine of the first pluggable engine and further defines a data analytic environment, including one or more jobs that the data analytics environment supports, and wherein the at least one runner resource manager at least:
• (i) dynamically registers and unregisters at least one other runner definition, and (ii) manages execution of the one or more runner definitions and the at least one other runner definition;
• plugging, by the data analytics engine manager, the generated first pluggable data analytics engine into the first data analytics platform;
• and
• thereafter performing, by the generated first pluggable data analytics engine, one or more data analytics operations.