Design-time information based on run-time artifacts in a distributed computing cluster
AssigneeCloudera, Inc.
InventorsVikas Singh, Sudhanshu Arora, Philip Zeyliger, Marcelo Masiero Vanzin, Chang She
Life of this patent
Estimating the term…
Loading patent…
AssigneeCloudera, Inc.
InventorsVikas Singh, Sudhanshu Arora, Philip Zeyliger, Marcelo Masiero Vanzin, Chang She
Estimating the term…
Techniques are disclosed for inferring design-time information based on run-time artifacts generated by services operating in a distributed computing cluster. In an embodiment, a metadata system extracts metadata including run-time artifacts generated by services in a distributed computing cluster while processing a workflow including multiple jobs. The extracted metadata is processed to identify entities and entity relationships which can then be used to generate lineage information. Using the lineage information, the metadata system can infer design-time information associated with the workflow. The inferred design-time information can then be utilized to, for example, recreate the workflow, recreate previous versions of the workflow, optimize the workflow, etc.
A method comprising:
A non-transitory computer readable medium storing instructions, execution of which by a computer system, cause the computer system to:
A computer system comprising:
Dependencies are inferred from the claim text.