Techniques for source-side metadata enrichment

An apparatus for data management, comprising:

• at least one processor;
• at least one memory coupled with the at least one processor;
• and
• instructions stored in the at least one memory and executable by the at least one processor to cause the apparatus to:
• receive, from a first application in a destination computing environment of a data management system, a set of enrichment definitions for metadata synchronization between the first application in the destination computing environment and a second application in a source computing environment of the data management system;
• generate a plurality of data records corresponding to metadata changes associated with the second application in the source computing environment;
• transform the plurality of data records based at least in part on using a plurality of data enrichment components to modify the plurality of data records according to the set of enrichment definitions provided by the first application in the destination computing environment, wherein the plurality of data enrichment components are dynamically partitioned into enrichment groups that execute in parallel;
• and
• transmit, via one or more data streams between the first application and the second application, at least a subset of the plurality of data records transformed by the plurality of data enrichment components.

A non-transitory computer-readable medium storing code for data management, the code comprising instructions executable by at least one processor to:

• receive, from a first application in a destination computing environment of a data management system, a set of enrichment definitions for metadata synchronization between the first application in the destination computing environment and a second application in a source computing environment of the data management system;
• generate a plurality of data records corresponding to metadata changes associated with the second application in the source computing environment;
• transform the plurality of data records based at least in part on using a plurality of data enrichment components to modify the plurality of data records according to the set of enrichment definitions provided by the first application in the destination computing environment, wherein the plurality of data enrichment components are dynamically partitioned into enrichment groups that execute in parallel;
• and
• transmit, via one or more data streams between the first application and the second application, at least a subset of the plurality of data records transformed by the plurality of data enrichment components.