Automatic transformation of data by patterns

A method implemented at a computing system for automatic transformation data by patterns in response to receiving a source dataset and a target dataset, the method comprising:

• identifying a subset of the source dataset and a subset of the target dataset as related data;
• accessing a plurality of Transform-by-Pattern (TBP) programs, wherein each TBP program in the plurality of the TBP programs comprises a combination of (i) a source pattern, (ii) a target pattern, and (iii) a transformation program, wherein the transformation program is configured to transform data that fits into the target pattern into data that fits into the source pattern;
• identifying one or more of the TBP programs as being applicable to the subset of the source dataset and the subset of the target dataset, wherein:
• for each of the one or more TBP programs, (i) at least one data unit of the subset of the source dataset fits into the source pattern of the TBP program and (ii) at least one data unit of the subset of the target dataset fits into the target pattern of the TBP program,
• the one or more TBP programs are identified based on a determination that corresponding coverage scores for the one or more TBP programs are greater than a predetermined threshold, and the coverage scores indicate applicability rates for the one or more TBP programs and
• a first TBP program included among the one or more TBP programs is learned or generated based on telemetry data obtained in response to leverage of a query log, the telemetry data being associated with a particular type of task and being usable to learn or generate the first TBP program;
• and
• applying at least one of the one or more applicable TBP programs to the target dataset, wherein applying the at least one of the one or more applicable TBP programs to the target dataset includes:
• selecting one applicable TBP program;
• and
• using a transformation program of the selected one applicable TBP program to automatically transform the subset of the target dataset to transformed data, the transformed data comprising an integrated dataset comprising the source dataset and the transformed target dataset.

One or more hardware storage devices having stored thereon computer-executable instructions that are executable by one or more processors of a computing system to cause the computer system to perform the following in response to receiving a source dataset and a target dataset:

• identify a subset of the source dataset and a subset of the target dataset as related data;
• access a plurality of Transform-by-Pattern (TBP) programs, wherein each TBP program in the plurality of TBP programs comprises a combination of (i) a source pattern, (ii) a target pattern, and (iii) a transformation program, wherein the transformation program is configured to transform data that fits into the target pattern into data that fits into the source pattern;
• identify one or more of the TBP programs as being applicable to the subset of the source dataset and the subset of the target dataset, wherein:
• for each of the one or more TBP programs, (i) at least one data unit of the subset of the source dataset fits into the source pattern of the TBP program and (ii) at least one data unit of the subset of the target dataset fits into the target pattern of the TBP program,
• the one or more TBP programs are identified based on a determination that corresponding coverage scores for the one or more TBP programs are greater than a predetermined threshold, and the coverage scores indicate applicability rates for the one or more TBP programs, and
• a first TBP program included among the one or more TBP programs is learned or generated based on telemetry data obtained in response to leverage of a query log, the telemetry data being associated with a particular type of task and being usable to learn or generate the first TBP program;
• and
• apply at least one of the one or more applicable TBP programs to the target dataset, wherein applying the at least one of the one or more applicable TBP programs to the target dataset includes:
• selecting one applicable TBP program;
• and
• using a transformation program of the selected one applicable TBP program to automatically transform the subset of the target dataset to transformed data, the transformed data comprising an integrated dataset comprising the source dataset and the transformed target dataset.