Heterogeneous schema discovery for unstructured data

A computer system, the computer system comprising:

• one or more processors, one or more computer-readable memories, one or more computer-readable tangible storage medium, and program instructions stored on at least one of the one or more computer-readable tangible storage medium for execution by at least one of the one or more processors via at least one of the one or more computer-readable memories, wherein the computer system is capable of performing a method comprising:
• automatically using a sidecar to collect schema discovery rules during conversion of raw data to the unstructured data, the schema discovery rules including conversion rules and conditions;
• automatically generating a plurality of schemas for different tenants using the collected schema discovery rules;
• automatically using extract transform load (ETL) to export the unstructured data to structured query language (SQL) databases with the generated plurality of schemas for the different tenants;
• automatically monitoring usage data of the SQL databases and collecting the usage data;
• and
• automatically optimizing schema discovery based on the collected usage data by identifying schemas with hot usage, and applying the identified schemas with hot usage to other tenants for further consumption and monitoring.

A computer program product, the computer program product comprising:

• one or more computer-readable tangible storage medium and program instructions stored on at least one of the one or more computer-readable tangible storage medium, the program instructions executable by a processor capable of performing a method, the method comprising:
• automatically using a sidecar to collect schema discovery rules during conversion of raw data to the unstructured data, the schema discovery rules including conversion rules and conditions;
• automatically generating a plurality of schemas for different tenants using the collected schema discovery rules;
• automatically using extract transform load (ETL) to export the unstructured data to structured query language (SQL) databases with the generated plurality of schemas for the different tenants;
• automatically monitoring usage data of the SQL databases and collecting the usage data;
• and
• automatically optimizing schema discovery based on the collected usage data by identifying schemas with hot usage, and applying the identified schemas with hot usage to other tenants for further consumption and monitoring.