Method and system for performing automatic schema-based data validation

A computing device configured to implement an execution of a method for performing automatic schema-based data validation, the computing device comprising:

• a processor;
• a memory;
• and
• a communication interface coupled to each of the processor and the memory, wherein the processor is configured to:
• receive a first dataset that comprises a plurality of entries, the first dataset is received from at least one data source;
• receive a second dataset that comprises a predefined set of instructions corresponding to a set of conformity standards for validation of the first dataset, wherein the set of conformity standards includes:
• number formats comprising integer and floating-point formats, Boolean formats, date formats including at least one of yyyy/mm/dd, yyyymmdd, and dd-MMM-yyyy;
• email validation formats, enumeration of strings specifying an allowed list of string values, and plain string formats;
• apply the predefined set of instructions to the received first dataset;
• validate each of the plurality of entries of the first dataset based on the application of the predefined set of instructions;
• generate a consolidated assessment report based on the validation;
• and
• display, using a display unit, the generated consolidated assessment report,
• wherein the received first dataset corresponds to a data file having a plurality of rows and columns, and wherein for the validation of the data file is performed at least in one of two levels, wherein:
• a first level of the two levels corresponds to the validation of the complete data file at a time;
• and
• a second level of the two levels corresponds to the validation of each of the plurality of rows and columns in a sequential manner, and
• wherein the processor is further configured to:
• parse the plurality of rows and columns into a plurality of segments, wherein each segment of the plurality of segments comprises at least one row and at least one column;
• and
• parallelly-validate the parsed plurality of segments.

A non-transitory computer-readable storage medium storing instruction performing automatic schema-based data validation, the storage medium comprising executable code which, when executed by a processor, causes the processor to:

• receive a first dataset that comprises a plurality of entries, the first dataset is received from at least one data source;
• receive a second dataset that comprises a predefined set of instructions corresponding to a set of conformity standards for validation of the first dataset, wherein the set of conformity standards includes:
• number formats comprising integer and floating-point formats, Boolean formats, date formats including at least one of yyyy/mm/dd, yyyymmdd, and dd-MMM-yyyy;
• email validation formats, enumeration of strings specifying an allowed list of string values, and plain string formats;
• apply the predefined set of instructions to the received first dataset;
• validate each of the plurality of entries of the first dataset based on the application of the predefined set of instructions;
• generate a consolidated assessment report based on the validation;
• and
• display, using a display unit, the generated consolidated assessment report,
• wherein the received first dataset corresponds to a data file having a plurality of rows and columns, and wherein for the validation of the data file is performed at least in one of two levels, wherein:
• a first level of the two levels corresponds to the validation of the complete data file at a time;
• and
• a second level of the two levels corresponds to the validation of each of the plurality of rows and columns in a sequential manner, and
• wherein the executable code which, when executed by the processor, causes the processor to:
• parse the plurality of rows and columns into a plurality of segments, wherein each segment of the plurality of segments comprises at least one row and at least one column;
• and
• parallelly-validate the parsed plurality of segments.