Simplifying unstructured data for data analytics

A computer system, comprising:

• one or more processors;
• and
• one or more non-transitory computer-readable media storing computer-executable instructions that, when executed by the one or more processors, cause the one or more processors to perform operations comprising:
• receiving a first file composed of unstructured data with a first file format;
• applying one or more programmatic solutions for identifying one or more duplicate text in the first file format wherein the one or more duplicate text is associated with one or more attributes contained in unstructured data of the first file;
• identifying at least one duplicate text contained in the first file wherein duplicate text is associated with at least a first attribute of the unstructured data;
• in response to identifying at least one duplicate text contained in the first file format, applying a mechanism for modifying the at least one duplicate text in the first file format to change the first attribute of the unstructured data to a second attribute of a second file format wherein the first attribute is different from the second attribute;
• and
• converting the unstructured data of the first file into a second file of structured data of the second file format composed of the second attribute wherein the second file format is configured with a reduction in duplicate text associated with one or more attributes in a file format.

One or more non-transitory computer-readable media storing instructions executable by a processor, wherein the instructions, when executed by the processor, cause the processor to perform operations comprising:

• receiving a first file composed of unstructured data with a first file format;
• applying one or more programmatic solutions for identifying one or more duplicate text in the first file format wherein the one or more duplicate text is associated with one or more attributes contained in unstructured data of the first file;
• identifying at least one duplicate text contained in the first file wherein duplicate text is associated with at least a first attribute of the unstructured data;
• in response to identifying at least one duplicate text contained in the first file format, applying a mechanism for modifying the at least one duplicate text in the first file format to change the first attribute of the unstructured data to a second attribute of a second file format wherein the first attribute is different from the second attribute;
• and
• converting the unstructured data of the first file into a second file of structured data of the second file format composed of the second attribute wherein the second file format is configured with a reduction in duplicate text associated with one or more attributes in a file format.