Framework for testing and validating content generated by applications

A computer-implemented method comprising:

• receiving a test specification at a provider network, the test specification being originated by a client and specifying a content validation block to be used as part of validating content generated by an application of the provider network, the content validation block identifying one or more data fields and a corresponding one or more expected data values;
• identifying, based on the test specification, one or more services within the provider network;
• communicating with the one or more services to retrieve one or more artifacts generated by the application, wherein the artifacts are generated by the application based on performance of one or more actions;
• generating a validation result, the generating including comparing the one or more expected data values specified in the content validation block to a corresponding one or more actual data values obtained from the one or more artifacts;
• and
• providing the validation result to the client.

A system comprising:

• a test execution service implemented by a first one or more electronic devices of a provider network, the test execution service including instructions that upon execution cause the test execution service to receive a test specification at the provider network, the test specification being originated by a client and specifying a content validation block to be used as part of validating content generated by an application of the provider network, the content validation block identifying one or more data fields and a corresponding one or more expected data values;
• and
• a content validation service implemented by a second one or more electronic devices, the content validation service including instructions that upon execution cause the content validation service to:
• identify, based on the test specification, one or more services within the provider network;
• communicate with the one or more services to retrieve one or more artifacts generated by the application, wherein the artifacts are generated by the application based on performance of one or more actions;
• generate a validation result, including comparing the one or more expected data values specified in the content validation block to a corresponding one or more actual data values obtained from the one or more artifacts;
• and
• provide the validation result to the client.