Text to screen video recorder

A computer system for automatically generating a computer screen recorded video based on a natural language query, comprising:

• one or more processors, one or more computer-readable memories, one or more computer-readable tangible storage devices, and program instructions stored on at least one of the one or more storage devices for execution by at least one of the one or more processors via at least one of the one or more memories, wherein the computer system is capable of performing operational steps comprising:
• based on receiving the natural language query:
• identifying, using a generative artificial intelligence (AI) model, a scenario based on an understanding of the received natural language query, wherein the identified scenario further comprises a determined scenario description;
• generating, using the generative artificial intelligence (AI) model, a feature file corresponding to the scenario identified by the generative AI model based on the received natural language query, wherein the generated feature file comprises step-by-step instructions and one or more computer elements required for performing the identified scenario based on feature documentation comprising one or more manuals and specifications;
• based on the generated feature file, automatically generating, using the generative AI model, computer code corresponding to each of the step-by-step instructions from the generated feature file;
• executing the generated computer code, wherein executing the generated code further comprises executing navigating and interacting with the one or more computer elements in a sequence according to the step-by-step instructions from the generated feature file;
• automatically recording as a video, using a screen recorder, the execution of the generated computer code, and storing the recorded video, wherein storing the recorded video further comprises linking the recorded video with the feature documentation, the identified scenario, and the natural language query, wherein the feature documentation is further linked with different scenarios and corresponding scenario descriptions;
• and
• providing the recorded video as output in response to the received natural language query.

A computer program product for automatically generating a computer screen recorded video based on a natural language query, comprising:

• one or more tangible computer-readable storage devices and program instructions stored on at least one of the one or more tangible computer-readable storage devices, the program instructions executable by a processor, the program instructions comprising:
• based on receiving the natural language query:
• identifying, using a generative artificial intelligence (AI) model, a scenario based on an understanding of the received natural language query, wherein the identified scenario further comprises a determined scenario description;
• generating, using the generative artificial intelligence (AI) model, a feature file corresponding to the scenario identified by the generative AI model based on the received natural language query, wherein the generated feature file comprises step-by-step instructions and one or more computer elements required for performing the identified scenario based on feature documentation comprising one or more manuals and specifications;
• based on the generated feature file, automatically generating, using the generative AI model, computer code corresponding to each of the step-by-step instructions from the generated feature file;
• executing the generated computer code, wherein executing the generated code further comprises executing navigating and interacting with the one or more computer elements in a sequence according to the step-by-step instructions from the generated feature file;
• automatically recording as a video, using a screen recorder, the execution of the generated computer code, and storing the recorded video, wherein storing the recorded video further comprises linking the recorded video with the feature documentation, the identified scenario, and the natural language query, wherein the feature documentation is further linked with different scenarios and corresponding scenario descriptions;
• and
• providing the recorded video as output in response to the received natural language query.