Systems and/or methods for computer-automated execution of digitized natural language video stream instructions

A computing platform, comprising:

• at least one data store;
• and
• processing resources including at least one processor and a memory, the processing resources being configured to run an operating system and execute instructions using the operating system;
• wherein the processing resources are configured to control the computing platform to at least:
• develop a script from audio provided in the video;
• extract text shown visually in frames of the video;
• identify simulated user interaction events present in the video;
• generate a timeline representation that includes entries for elements of the developed script, elements of the extracted text, and identified simulated user interaction events, wherein like elements of the developed script, elements of the extracted text, and/or identified simulated user interaction events are collected into common or linked entries in the timeline representation;
• convert entries in the timeline to corresponding user action command representations;
• map each user action command representation to a computing platform executable command, wherein elements of the developed script and/or elements of the extracted text are used as parameters for at least one of the corresponding user action command representations;
• and
• store, to the data store, an ordered listing of each computing platform executable command, the computing platform executable commands being executable at least in part in a computing environment, automatically and without user intervention.

A method of automating execution, on a computing platform, of digitized natural-language instructions provided in a video, the computing platform comprising processing resources including at least one processor and a memory, the method comprising:

• retrieving, from a data store, computing platform executable commands that have been stored thereto after:
• a script is developed from audio provided in the video;
• text shown visually in frames of the video is extracted;
• simulated user interaction events present in the video are identified;
• a timeline representation is generated, the timeline representation including entries for elements of the developed script, elements of the extracted text, and identified simulated user interaction events, wherein like elements of the developed script, elements of the extracted text, and/or identified simulated user interaction events are collected into common or linked entries in the timeline representation;
• entries in the timeline are converted to corresponding user action command representations;
• each user action command representation is mapped to a computing platform executable command, wherein elements of the developed script and/or elements of the extracted text are used as parameters for at least one of the corresponding user action command representations;
• and
• each computing platform executable command is stored to the data store, at least some of the computing platform executable commands being executable automatically and without user intervention;
• and
• attempting to execute the retrieved computing platform executable commands, automatically and without user intervention.