Systems and methods for score and screenplay based audio and video editing

A method for generating a video file, the method comprising:

• reading a reference file comprising text;
• identifying a plurality of script elements of the text, wherein each script element comprises natural language for a setting description, an action description, or dialogue;
• associating each script element with an identification of whether that script element is a description or is dialogue;
• reading a plurality of videos;
• for each script element of the plurality of script elements, based on the natural language of that script element, identifying a corresponding segment of a video of the plurality of videos;
• displaying the text to a user;
• receiving, from the user, first selections of a script element of the plurality of script elements;
• for each of the first selections, displaying to the user a listing of the videos comprising a representation of that first selection;
• for each of the first selections, receiving a second selection from the user of a video from the listing thereby linking the selected script element to the corresponding segment of the selected video;
• and
• automatically generating a video file by splicing together each of the linked segments.

A system comprising:

• a computing node comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a processor of the computing node to cause the processor to perform a method comprising:
• reading a reference file comprising text;
• identifying a plurality of script elements of the text, wherein each script element comprises natural language for a setting description, an action description, or dialogue;
• associating each script element with an identification of whether that script element is a description or is dialogue;
• reading a plurality of videos;
• for each script element of the plurality of script elements, based on the natural language of that script element, identifying a corresponding segment of a video of the plurality of videos;
• displaying the text to a user;
• receiving, from the user, first selections of a script element of the plurality of script elements;
• for each of the first selections, displaying to the user a listing of the videos comprising a representation of that first selection;
• for each of the first selections, receiving a second selection from the user of a video from the listing thereby linking the selected script element to the corresponding segment of the selected video;
• and
• automatically generating a video file by splicing together each of the linked segments.

A computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable to perform a method comprising:

• reading a reference file comprising text;
• identifying a plurality of script elements of the text, wherein each script element comprises natural language for a setting description, an action description, or dialogue;
• associating each script element with an identification of whether that script element is a description or is dialogue;
• reading a plurality of videos;
• for each script element of the plurality of script elements, based on the natural language of that script element, identifying a corresponding segment of a video of the plurality of videos;
• displaying the text to a user;
• receiving, from the user, first selections of a script element of the plurality of script elements;
• for each of the first selections, displaying to the user a listing of the videos comprising a representation of that first selection;
• for each of the first selections, receiving a second selection from the user of a video from the listing thereby linking the selected script element to the corresponding segment of the selected video;
• and
• automatically generating a video file by splicing together each of the linked segments.