Predicting video edits from text-based conversations using neural networks

A non-transitory computer-readable storage medium storing executable instructions, which when executed by a processing device, cause the processing device to perform operations comprising:

• receiving an input including a video sequence and text sentences, the text sentences describing a modification to the video sequence;
• mapping, by a first neural network, content of the text sentences describing the modification to the video sequence to a candidate video editing operation;
• processing, by a second neural network, the video sequence to predict parameter values for the candidate video editing operation;
• and
• generating a modified video sequence by applying the candidate video editing operation with the predicted parameter values to the video sequence.

A system comprising:

• a memory component;
• and
• a processing device coupled to the memory component, the processing device to perform operations comprising:
• receiving an input including a video sequence and text sentences, the text sentences describing a modification to the video sequence;
• mapping, by a first neural network, content of the text sentences describing the modification to the video sequence to a candidate video editing operation;
• processing, by a second neural network, the video sequence to predict parameter values for the candidate video editing operation;
• and
• generating a modified video sequence by applying the candidate video editing operation with the predicted parameter values to the video sequence.