Approaches to multimedia editing using an artificial intelligence model and systems for accomplishing the same

A method for removing retakes of a transcript, the method comprising:

• receiving, from a client device, a first transcript that is representative of words spoken within an audio file from a client device,
• wherein the audio file includes a retake in which one or more words are spoken multiple times in succession, and therefore the first transcript includes a set of identical successive segments, the set of identical successive segments including a first segment that precedes a second segment;
• applying, to the first transcript, an artificial intelligence (AI) model that produces, as output, a second transcript in which the second segment is included while the first segment is excluded;
• beginning with a last word of the first transcript and the second transcript, iteratively comparing each word of the first transcript with a corresponding word of the second transcript;
• generating a set of indicators indicating the words of the first transcript that are absent from the second transcript;
• and
• causing the set of indicators to be presented on the client device.

A non-transitory, computer-readable storage medium storing instructions for editing a video, wherein the instructions when executed by at least one data processor of a system, cause the system to:

• acquire, from a client device, an input that includes (i) a first audiovisual file and (ii) a transcript that is representative of words spoken within the first audiovisual file;
• for each layout in a set of layouts, assign a score that is based on a degree of relevancy of that layout to a corresponding portion of the first audiovisual file;
• apply, to the first audiovisual file and the transcript, an artificial intelligence (AI) model that produces, as output, an identification of a set of scenes of the first audiovisual file,
• wherein each scene in the set of scenes is a portion of the first audiovisual file;
• for each portion of the first audiovisual file corresponding to a scene within the set of scenes, map a layout within the set of layouts to that portion based on the assigned score;
• generate a second audiovisual file including the mapped layouts of the set of scenes;
• and
• cause the second audiovisual file to be presented on the client device.

A system comprising:

• at least one hardware processor;
• and
• at least one non-transitory memory storing instructions, which, when executed by the at least one hardware processor, cause the system to:
• receive, from a client device, an input that includes (i) a first audiovisual file and (ii) a textual transcript that is representative of words spoken within the first audiovisual file;
• apply a first artificial intelligence (AI) model to generate a first set of clips of the audiovisual file by:
• supplying the first audiovisual file and the textual transcript into the first AI model, and
• receiving, from the first AI model, the first set of clips of the first audiovisual file,
• wherein each clip in the first set of clips is a portion of the first audiovisual file;
• apply a second AI model to generate a set of topics of the audiovisual file by:
• supplying the first audiovisual file and the textual transcript into the second AI model, and
• receiving, from the second AI model, the set of topics of the first audiovisual file,
• wherein each topic in the set of topics is associated with one or more portions of the first audiovisual file;
• for each topic of the set of topics, determine whether each clip of the first set of clips is representative of that topic;
• generate a second audiovisual file including a second set of clips of the first audiovisual file,
• wherein each clip within the second set of clips is representative of at least one topic of the set of topics;
• and
• present an indicator of the second audiovisual file on the client device.