Fully automated post-production editing for movies, tv shows and multimedia contents

A system for producing a multimedia digital content, comprising:

• a production subsystem configured to:
• receive one or more machine-readable scripts, wherein the one or more machine-readable scripts comprise information about one or more scenes in a storyline, wherein the information comprises editing instructions for an individual scene of the one or more scenes;
• produce multiple streams of the multimedia digital content using a set of production devices based on the one or more machine-readable scripts;
• and
• a post-production editing subsystem that is synchronized with the set of production devices in the production subsystem, wherein the post-production editing subsystem is configured to:
• receive the multiple streams of the multimedia digital content and the one or more machine-readable scripts from the production subsystem,
• detect an audio or video feature in the multiple streams of the multimedia digital content based on one or more machine learning techniques,
• identify a change of the audio or video feature by comparing the detected audio or video feature with a set of predefined features indicated in the one or more machine-readable scripts, wherein the comparing comprises feature matching between the audio or video feature with preloaded reference information, wherein the preloaded reference information comprises at least an image of a facial expression of an actor or an actress or an audio sample;
• and
• selectively edit the multiple streams of the multimedia digital content based on the identified change,
• wherein the post-production editing subsystem is further configured to:
• determine, based on the one or more machine-readable scripts, whether the identified change of the audio or video feature is a candidate for one or more editing operations for the multiple streams of the multimedia digital content.

A method for operating a post-production editing service, comprising:

• receiving, by the post-production editing service, one or more machine-readable scripts that comprise information about one or more scenes in a storyline, wherein the information comprises editing instructions for an individual scene of the one or more scenes, and wherein the one or more machine-readable scripts further comprise information indicating a location of preloaded reference information related to a set of predefined features;
• receiving, by the post-production editing service, multimedia content data corresponding to the one or more scenes in the storyline from one or more production devices;
• detecting, by the post-production editing service, an audio or video feature in the multimedia content data based on one or more machine learning techniques;
• identifying a change of the audio or video feature by comparing the detected audio or video feature with the set of predefined features indicated in the one or more machine-readable scripts, wherein the comparing comprises feature matching between the audio or video feature with the preloaded reference information that comprises at least an image of a facial expression of an actor or an actress or an audio sample;
• and
• selectively editing the multimedia content data based on the identified change.