Method and system for preprocessing optimization of streaming video data using machine learning

A method of improving a main output of a main AI model processing first video data, the method comprising:

• analyzing incoming video data via a first processing pipeline that comprises:
• accessing incoming video data;
• preprocessing the incoming video data according to first preprocessing parameters, wherein the preprocessing includes formatting the incoming video data to create the first video data;
• accessing the first video data by the main AI model;
• processing the first video data by the main AI model to determine the main output that is indicative of a first inference dependent upon the first video data;
• analyzing incoming video data via a second processing pipeline that includes a machine learning model, the second processing pipeline comprising:
• accessing the incoming video data;
• identifying, by the machine learning model, first test preprocessing parameters that are predictive to result in a determination of a first test output that satisfies a baseline criterion, that include video edits to be performed on the incoming video data, and that include an order in which those video edits are to be performed on the incoming video data;
• preprocessing the incoming video data according to the first test preprocessing parameters, wherein the preprocessing includes formatting the incoming video data to create first test video data;
• accessing the first test video data by a test AI model;
• processing the first test video data by the test AI model to determine the first test output that is indicative of a first test inference dependent upon the first test video data;
• comparing the first test output to the baseline criterion;
• and
• in response to the first test output satisfying the baseline criterion:
• altering the first preprocessing parameters to be similar to the first test preprocessing parameters;
• and
• analyzing the incoming video data via the first processing pipeline using the altered first preprocessing parameters to improve the main output.