System and method for machine learning-based brand advertising rate calculation in a video

A method for performing brand detection and brand analysis on a video, the method comprising:

• receiving by a video splitter the video for performing the brand detection;
• splitting, via the video splitter, the video to obtain a plurality of video frames;
• providing the plurality of video frames to a brand detector for performing an open set detection on each input video frame from the plurality of video frames to compute instances of detecting brand media in each video frame of the plurality of video frames;
• determining by a semantic-segmentation model a square region in which the brand media is occupied within the input video frame;
• resolving by the semantic segmentation model a scene understanding task in the input video frame;
• detecting by a video action recognition module in the video one or more crucial moments and providing an objective crucial moment rating for each input video frame of the plurality of video frames without performing any brand detection operation thereon;
• identifying by the video action recognition module an area on the input frame where a user's attention is focused to provide a user-focus index for each input video frame of the plurality of video frames when viewed on a screen without performing any brand detection operation thereon;
• generating by a brand-appearance computing unit a plurality of heat maps using inputs from the video action-recognition module;
• and
• combining, by the brand-appearance computing unit, inputs from the brand detector and the semantic-segmentation model into at least one of the heat maps using all the input video frames of the plurality of video frames and computing a brand advertising rate, wherein the inputs comprise, for each input video frame of the plurality of video frames, a location of brand media appearance on the input video frame, a duration of brand media appearance on the input video frame, and at least one of parameters:
• the user focus index for the video frame, or the crucial-moment rating for the input video frame.