Brightness adjustment method, and apparatus thereof

A method of adjusting brightness of a foreground video displayed over a background on a display of a user device, the method comprising:

• capturing, by a camera, a background frame of the background;
• dividing, by at least one processor, the background frame of the background into a plurality of background sub-frames and a foreground video frame of the foreground video into a plurality of foreground sub-frames;
• determining an average brightness value of each foreground sub-frame of the plurality of foreground sub-frames and an average brightness value of each background sub-frame of the plurality of background sub-frames;
• clustering similar background sub-frames for forming a plurality of background sections based on the average brightness value of each background sub-frame;
• determining a luminance factor for each background sub-frame of the plurality of background sub-frames;
• determining an effective brightness value for each background section of the plurality of background sections based on the luminance factor and the average brightness value of each background sub-frame forming the background section;
• determining an enhancement factor for each background section of the plurality of background sections based on the effective brightness value of the background section and an average of the average brightness value of each foreground sub-frame corresponding to each background sub-frame forming the background section;
• generating an enhancement mask for each foreground sub-frame of the plurality of foreground sub-frames based on the enhancement factor for the background section corresponding to the foreground sub-frame;
• adjusting the average brightness value of each foreground sub-frame of the plurality of foreground sub-frames based on the corresponding enhancement mask for generating an enhanced foreground video frame;
• and
• displaying the enhanced foreground video frame over the background on the display of the user device.

A video enhancement server in communication with a user device, the video enhancement server being configured to receive a foreground video and a background from the user device, the video enhancement server comprising:

• a memory;
• and
• at least one processor configured to:
• divide a background frame of the background into a plurality of background sub-frames and a foreground video frame of the foreground video into a plurality of foreground sub-frames and to determine an average brightness value of each foreground sub-frame of the plurality of foreground sub-frames and an average brightness value of each background sub-frame of the plurality of background sub-frames,
• cluster similar background sub-frames to form a plurality of background sections,
• determine a luminance factor for each background sub-frame of the plurality of background sub-frames,
• determine an effective brightness value for each background section of the plurality of background sections based on the luminance factor and the average brightness value of each background sub-frame forming the background section,
• determine an enhancement factor for each background section of the plurality of background sections based on the effective brightness value of the background section and an average of the average brightness value of each foreground sub-frame corresponding to each background sub-frame forming the background section,
• generate an enhancement mask for each foreground sub-frame of the plurality of foreground sub-frames based on the enhancement factor for the background section corresponding to the foreground sub-frame, and
• adjust the average brightness value of each foreground sub-frame of the plurality of foreground sub-frames based on the corresponding enhancement mask to generate an enhanced foreground video frame.