Back to results
US 2022/0021888 A1Published application
Systems and methods to encode regions-of-interest based on video content detection
AssigneeAlibaba Group Holding Limited
InventorsMinghai QIN, Yen-kuang CHEN, Tae Meon BAE, Guanlin WU, Yuanwei FANG, Sicheng LI
Life of this patent
Estimating the term…
Abstract
Video coding techniques including variable bitrate encoding based on regions-of-interest (ROIs) and the type of the video content, the type of sets of frames of the video content, the type of scenes of the video content, or the like.
Claims21
A video processing unit comprising:
- a content detection engine configured to receive input video content and to determine a content genre of the input video content or content genre of one or more portions of the input video content;
- a region-of-interest (ROI) generator configured to receive an indication of the content genre of the input video content or one or more portions of the input video content and to select one or more predetermined regions of corresponding video frames of the input video content or one or more portions of the input video content as one or more ROIs based on the content genre of the input video content or content genre of the one or more portions of the input video content;
- a rate controller configured to receive the one or more ROIs and to determine a first encoder rate for the one or more ROIs and a second encoder rate for one or more non-ROIs of the corresponding video frames;
- and
- a video encoder configured to receive the input video content, the one or more ROIs and the one or more non-ROIs, and the first and second encoder rates, and to generate a compressed bit stream of the input video content using the first encoder rate for the one or more ROIs and the second encoder rate for the one or more non-ROIs.
2 more elements
A video processing unit comprising:
- a content detection engine including,
- a frame sampler configured to sample sets of frames or scenes of input video content;
- and
- a scene classifier configured to determine a content genre of each set of frames or each scene;
- a region-of-interest (ROI) generator configured to receive an indication of the content genre of each set of frames or each scene of the input video content and to select one or more predetermined regions of a corresponding video frame as one or more ROIs based on the determined content genre;
- and
- a rate controller configured to receive indications of the one or more ROIs and to determine a first encoder rate for the one or more ROIs and a second encoder rate for one or more non-ROIs.
4 more elements
A method of video processing comprising:
- detecting a content genre of a given portion of video content;
- generating one or more regions-of-interest (ROIs) for the given portion of the video content based on the content genre of the given portion of the video content;
- determining a first encoding rate for the one or more ROIs and a second encoding rate for one or more non-ROIs of the given portion of the video content;
- and
- encoding the one or more ROIs at the first encoding rate and the one or more non-ROIs at the second encoding rate of the given portion of the video content to generate a compressed bitstream.
2 more elements
Dependencies are inferred from the claim text.