Method and apparatus for performing electronic image stabilization with dynamic margin

An electronic image stabilization (EIS) apparatus comprising:

• a storage device, arranged to buffer a plurality of video frames derived from an output of an image sensor, wherein each of the plurality of video frames has a full field of view (FOV) of the image sensor;
• and
• a processing circuit, arranged to obtain motion information of the plurality of video frames, dynamically estimate EIS margins according to FOV variation of a plurality of cropped images that are within the plurality of video frames respectively, and apply stabilization correction to the plurality of cropped images according to the motion information and the EIS margins, to generate a plurality of stabilized images;
• wherein one of the plurality of video frames includes one of the plurality of cropped images and one of the EIS margins;
• within said one of the plurality of video frames, said one of the EIS margins is outside said one of the plurality of cropped images;
• and said one of the EIS margins is used by the stabilization correction applied to said one of the plurality of cropped images;
• and
• wherein the plurality of cropped images comprise cropped images with different FOVs, and the EIS margins that are dynamically estimated according to the FOV variation of the plurality of cropped images comprise EIS margins with different sizes for the cropped images with different FOVs.

A non-transitory machine-readable medium for storing a program code, wherein when loaded and executed by a processing circuit, the program code instructs the processing circuit to perform following steps:

• obtaining a plurality of video frames derived from an output of an image sensor, wherein each of the plurality of video frames has a full field of view (FOV) of the image sensor;
• obtaining motion information of the plurality of video frames;
• dynamically estimating EIS margins according to FOV variation of a plurality of cropped images that are within the plurality of video frames respectively;
• and
• applying stabilization correction to the plurality of cropped images according to the motion information and the EIS margins, to generate a plurality of stabilized images;
• wherein one of the plurality of video frames includes one of the plurality of cropped images and one of the EIS margins;
• within said one of the plurality of video frames, said one of the EIS margins is outside said one of the plurality of cropped images;
• and said one of the EIS margins is used by the stabilization correction applied to said one of the plurality of cropped images;
• and
• wherein the plurality of cropped images comprise cropped images with different FOVs, and the EIS margins that are dynamically estimated according to the FOV variation of the plurality of cropped images comprise EIS margins with different sizes for the cropped images with different FOVs.