Image stitching with electronic rolling shutter correction
AssigneeGoPro, Inc.
InventorsBruno César Douady-Pleven, Antoine Meler, Christophe Clienti
Life of this patent
Estimating the term…
Abstract
Systems and methods are disclosed for image signal processing. For example, methods may include receiving a first image from a first image sensor, receiving a second image from a second image sensor; obtaining corrected images based on the first image and the second image; obtaining stabilized images based on the corrected images; applying a parallax correction to the stabilized images to obtain a composite image; obtaining a transformed image from the composite image; and encoding an output image based on the transformed image.
Claims20
A system comprising:
- a first image sensor configured to detect a first image;
- a second image sensor configured to detect a second image;
- an angular rate sensor;
- and
- a processing apparatus that is configured to:
- obtain angular rate measurements from the angular rate sensor for a device including the first image sensor and the second image sensor for times during capture of the first image and the second image;
- determine an electronic rolling shutter correction based on the angular rate measurements and times when portions of the first image and the second image were captured using an electronic rolling shutter;
- obtain corrected images based on the first image and the second image, wherein the processing apparatus is configured to determine a near point for an initial epipolar line, and a compensated near point, wherein the compensated near point is determined based on the near point and electronic rolling shutter data associated with the near point;
- obtain stabilized images based on the corrected images;
- apply a parallax correction to the stabilized images to obtain a composite image;
- obtain a transformed image from the composite image;
- and
- encode an output image based on the transformed image.
A method comprising:
- detecting a first image;
- detecting a second image;
- obtaining angular rate measurements from an angular rate sensor for a device for times during capture of the first image and the second image;
- determining an electronic rolling shutter correction based on the angular rate measurements and times when portions of the first image and the second image were captured using an electronic rolling shutter;
- determining a near point for an initial epipolar line, and a compensated near point, wherein the compensated near point is determined based on the near point and electronic rolling shutter data associated with the near point, to obtain corrected images based on the first image and the second image;
- obtaining stabilized images based on the corrected images;
- applying a parallax correction to the stabilized images to obtain a composite image;
- obtaining a transformed image from the composite image;
- and
- encoding an output image based on the transformed image.
A non-transitory computer-readable medium comprising instructions, that when executed by a processor, cause the processor to perform operations comprising:
- detecting a first image;
- detecting a second image;
- obtaining angular rate measurements from an angular rate sensor for a device for times during capture of the first image and the second image;
- determining an electronic rolling shutter correction based on the angular rate measurements and times when portions of the first image and the second image were captured using an electronic rolling shutter;
- determining a near point for an initial epipolar line, and a compensated near point, wherein the compensated near point is determined based on the near point and electronic rolling shutter data associated with the near point, to obtain corrected images based on the first image and the second image;
- obtaining stabilized images based on the corrected images;
- applying a parallax correction to the stabilized images to obtain a composite image;
- obtaining a transformed image from the composite image;
- and
- encoding an output image based on the transformed image.
Dependencies are inferred from the claim text.