Sensor prioritization for composite image capture
AssigneeGoPro, Inc.
InventorsSylvain Leroy, Guillaume Matthieu Guerin, Yoël Taïeb
Life of this patent
Estimating the term…
Abstract
Systems and methods are disclosed for sensor prioritization for composite image capture. For example, methods may include selecting an image sensor as a prioritized sensor from among an array of two or more image sensors; determining one or more image processing parameters based on one or more images captured using the prioritized sensor; applying image processing using the one or more image processing parameters to images captured with each image sensor in the array of two or more image sensors to obtain respective processed images for the array of two or more image sensors; and stitching the respective processed images for the array of two or more image sensors to obtain a composite image.
Claims20
A system comprising:
- an array of two or more image sensors configured to capture images;
- and
- a processing apparatus that is configured to:
- select an image sensor as a prioritized sensor from among the array of two or more image sensors, wherein the array of two or more image sensors have different respective fields of view that jointly provide a larger combined field of view;
- access one or more images captured using the prioritized sensor;
- determine one or more image processing parameters based on the one or more images captured using the prioritized sensor, wherein the one or more image processing parameters include at least one of an auto exposure algorithm parameter, an auto white balance algorithm parameter, or a global tone mapping algorithm parameter;
- access a second image captured using a second image sensor of the array of two or more image sensors, wherein the second image sensor is other than the prioritized sensor;
- and
- apply image processing using the one or more image processing parameters to the second image to obtain a processed image.
A method comprising:
- selecting an image sensor as a prioritized sensor from among an array of two or more image sensors, wherein the array of two or more image sensors have different respective fields of view that jointly provide a larger combined field of view;
- determining one or more image processing parameters based on one or more images captured using the prioritized sensor, wherein the one or more image processing parameters include at least one of an auto exposure algorithm parameter, an auto white balance algorithm parameter, or a global tone mapping algorithm parameter;
- applying image processing using the one or more image processing parameters to images captured with each image sensor in the array of two or more image sensors to obtain respective processed images for the array of two or more image sensors;
- and
- stitching the respective processed images for the array of two or more image sensors to obtain a composite image.
An image capture device, comprising:
- a first image sensor configured to capture images;
- a second image sensor configured to capture images;
- a memory that stores instructions for producing spherical images based on images captured using the first image sensor and the second image sensor;
- and
- a processor that executes the instructions to:
- select, from among the first image sensor and the second image sensor, an image sensor as a prioritized sensor and an other image sensor as a deprioritized sensor;
- determine an average global luminance value for a spherical image to be produced using a first image captured using the first image sensor and a second image captured using the second image sensor, wherein the average global luminance value is determined as a weighted average using weights determined based on the selection of the prioritized sensor to weight pixel values captured using the prioritized sensor more heavily than pixel values captured using the deprioritized sensor;
- determine luminance values for each of the first image and the second image;
- determine delta luminance values for each of the first image and the second image based on the average global luminance value and the luminance values;
- update the first image and the second image using the delta luminance values;
- and
- produce the spherical image based on the updated first image and the updated second image.
Dependencies are inferred from the claim text.