Systems and methods for adaptive stitching of digital images

A computer implemented method of processing digital images associated with a parallax shift for creation of a digital panoramic image, comprising:

• computing a respective depth map storing values denoting distances to regions of a scene, for each camera of a plurality of cameras located at a respective first position;
• capturing a respective image by each of the plurality of cameras at the respective first position;
• virtually rotating each of the plurality of cameras to a plurality of respective second positions at a respective angle around the center point of the respective camera;
• wherein each respective angle is computed according to a certain region of a plurality of regions of the image relative to the center point of the respective camera;
• mapping between each respective region of the image associated with each respective second position and a corresponding region of the respective depth map computed for the respective camera;
• adjusting intensity values of pixels of the regions of each respective image captured by each camera of the plurality of cameras according to corresponding distance values of the mapped regions of the depth map of the respective camera, to create a plurality of adjusted images;
• and
• stitching the plurality of adjusted images to create a panoramic image;
• analyzing at least one area in proximity to each of the stitches of the plurality of adjusted images, wherein the at least one area is located within an overlapping region;
• computing a binocular disparity value for each feature point in each at least one area;
• identifying, for each stitch, the most frequent binocular disparity value for the at least one area of the respective stitch;
• computing, for each stitch, a radius value according to the most frequent binocular disparity value;
• wherein the mapping of regions of each image located within the at least one area in proximity to each of the stitches of each image is performed according to a projection sphere having the radius value associated with the respective stitch.

A system for processing digital images associated with a parallax shift for creation of a digital panoramic image, comprising:

• a non-transitory memory having stored thereon a code for execution by at least one hardware processor of a computing device, the code comprising:
• code for computing a respective depth map storing values denoting distances to regions of a scene, for each camera of a plurality of cameras located at a respective first position;
• code for capturing a respective image by each of the plurality of cameras at the respective first position;
• code for virtually rotating each of the plurality of cameras to a plurality of respective second positions at a respective angle around the center point of the respective camera,
• wherein each respective angle is computed according to a certain region of a plurality of regions of the image relative to the center point of the respective camera;
• code for mapping between each respective region of the image associated with each respective second position and a corresponding region of the respective depth map computed for the respective camera;
• code for adjusting intensity values of pixels of the regions of each respective image captured by each camera of the plurality of cameras according to corresponding distance values of the mapped regions of the depth map of the respective camera, to create a plurality of adjusted images;
• and
• code for stitching the plurality of adjusted images to create a panoramic image;
• wherein the mapping between regions associated with each respective second position to corresponding regions of the respective depth map is computed based on:
• computing a plurality of rays from a center of the respective camera at the first position that captured the image to corresponding regions of the depth map associated with the respective camera, wherein a length of each respective ray is obtained from the distance values of the corresponding region of the depth map;
• translating each of the plurality of rays from the center of the respective camera to a surface of a projection sphere centered at the center of the respective camera, wherein each of the plurality of rays is translated while maintaining the direction, orientation, and length of the respective ray such that each of the plurality of rays is tangent to the projection sphere;
• projecting the region at the distal end of each of the plurality of translated rays having the respective length to a corresponding region of the image captured by the respective camera;
• and
• adjusting the intensity value of at least one pixel of each region of the image captured by the respective camera according to the distance value of the projected region of the depth map of each of the plurality of translated rays.

A non-transitory computer program product for processing digital images associated with a parallax shift for creation of a digital panoramic image, comprising:

• a non-transitory memory having stored thereon a code for execution by at least one hardware processor of a computing device, the code comprising:
• instructions for computing a respective depth map storing values denoting distances to regions of a scene, for each camera of a plurality of cameras located at a respective first position;
• instructions for capturing a respective image by each of the plurality of cameras at the respective first position;
• instructions for virtually rotating each of the plurality of cameras to a plurality of respective second positions at a respective angle around the center point of the respective camera;
• instructions each respective angle is computed according to a certain region of a plurality of regions of the image relative to the center point of the respective camera;
• instructions for mapping between each respective region of the image associated with each respective second position and a corresponding region of the respective depth map computed for the respective camera;
• instructions for adjusting intensity values of pixels of the regions of each respective image captured by each camera of the plurality of cameras according to corresponding distance values of the mapped regions of the depth map of the respective camera, to create a plurality of adjusted images;
• and
• instructions for stitching the plurality of adjusted images to create a panoramic image;
• wherein the instructions for mapping between regions associated with each respective second position to corresponding regions of the respective depth map comprises instructions for:
• computing a plurality of rays from a center of the respective camera at the first position that captured the image to corresponding regions of the depth map associated with the respective camera, wherein a length of each respective ray is obtained from the distance values of the corresponding region of the depth map;
• translating each of the plurality of rays from the center of the respective camera to a surface of a projection sphere centered at the center of the respective camera, wherein each of the plurality of rays is translated while maintaining the direction, orientation, and length of the respective ray such that each of the plurality of rays is tangent to the projection sphere;
• projecting the region at the distal end of each of the plurality of translated rays having the respective length to a corresponding region of the image captured by the respective camera;
• and
• adjusting the intensity value of at least one pixel of each region of the image captured by the respective camera according to the distance value of the projected region of the depth map of each of the plurality of translated rays.