Merging split-pixel data for deeper depth of field

A system comprising:

• a processor;
• and
• a non-transitory computer-readable medium having stored thereon instructions that, when executed by the processor, cause the processor to perform operations comprising:
• obtaining split-pixel image data captured by a split-pixel camera, wherein the split-pixel image data comprises a first sub-image and a second sub-image;
• determining, for each respective pixel of a plurality of pixels of the split-pixel image data, a corresponding position of a scene feature represented by the respective pixel relative to a depth of field of the split-pixel camera;
• identifying, based on the corresponding position of the scene feature represented by each respective pixel of the plurality of pixels, one or more out-of-focus pixels of the plurality of pixels, wherein scene features represented by the one or more out-of-focus pixels are positioned outside of the depth of field;
• determining, for each respective out-of-focus pixel of the one or more out-of-focus pixels, a corresponding pixel value based on (i) the corresponding position of the scene feature represented by the respective out-of-focus pixel relative to the depth of field, (ii) a location of the respective out-of-focus pixel within the split-pixel image data, and (iii) at least one of:
• a first value of a corresponding first pixel in the first sub-image or a second value of a corresponding second pixel in the second sub-image;
• and
• generating, based on the corresponding pixel value determined for each respective out-of-focus pixel, an enhanced image having an extended depth of field.

A non-transitory computer-readable medium having stored thereon instructions that, when executed by a computing device, cause the computing device to perform operations comprising:

• obtaining split-pixel image data captured by a split-pixel camera, wherein the split-pixel image data comprises a first sub-image and a second sub-image;
• determining, for each respective pixel of a plurality of pixels of the split-pixel image data, a corresponding position of a scene feature represented by the respective pixel relative to a depth of field of the split-pixel camera;
• identifying, based on the corresponding position of the scene feature represented by each respective pixel of the plurality of pixels, one or more out-of-focus pixels of the plurality of pixels, wherein scene features represented by the one or more out-of-focus pixels are positioned outside of the depth of field;
• determining, for each respective out-of-focus pixel of the one or more out-of-focus pixels, a corresponding pixel value based on (i) the corresponding position of the scene feature represented by the respective out-of-focus pixel relative to the depth of field, (ii) a location of the respective out-of-focus pixel within the split-pixel image data, and (iii) at least one of:
• a first value of a corresponding first pixel in the first sub-image or a second value of a corresponding second pixel in the second sub-image;
• and
• generating, based on the corresponding pixel value determined for each respective out-of-focus pixel, an enhanced image having an extended depth of field.