Dirty lens image correction

A dirty lens correction system comprising:

• an electronic device including:
• a frame;
• and
• a first camera including a first lens and a second camera including a second lens supported by the frame, wherein the first camera has a first viewpoint and the second camera has a second viewpoint separated from the first viewpoint in a camera baseline direction;
• an image display;
• an image display driver coupled to the image display to control the image display;
• a memory;
• a processor coupled to the first camera, the second camera, the image display driver, and the memory;
• and
• programming in the memory, wherein execution of the programming b the processor configures the system to perform functions, including functions to:
• obtain a first raw pixel image of a scene captured with the first camera;
• obtain a second raw image of the scene captured with the second camera;
• rectify the first and second raw pixel images to create respective first and second rectified pixel images;
• determine disparity correspondence between corresponding image pixel pairs of the first and second rectified images in the camera baseline direction;
• map the first and second rectified images into the same domain using the determined disparity;
• detect image artifact regions within each domain mapped image by comparing corresponding regions of the domain mapped images;
• determine correction factors for each detected image artifact region;
• and
• correct the rectified first and second images by applying the determined correction factors;
• wherein the function to rectify the first and second raw pixel images applies:
• (xrectilinear,yrectilinear)=(rx*xRAW,ry*yRAW)
• where rx=f(x2RAW);
• and
• ry=f(y2RAW);
• wherein x is a pixel location in a horizontal direction and y is a pixel location in a vertical direction.

A dirty lens correction method comprising the steps of:

• obtaining a first raw pixel image of a scene captured with a first camera of an electronic device;
• obtaining a second raw image of the scene captured with the second camera of the electronic device, the second camera separated from the first camera in a camera baseline direction;
• rectifying the first and second raw pixel images to create respective first and second rectified pixel images;
• determining disparity correspondence between corresponding image pixel pairs of the first and second rectified images in the camera baseline direction by extracting rectified image disparity by correlating pixels in the first rectified image with the second rectified image for each of the correlated pixels, determining respective raw image pixel pair locations in the first and second raw pixel images corresponding to locations of the corresponding image pixel airs in the first and second rectified images, determining corrected disparity using the respective raw pixel pair locations, and replacing the rectified image disparity with the corrected disparity;
• mapping first and second rectified images into the same domain using the determined disparity;
• detecting image artifact regions within each domain mapped image by comparing corresponding regions of the domain mapped images;
• determining correction factors for each detected image artifact region;
• and
• correcting the rectified first and second images by applying the determined correction factors.

A dirty lens correction method comprising the steps of:

• obtaining a first raw pixel image of a scene captured with a first camera of an electronic device;
• obtaining a second raw image of the scene captured with the second camera of the electronic device, the second camera separated from the first camera in a camera baseline direction;
• rectifying the first and second raw pixel images to create respective first and second rectified pixel images;
• determining disparity correspondence between corresponding image pixel pairs of the first and second rectified images in the camera baseline direction;
• mapping first and second rectified images into the same domain using the determined disparity;
• detecting image artifact regions within each domain mapped image by comparing corresponding regions of the domain mapped images;
• determining correction factors for each detected image artifact region;
• and
• correcting the rectified first and second images by applying the determined correction factors;
• wherein the rectifying step applies:
• (xrectilinear,yrectilinear)=(rx*xRAW,ry*yRAW)
• where rx=f(x2RAW);
• and
• ry=f(y2RAW);
• wherein x is a pixel location in a horizontal direction and y is a pixel location in a vertical direction.