Back to results
US 11,113,831 B2Granted
Reducing textured IR patterns in stereoscopic depth sensor imaging
AssigneeSony Corporation
InventorAnders Grunnet-Jepsen
Life of this patent
Estimating the term…
Abstract
Systems, devices, and techniques related to removing infrared texture patterns used for depth sensors are discussed. Such techniques may include applying a color correction transform to raw input image data including a residual infrared texture pattern to generate output image data such that the output image data has a reduced IR texture pattern residual with respect to the raw input image data.
Claims20
A device comprising:
- an infrared (IR) projector configured to project an IR texture pattern onto a scene;
- an image sensor comprising a plurality of sub-pixels, the image sensor configured to generate raw input image data based on an image capture of the scene comprising a projection of the IR texture pattern, wherein the raw input image data comprises an IR texture pattern residual from the IR texture pattern received at the image sensor through at least some red, green, and blue color filter elements;
- a color filter array adjacent to the image sensor, the color filter array comprising red, green, and blue color filter elements, each of the red, green, and blue color filter elements corresponding to one of the plurality of sub-pixels, and the red, green, and blue color filter elements including the at least some red, green, and blue color filter elements;
- and
- an image signal processor coupled to the image sensor, the image signal processor configured to
- receive the raw input image data, and
- generate output image data by applying a color correction transform to the raw input image data or image data corresponding to the raw input image data, the color correction transform corrects the IR texture pattern residual in the output image data, and the output image data has a reduced IR texture pattern residual relative to the raw input image data.
4 more elements
A method for image processing comprising:
- receiving, with an electronic processor, raw input image data from an image sensor, the raw input image data comprising an infrared (IR) texture pattern residual from an IR texture pattern projected on a scene during an image capture of the scene, and the raw input image data comprises an IR texture pattern residual from the IR texture pattern received at the image sensor through at least some red, green, and blue color filter elements;
- generating, with the electronic processor, output image data by applying a color correction transform to the raw input image data or image data corresponding to the raw input image data, the color correction transform corrects the IR texture pattern residual in the output image data, and the output image data has a reduced IR texture pattern residual relative to the raw input image data;
- and
- providing, with the electronic processor, the output image data for display to a user or for use in computer vision processing,
- wherein the image sensor includes a plurality of sub-pixels and is adjacent to a color filter array comprising red, green, and blue color filter elements with each of the red, green, and blue color filter elements corresponding to one of the plurality of sub-pixels, and the red, green, and blue color filter elements including the at least some red, green, and blue color filter elements.
2 more elements
A non-transitory machine readable medium comprising a plurality of instructions that, when executed by an electronic processor, cause the electronic processor to perform a set of operations comprising:
- receiving raw input image data from an image sensor, the raw input image data comprising an infrared (IR) texture pattern residual from an IR texture pattern projected on a scene during an image capture of the scene, and the raw input image data comprises an IR texture pattern residual from the IR texture pattern received at the image sensor through at least some red, green, and blue color filter elements;
- generating output image data by applying a color correction transform to the raw input image data or image data corresponding to the raw input image data, the color correction transform corrects the IR texture pattern residual in the output image data, and the output image data has a reduced IR texture pattern residual relative to the raw input image data;
- and
- providing the output image data for display to a user or for use in computer vision processing,
- wherein the image sensor includes a plurality of sub-pixels and is adjacent to a color filter array comprising red, green, and blue color filter elements with each of the red, green, and blue color filter elements corresponding to one of the plurality of sub-pixels, and the red, green, and blue color filter elements including the at least some red, green, and blue color filter elements.
2 more elements
Dependencies are inferred from the claim text.