Trans-spectral feature detection for volumetric image alignment and colorization
AssigneesSony Group Corporation, Sony Pictures Entertainment Inc.
InventorsTobias Anderberg, Scott Metzger
Life of this patent
Estimating the term…
Abstract
Aligning and coloring a volumetric image, including: capturing intensity data using at least one scanner; generating an intensity image using the intensity data, wherein the intensity image includes at least one feature in a scene, the at least one feature including a sample feature; capturing image data using at least one camera, wherein the image data includes color information; generating a camera image using the image data, wherein the camera image includes the sample feature; matching the sample feature in the intensity image with the sample feature in the camera image to align the intensity image and the camera image; and generating a color image by applying the color information to the aligned intensity image.
Claims10
A non-transitory computer-readable storage medium storing a computer program to align and color a volumetric image, the computer program comprising executable instructions that cause a computer to:
- receive a 2-D color image and a 2-D intensity image;
- convert the 2-D color image to a 2-D grayscale image;
- perform a shape detection on the 2-D grayscale image and the 2-D intensity image to produce detected shapes;
- perform a feature detection on the detected shapes to find matching shape points in the 2-D grayscale image and the 2-D intensity image;
- calculate a phase correlation between the 2-D grayscale image and the 2-D intensity image;
- transform the 2-D color image using the phase correlation to produce a correlated 2-D color image which has same orientation as the 2-D intensity image;
- perform an initial image alignment including pre-processing for edges to produce a result;
- perform finer feature detection based on the initial image alignment including feeding the result into a line detection processing to produce matched features;
- extract matching feature points from the matched features;
- calculate a final image transform using the matching shape points, the phase correlation, and the extracted matching feature points;
- and
- align the 2-D color image to the 2-D intensity image using the final image transform.
Dependencies are inferred from the claim text.