Diffusion bridge framework for cloud removal in satellite imagery
AssigneeMitsubishi Electric Research Laboratories, Inc.
InventorsSuhas Lohit, Yuyang Hu, Tim Marks
Life of this patent
Estimating the term…
Loading patent…
AssigneeMitsubishi Electric Research Laboratories, Inc.
InventorsSuhas Lohit, Yuyang Hu, Tim Marks
Estimating the term…
A system and method for generating a cloud-free optical satellite image from a cloudy optical satellite image using a diffusion bridge (DB) framework that includes iteratively applying a reverse diffusion bridge process, such that each iteration progressively refines the input image by reducing cloud-induced noise while preserving structural and spectral details. The diffusion bridge framework models a deterministic transition from the cloudy image distribution to the target cloud-free image distribution. The system may further incorporate Synthetic Aperture Radar (SAR) imagery to guide the structural recovery process, using a two-branch multimodal architecture comprising an optical image restoration branch and a SAR feature extraction branch. The branches are interconnected through SAR Fusion Blocks (SFBlocks), which employ cross-attention mechanisms to align and merge structural information from SAR images with spectral details from optical images. This multimodal diffusion bridge framework improves cloud removal accuracy, reduces artifacts, and maintains computational efficiency.
A method for generating a cloud-free optical satellite image from a cloudy optical satellite image, wherein the method uses a processor coupled with stored instructions implementing the method, wherein the instructions, when executed by the processor carry out steps of the method, comprising:
A system for generating a cloud-free optical satellite image from a cloudy optical satellite image, the system comprising:
Dependencies are inferred from the claim text.