Electrically tunable lens assisted absolute phase unwrapping
OwnerSong Zhang, Liming Cheninventors
Life of this patent
Estimating the term…
Abstract
Described herein are systems and methods for generating three-dimension point clouds. Phase-shifted images of a sample are captured using a camera. Fring contrast maps are generated based on the phase-shifted images. A label map is generated based on the fringe contrast maps. In-focus pixels are extracted from the phase-shifted images to generate a wrapped in-focus phase map. A rough depth map is generated based on the label map. An artificial phase map is generated based on the rough depth map. The wrapped in-focus phase map is unwrapped and a three-dimensional point cloud is generated based on the unwrapped in-focus phase map.
Claims20
A three-dimensional imaging microscope system, the system comprising:
- a projector;
- a camera;
- an electrically tunable lens (ETL);
- and
- a processor coupled to the projector, the camera, and the ETL, wherein the processor is configured to:
- capture, using the camera, a plurality of phase-shifted images of a sample by controlling the projector, the camera, and the ETL;
- generate a plurality of fringe contrast maps based on the plurality of phase-shifted images, wherein each fringe contrast map of the plurality of fringe contrast maps corresponds to a respective focus setting of a plurality of focus settings of the ETL;
- generate a label map based on the plurality of fringe contrast maps;
- extract a plurality of in-focus pixels from the plurality of phase-shifted images to generate a wrapped in-focus phase map;
- generate, based on the label map, a rough depth map indicating an estimated depth for each pixel of the plurality of in-focus pixels;
- generate, based on the rough depth map, an artificial phase map;
- unwrap the wrapped in-focus phase map to generate an unwrapped in-focus phase map;
- and
- generate a three-dimensional point cloud based on the unwrapped in-focus phase map.
A method, the method comprising:
- capturing, using a camera, a plurality of phase-shifted images of a sample by controlling a projector, a camera, and an electrically tunable lens (ETL) via a processor;
- generating a plurality of fringe contrast maps based on the plurality of phase-shifted images, wherein each fringe contrast map of the plurality of fringe contrast maps corresponds to a respective focus setting of a plurality of focus settings of the ETL;
- generating a label map based on the plurality of fringe contrast maps;
- extracting a plurality of in-focus pixels from the plurality of phase-shifted images to generate a wrapped in-focus phase map;
- generating, based on the label map, a rough depth map indicating an estimated depth for each pixel of the plurality of in-focus pixels;
- generating, based on the rough depth map, an artificial phase map;
- unwrapping the wrapped in-focus phase map to generate an unwrapped in-focus phase map;
- and
- generating a three-dimensional point cloud based on the unwrapped in-focus phase map.
A non-transitory computer readable medium storing instructions that, when executed, cause a processor to:
- capture, using a camera, a plurality of phase-shifted images of a sample by controlling a projector, a camera, and an electrically tunable lens (ETL) via the processor;
- generate a plurality of fringe contrast maps based on the plurality of phase-shifted images, wherein each fringe contrast map of the plurality of fringe contrast maps corresponds to respective focus setting of a plurality of focus settings of the ETL;
- generate a label map based on the plurality of fringe contrast maps;
- extract a plurality of in-focus pixels from the plurality of phase-shifted images to generate a wrapped in-focus phase map;
- generate, based on the label map, a rough depth map indicating an estimated depth for each pixel of the plurality of in-focus pixels;
- generate, based on the rough depth map, an artificial phase map;
- unwrap the wrapped in-focus phase map to generate an unwrapped in-focus phase map;
- and
- generate a three-dimensional point cloud based on the unwrapped in-focus phase map.
Dependencies are inferred from the claim text.