Image processing method and apparatus, electronic device, and storage medium
AssigneeBeijing Sensetime Technology Development Co., Ltd.
InventorsDi Qiu, Jiahao Pang, Chengxi Yang, Wenxiu Sun
Life of this patent
Estimating the term…
Abstract
An image processing method and apparatus, an electronic device, and a storage medium are provided. The method includes: obtaining an infrared image and a color image for the same object in a predetermined scenario, and a first depth map corresponding to the color image; obtaining a first optical flow between the color image and the infrared image; and performing first optimization processing on the first depth map by using the first optical flow to obtain an optimized second depth map corresponding to the color image.
Claims20
An image processing method, comprising:
- obtaining an infrared image and a color image for a same object in a predetermined scenario, and a first depth map corresponding to the color image;
- obtaining a first optical flow between the color image and the infrared image;
- and
- performing first optimization processing on the first depth map by using the first optical flow to obtain an optimized second depth map corresponding to the color image,
- wherein obtaining the first optical flow between the color image and the infrared image comprises:
- inputting the color image and the infrared image to an optical flow estimation model, and obtaining a second optical flow between the color image and the infrared image by using the optical flow estimation model;
- and
- performing second optimization processing on the second optical flow based on the first depth map to obtain the first optical flow.
An image processing apparatus, comprising:
- a processor;
- and
- a memory configured to store processor-executable instructions;
- wherein the processor is configured to:
- obtain an infrared image and a color image for a same object in a predetermined scenario, and a first depth map corresponding to the color image;
- obtain a first optical flow between the color image and the infrared image;
- and
- perform first optimization processing on the first depth map by using the first optical flow to obtain an optimized second depth map corresponding to the color image,
- wherein obtaining the first optical flow between the color image and the infrared image comprises:
- inputting the color image and the infrared image to an optical flow estimation model, and obtaining a second optical flow between the color image and the infrared image by using the optical flow estimation model;
- and
- performing second optimization processing on the second optical flow based on the first depth map to obtain the first optical flow.
A non-transitory computer-readable storage medium, having computer program instructions stored thereon, wherein the computer program instructions, when being executed by a processor, enable the processor to implement the following operations:
- obtaining an infrared image and a color image for a same object in a predetermined scenario, and a first depth map corresponding to the color image;
- obtaining a first optical flow between the color image and the infrared image;
- and
- performing first optimization processing on the first depth map by using the first optical flow to obtain an optimized second depth map corresponding to the color image,
- wherein the operation of obtaining the first optical flow between the color image and the infrared image comprises:
- inputting the color image and the infrared image to an optical flow estimation model, and obtaining a second optical flow between the color image and the infrared image by using the optical flow estimation model;
- and
- performing second optimization processing on the second optical flow based on the first depth map to obtain the first optical flow.
Dependencies are inferred from the claim text.