Method and apparatus to complement depth image
AssigneeSamsung Electronics Co., Ltd.
InventorsZhaohui LV, Weijia ZHANG, Mingming FAN
Life of this patent
Estimating the term…
Abstract
A method and apparatus for complementing a depth image are provided. The method includes obtaining a color image and a corresponding depth image, obtaining a first depth image based on the color image, using a first deep neural network (DNN), obtaining a second depth image based on the depth image and an intermediate feature image generated by each intermediate layer of the first DNN, using a second DNN, and obtaining a final depth image by merging the first depth image and the second depth image.
Claims20
A method of complementing a depth image, comprising:
- obtaining a color image and a corresponding depth image;
- obtaining a first depth image based on the color image, using a first deep neural network (DNN);
- obtaining a second depth image based on the depth image and an intermediate feature image generated by each intermediate layer of the first DNN, using a second DNN;
- and
- obtaining a final depth image by merging the first depth image and the second depth image.
An apparatus for complementing a depth image, comprising:
- an image acquirer configured to obtain a color image and a corresponding depth image;
- a color brancher configured to obtain a first depth image based on the color image, using a first deep neural network (DNN);
- a depth brancher configured to obtain a second depth image based on the depth image and an intermediate feature image generated by each intermediate layer of the first DNN, using a second DNN;
- and
- an image merger configured to obtain a final depth image by merging the first depth image and the second depth image.
Dependencies are inferred from the claim text.