Method and apparatus for estimating depth information of images
AssigneesElectronics and Telecommunications Research Institute, The Trustees of Indiana University
InventorsSoon-Heung Jung, David Crandall, Vibhas Kumar Vats, Shaurya Shubham, Md Alimoor Reza, Chuhua Wang
Life of this patent
Estimating the term…
Abstract
A method and apparatus for estimating depth information of an image are disclosed. The depth information estimation method of the image includes providing a confidence map for a ground truth depth map; and learning a depth information estimation model for estimating depth information of an image based on the ground truth depth map and the confidence map.
Claims11
A method of estimating the depth information of an image, the method comprising:
- providing, by an apparatus including a memory and a processor, a confidence map for a ground truth depth map;
- and
- learning, by the apparatus, a depth information estimation model that estimates depth information of an image based on the ground truth depth map and the confidence map,
- wherein the providing the confidence map includes:
- filling, by the apparatus, an empty depth value of the ground truth depth map using a depth completion technique and providing the confidence map by generating the confidence map for the ground truth depth map filled with the empty depth value,
- wherein the generating the confidence map includes:
- configuring, by the apparatus, a confidence value to 1 for a depth value generated in a same pixel position as the ground truth depth map;
- and
- generating, by the apparatus, the confidence map for the ground truth depth map filled with the empty depth value, by configuring the confidence value based on a distance from a number of pixels having a confidence value present in a certain radius for a depth value of a remaining pixel position.
A method for estimating depth information of image, the method comprising:
- obtaining, by an apparatus including a memory and a processor, a ground truth depth map;
- filling, by the apparatus, an empty depth value for each of the obtained ground truth depth map using a depth completion technique;
- generating, by the apparatus, a confidence map for the ground truth depth map filled with the empty depth value;
- and
- learning, by the apparatus, a depth information estimation model for estimating depth information of an image based on the ground truth depth map filled with the empty depth value and the confidence map,
- wherein the providing the confidence map includes:
- configuring, by the apparatus, a confidence value to 1 for a depth value generated in a same pixel position as the ground truth depth map;
- and
- generating, by the apparatus, the confidence map for the ground truth depth map filled with the empty depth value, by configuring a confidence value based on a distance from a number of pixels having a confidence value present in a certain radius for a depth value of a remaining pixel position.
An apparatus for estimating depth information of an image, the apparatus comprising:
- a memory;
- a transceiver;
- and
- a processor,
- wherein the processor is configured to:
- provide a confidence map for a ground truth depth map;
- learn a depth information estimation model for estimating depth information of an image based on the ground truth depth map and the confidence map;
- and
- fill an empty depth value of the ground truth depth map using depth completion technology and provide the confidence map by generating the confidence map for the ground truth depth map filled with the empty depth value,
- wherein the processor is configured to:
- configure a confidence value to 1 for a depth value generated in a same pixel position as the ground truth depth map;
- and
- generate the confidence map for the ground truth depth map filled with the empty depth value, by configuring the confidence value based on a distance from a number of pixels having the confidence value present in a certain radius for a depth value of a remaining pixel position.
Dependencies are inferred from the claim text.