US 2024/0177329 A1 · SCALING FOR DEPTH ESTIMATION

Abstract

Systems and techniques are provided for processing sensor data. For example, a process can include determining, using a trained machine learning system, a predicted depth map for an image, the predicted depth map including a respective predicted depth value for each pixel of the image. The process can further include obtaining depth values for the image, the depth values including depth values for less than all pixels of the image from a tracker configured to determine the depth values based on one or more feature points between frames. The process can further include scaling the predicted depth map for the image using and the depth values. The output of the process can be scale-correct depth prediction values.

Claims28

Dependent claims

An apparatus for scaling a depth prediction, the apparatus comprising:

at least one memory;
and
at least one processor coupled to the at least one memory and configured to:
determine, using a trained machine learning system, a predicted depth map for an image, the predicted depth map including a respective predicted depth value for each pixel of the image;
obtain depth values for the image from a tracker configured to determine the depth values based on one or more feature points between frames, the depth values including depth values for less than all pixels of the image;
and
scale the predicted depth map for the image using and the depth values.

4 more elements

Dependencies are inferred from the claim text.

Scaling for depth estimation

Life of this patent

Scaling for depth estimation

Life of this patent

Abstract

Claims28