Device and method with scene component information estimation

Abstract

An electronic device includes: one or more processors configured to: extract, using an implicit neural representation (INR) model, a global geometry feature and information indicating whether a point is on a surface from a viewpoint and a view direction corresponding to an image pixel corresponding to a two-dimensional (2D) scene at the viewpoint within a field of view (FOV); determine an object surface position corresponding to the viewpoint and the view direction and normal information of the object surface position based on the information indicating whether the point is on the surface; estimate, using an albedo estimation model, albedo information independent of the view direction from the global geometry feature, the object surface position, and the normal information; and estimate, using a specular estimation model, specular information dependent on the view direction from the global geometry feature, the object surface position, the normal information, and the view direction.

Dependencies are inferred from the claim text.