Information processing apparatus and information processing method
AssigneeSony Corporation
InventorsZhaoxin Li, Chongyu Chen, Lei Zhang
Life of this patent
Estimating the term…
Abstract
The disclosure relates to an information processing apparatus and information processing method. The information processing apparatus according to an embodiment includes a processing circuitry configured to: derive a disparity map of an object based on at least two images among multi-view images of the object; estimate confidences of disparity values in the disparity map using a classifier trained in advance; and perform an optimization process on the disparity map based on disparity values of reference pixels having confidences higher than a predetermined level.
Claims19
An information processing apparatus, comprising:
- processing circuitry configured to
- derive a disparity map of an object based on at least two images among multi-view images of the object;
- estimate confidences of disparity values in the disparity map using a classifier trained in advance;
- and
- perform an optimization process on the disparity map based on disparity values of reference pixels having confidences higher than a predetermined level,
- wherein the optimization process further comprises:
- triangulating the disparity map based on positions of the reference pixels,
- determining an energy function respectively for each of triangular regions with the reference pixels as vertexes, and
- optimizing disparity values of pixels in a corresponding triangular region based on the determined energy function.
An information processing method, comprising:
- deriving a disparity map of an object based on at least two images among multi-view images of the object;
- estimating confidences of disparity values in the disparity map using a classifier trained in advance;
- and
- performing an optimization process on the disparity map based on disparity values of reference pixels having confidences higher than a predetermined level, wherein the optimization process further comprises:
- triangulating the disparity map based on positions of the reference pixels,
- determining an energy function respectively for each of triangular regions with the reference pixels as vertexes, and
- optimizing disparity values of pixels in a corresponding triangular region based on the determined energy function.
An information processing apparatus, comprising:
- processing circuitry configured to
- derive a disparity map of an object based on at least two images among multi-view images of the object;
- estimate confidences of disparity values in the disparity map using a classifier trained in advance;
- generate a depth map of the object based on the disparity map;
- perform a three-dimensional reconstruction of the object from the depth map based on the confidences;
- triangulate the disparity map based on positions of reference pixels;
- determine an energy function respectively for each of triangular regions with the reference pixels as vertexes;
- and
- optimize disparity values of pixels in a corresponding triangular region based on the determined energy function.
An information processing method, comprising:
- deriving a disparity map of an object based on at least two images among multi-view images of the object;
- estimating confidences of disparity values in the disparity map using a classifier trained in advance;
- generating a depth map of the object based on the disparity map;
- performing a three-dimensional reconstruction of the object from the depth map based on the confidences;
- triangulating the disparity map based on positions of reference pixels;
- determining an energy function respectively for each of triangular regions with the reference pixels as vertexes;
- and
- optimizing disparity values of pixels in a corresponding triangular region based on the determined energy function.
Dependencies are inferred from the claim text.