Back to results
US 9,179,153 B2Granted
Refined depth map
AssigneeThomson Licensing
InventorsDong Tian, Purvin Bibhas Pandit, Peng Yin
Life of this patent
Estimating the term…
Abstract
Various implementations are described. Several implementations relate to a refined depth map. According to one aspect, depth information for a picture in a set of pictures is accessed. Modified depth information for the picture is accessed. A refinement is determined that characterizes a difference between the depth information and the modified depth information. The refinement, and the depth information, is provided for use in processing one or more pictures in the set of pictures.
Claims50
A method comprising:
- accessing depth information for a picture in a set of pictures, the set of pictures including the reference picture and a target picture, the reference picture being from a reference view at a reference location, and the target picture being from a target view at a target location different from the reference location;
- accessing modified depth information for the reference picture, wherein the modified depth information reduces, as compared to the depth information, a cost function for encoding the target picture;
- determining a refinement that characterizes a difference between the depth information and the modified depth information;
- warping the reference picture, based on the modified depth information, from the reference location to the target location;
- encoding the target picture based on the warped reference picture;
- and
- providing the encoded target picture along with the refinement and the depth information.
4 more elements
An apparatus comprising:
- means for accessing depth information for a reference picture in a set of pictures, the set of pictures including the reference picture and a target picture, the reference picture being from a reference view at a reference location, and the target picture being from a target view at a target location different from the reference location;
- means for accessing modified depth information for the picture, wherein the modified depth information reduces, as compared to the depth information, a cost function for encoding the target picture;
- means for determining a refinement that characterizes a difference between the depth information and the modified depth information;
- means for warping the reference picture, based on the modified depth information, from the reference location to the target location;
- means for encoding the target picture based on the warped reference picture;
- and
- means for providing the encoded target picture along with the refinement and the depth information.
4 more elements
A non-transitory processor readable medium having stored thereon instructions for causing a processor to perform at least the following:
- accessing depth information for a reference picture in a set of pictures the set of pictures including the reference picture and a target picture, the reference picture being from a reference view at a reference location, and the target picture being from a target view at a target location different from the reference location;
- accessing modified depth information for the reference picture, wherein the modified depth information reduces, as compared to the depth information, a cost function for encoding the target picture;
- determining a refinement that characterizes a difference between the depth information and the modified depth information;
- warping the reference picture, based on the modified depth information, from the reference location to the target location:
- encoding the target picture based on the warped reference picture;
- and
- providing the encoded target picture along with the refinement and the depth information.
4 more elements
An apparatus, comprising a processor configured to perform at least the following:
- accessing depth information for a picture in a set of pictures, the set of pictures including the reference picture and a target picture, the reference picture being from a reference view at a reference location, and the target picture being from a target view at a target location different from the reference location;
- accessing modified depth information for the picture, wherein the modified depth information reduces, as compared to the depth information, a cost function for encoding the target picture;
- determining a refinement that characterizes a difference between the depth information and the modified depth information;
- warping the reference picture, based on the modified depth information, from the reference location to the target location;
- encoding the target picture based on the warped reference picture;
- and
- providing the encoded target picture along with the refinement and the depth information.
4 more elements
An apparatus comprising:
- an accessing unit for accessing depth information for a reference picture in a set of pictures, the set of pictures including the reference picture and a target picture, the reference picture being from a reference view at a reference location, and the target picture being from a target view at a target location different from the reference location, and for accessing modified depth information for the reference picture, wherein the modified depth information reduces, as compared to the depth information, a cost function for encoding the target picture;
- and
- a depth refiner for
- (i) determining a refinement that characterizes a difference between the depth information and the modified depth information,
- (ii) warping the reference picture, based on the modified depth information, from the reference location to the target location,
- (iii) encoding the target picture based on the warped reference picture, and
- (iv) providing the encoded target picture along with the refinement and the depth information.
4 more elements
An apparatus comprising:
- an accessing unit for accessing depth information for a reference picture in a set of pictures, the set of pictures including the reference picture and a target picture, the reference picture being from a reference view at a reference location, and the target picture being from a target view at a target location different from the reference location, and for accessing modified depth information for the reference picture, wherein the modified depth information reduces, as compared to the depth information, a cost function for encoding the target picture;
- a depth refiner for
- (i) determining a refinement that characterizes a difference between the depth information and the modified depth information,
- (ii) warping the reference picture, based on the modified depth information, from the reference location to the target location,
- (iii) encoding the target picture based on the warped reference picture, and
- (iv) providing the encoded target picture along with the refinement and the depth information;
- and
- a modulator (320) for modulating a signal, the signal including the refinement and the depth information.
5 more elements
A method comprising:
- accessing an encoding of a target picture;
- accessing a decoded reference picture, the reference picture being from a reference view at a reference location, and the target picture being from a target view at a target location different from the reference location;
- accessing depth information for the reference picture;
- accessing a refinement that characterizes a difference between the depth information for the reference picture, wherein the modified depth information reduces, as compared to the depth information, from the reference location to the target location;
- and
- determining the modified depth information for the reference picture;
- and
- warping the decoded reference picture, based on the modified depth information, from the reference location to the target location;
- and
- decoding the target picture based on the warped decoded reference picture to produce a decoded target picture.
7 more elements
An apparatus comprising:
- means for accessing an encoding of a target picture;
- means for accessing a decoded reference picture, the reference picture being from a reference view at a reference location, and the target picture being from a target view at a target location different from the reference location;
- means for accessing depth information for the reference picture;
- means for accessing a refinement that characterizes a difference between the depth information for the reference picture and modified depth information for the reference picture, wherein the modified depth information reduces, as compared to the depth information, a cost function for encoding the target picture;
- means for determining the modified depth information for the reference picture;
- and
- means for warping the decoded reference picture, based on the modified depth information, from the reference location to the target location;
- and
- means for decoding the target picture based on the warped decoded reference picture to produce a decoded target picture.
6 more elements
A non-transitory processor readable medium having stored thereon instructions for causing a processor to perform at least the following:
- accessing an encoding of a target picture;
- accessing a decoded reference picture, the reference picture being from a reference view at a reference location, and the target picture being from a target view at a target location different from the reference location;
- accessing depth information for the reference picture;
- accessing a refinement that characterizes a difference between the depth information for the reference picture and modified depth information for the reference picture, wherein the modified depth information reduces, as compared to the depth information, a cost function for encoding the target picture;
- determining the modified depth information for the reference picture;
- warping the decoded reference picture, based on the modified depth information, from the reference location to the target location;
- and
- decoding the target picture based on the warped decoded reference picture to produce a decoded target picture.
5 more elements
An apparatus, comprising a processor configured to perform at least the following:
- accessing an encoding of a target picture;
- accessing a decoded reference picture, the reference picture being from a reference view at a reference location, and the target picture being from a target view at a target location different from the reference location;
- accessing depth information for the reference picture;
- accessing a refinement that characterizes a difference between the depth information for the reference picture and modified depth information for the reference picture, wherein the modified depth information reduces, as compared to the depth information, a cost function for encoding the target picture;
- determining the modified depth information for the reference picture;
- warping the decoded reference picture, based on the modified depth information, from the reference location to the target location;
- and
- decoding the target picture based on the warped decoded reference picture to produce a decoded target picture.
5 more elements
An apparatus comprising:
- an accessing unit for
- (i) accessing an encoding of a target picture,
- (ii) accessing a decoded reference picture, the reference picture being from a reference view at a reference location, and the target picture being from a target view at a target location different from the reference location,
- (iii) accessing depth information for the reference picture, and
- (iv) accessing a refinement that characterizes a difference between the depth information for the reference picture and modified depth information for the reference picture, wherein the modified depth information reduces, as compared to the depth information, a cost function for encoding the target picture;
- and
- a depth refiner for
- (i) determining the modified depth information for the reference picture,
- (ii) warping the decoded reference picture, based on the modified depth information, from the reference location to the target location, and
- (iii) decoding the target picture based on the warped decoded reference picture to produce a decoded target picture.
7 more elements
An apparatus comprising:
- a demodulator for receiving and demodulating a signal, the signal including coded video information for a set of pictures, depth information for a picture in the set of pictures, and a refinement that characterizes a difference between the depth information for the picture and modified depth information for the picture;
- an accessing unit for
- (i) accessing an encoding of a target picture,
- (ii) accessing a decoded reference picture, the reference picture being from a reference view at a reference location, and the target picture being from a target view at a target location different from the reference location,
- (iii) accessing depth information for the reference picture, and
- (iv) accessing a refinement that characterizes a difference between the depth information for the reference picture and modified depth information for the reference picture, wherein the modified depth information reduces, as compared to the depth information, a cost function for encoding the target picture;
- and
- a depth refiner for
- (i) determining the modified depth information for the reference picture,
- (ii) warping the decoded reference picture, based on the modified depth information, from the reference location to the target location, and
- (iii) decoding the target picture based on the warped decoded reference picture to produce a decoded target picture.
8 more elements
Dependencies are inferred from the claim text.