View synthesis using low resolution depth maps
AssigneeTelefonaktiebolaget LM Ericsson (publ)
InventorsBjorn Johansson, Thomas Rusert
Life of this patent
Estimating the term…
Abstract
View synthesis is performed based on obtained texture data and a depth map. The resolution of the depth map is lower than that of the texture data by a ratio dw in the x direction and by a ratio dh in the y direction. Texture pixel positions x, y are transformed into non-integer depth map pixel positions by performing divisions x/dw and y/dh and these non-integer depth map pixel positions are rounded to integer depth map pixel positions, and a view is synthesized based at least on the obtained texture data and depth map values at the integer depth map pixel positions and/or adjacent positions.
Claims11
A method of performing view synthesis, comprising:
- a view synthesizing apparatus performing:
- obtaining texture data comprising pixels arranged along an x direction and arranged along a y direction;
- obtaining a depth map, the depth map associated with the obtained texture data and where the resolution of the depth map is lower than that of the texture data, wherein a ratio of depth map data to texture data in a first direction is dw, and a ratio of depth map data to texture data in a second direction is dh, wherein x is a pixel position in the first direction and y is a pixel position in the y direction;
- transforming texture pixel positions x, y into non-integer depth map pixel positions by performing divisions x/dw and y/dh;
- rounding the non-integer depth map pixel positions to integer depth map pixel positions;
- for each of the non-integer depth map pixel positions, using rounding errors obtained in the rounding of the non-integer depth map pixel positions to integer depth map pixel positions as a basis for selecting one of a plurality of dilation operations;
- and
- synthesizing a view based at least on the obtained texture data and lower resolution depth map values adjacent to the integer depth map pixel positions and lower resolution depth map values at the integer depth map pixel positions, wherein the depth values at the integer depth map pixel position and adjacent positions are combined by means of the selected dilation operations.
A non-transitory processor-readable storage medium comprising instructions that, when executed in a processor, perform a method of performing view synthesis, the method comprising:
- obtaining texture data comprising pixels arranged along an x direction and arranged along a y direction;
- obtaining a depth map, the depth map associated with the obtained texture data and where the resolution of the depth map is lower than that of the texture data, wherein a ratio of depth map data to texture data in a first direction is dw and a ratio of depth map data to texture data in a second direction is dh, wherein x is a pixel position in the first direction and y is a pixel position in the y direction;
- transforming texture pixel positions x, y into non-integer depth map pixel positions by performing divisions x/dw and y/dh;
- rounding the non-integer depth map pixel positions to integer depth map pixel positions;
- for each of the non-integer depth map pixel positions, using rounding errors obtained in the rounding of the non-integer depth map pixel positions to integer depth map pixel positions as a basis for selecting one of a plurality of dilation operations;
- and
- synthesizing a view based at least on the obtained texture data and lower resolution depth map values adjacent to the integer depth map pixel positions and lower resolution depth map values at the integer depth map pixel positions, wherein the depth values at the integer depth map pixel position and adjacent positions are combined by means of the selected dilation operations.
Dependencies are inferred from the claim text.