Scalable multi-view image encoding and decoding apparatuses and methods
AssigneeSamsung Electronics Co., Ltd.
InventorsGwang-Hoon Park, Won-jun Choi
Life of this patent
Estimating the term…
Abstract
Scalable multi-view image encoding and decoding methods and apparatuses are provided. The scalable multi-view image encoding and decoding methods and apparatuses filter multi-view images input from a plurality of cameras in spatial-axis and in temporal-axis directions using motion compensated temporal filtering (MCTF) or hierarchical B-pictures and scalably code the filtered multi-view.
Claims14
A scalable multi-view image encoding method comprising:
- filtering M images on a spatial axis, which are input from M cameras, using at least one of spatial motion compensated temporal filtering (MCTF) and hierarchical B-pictures and generating a spatial low-frequency image and (M−1) spatial high-frequency images;
- filtering N spatial low-frequency images generated for an N period of time using at least one of temporal MCTF and the hierarchical B-pictures and generating a temporal low-frequency image and (N−1) temporal high-frequency images;
- scalably encoding the temporal low-frequency image and the (N−1) temporal high-frequency images according to a transmission bit rate allocated to each group of M×N two-dimensional (2D) images;
- and
- scalably encoding the (M−1) spatial high-frequency images according to a transmission bit rate allocated to the temporal low-frequency image and the (N−1) temporal high-frequency images.
A scalable multi-view image encoding apparatus comprising:
- a spatial image filtering unit for filtering M images on a spatial axis, which are input from M cameras, using at least one of spatial MCTF and hierarchical B-pictures and for generating a spatial low-frequency image and (M−1) spatial high-frequency images;
- a temporal image filtering unit for filtering N spatial low-frequency images generated for an N period of time using at least one of temporal MCTF and the hierarchical B-pictures and for generating a temporal low-frequency image and (N−1) temporal high-frequency images;
- a temporal image scalable encoding unit for scalably encoding the temporal low-frequency image and the (N−1) temporal high-frequency images according to a transmission bit rate allocated to each group of M×N two-dimensional (2D) images;
- and
- a spatial image scalable encoding unit for scalably encoding the (M−1) spatial high-frequency images according to a transmission bit rate allocated to the temporal low-frequency image and the (N−1) temporal high-frequency images.
A scalable multi-view image decoding method comprising:
- receiving a scalably encoded bitstream corresponding to spatio-temporal low-frequency and high-frequency images generated after a group of 2D images input from M cameras for an N period of time are spatially and temporally filtered using at least one of MCTF and hierarchical B-pictures;
- decoding the scalably encoded temporal low-frequency and high-frequency images comprised in the bitstream;
- inversely filtering the decoded temporal low-frequency and high-frequency images using at least one of temporal inverse-MCTF and the hierarchical B-pictures and reconstructing the spatial low-frequency images;
- decoding the scalably encoded spatial high-frequency images comprised in the bitstream;
- and
- inversely filtering the reconstructed spatial low-frequency images and the decoded spatial high-frequency images using at least one of the temporal inverse-MCTF and the hierarchical M-pictures and reconstructing images.
A scalable multi-view image decoding apparatus comprising:
- a temporal image decoding unit for receiving a scalably encoded bitstream corresponding to spatio-temporal low-frequency and high-frequency images generated after a group of 2D images input from M cameras for an N period of time are temporally and spatially filtered using at least one of MCTF and hierarchical B-pictures, and decoding the scalably encoded temporal low-frequency and high-frequency images comprised in the bitstream;
- a temporal inverse-filtering unit for inversely filtering the decoded temporal low-frequency and high-frequency images using at least one of temporal inverse-MCTF and the hierarchical B-pictures and reconstructing the spatial low-frequency images;
- a spatial image decoding unit for decoding the scalably encoded spatial high-frequency images comprised in the bitstream;
- and
- a spatial inverse-filtering unit for inversely filtering the reconstructed spatial low-frequency images and the decoded spatial high-frequency images using at least one of the temporal inverse-MCTF and the hierarchical M-pictures and reconstructing images.
Dependencies are inferred from the claim text.