Video-signal layered coding and decoding methods, apparatuses, and programs

A video-signal layered coding method of encoding an input video signal at a plurality of coding layers exhibiting different spatial resolutions, the method comprising at each coding layer:

• a spatial scaling-down step of spatially scaling down an input video signal into a resolution-lowered video signal that exhibits a resolution lower than the input video signal;
• a first encoding step of encoding the resolution-lowered video signal with a decoding procedure, thus obtaining first coded data and a first decoded signal;
• a spatial scaling-up step of performing a high-resolution procedure by extracting a first high-frequency components signal from the first decoded signal, spatially scaling up the first high-frequency components signal so that the first high-frequency components signal exhibits resolution the same as the input original video signal, applying a level-limiting and constant-multiplication procedure with parameters to the spatially scaled-up first high-frequency components signal to generate a second high-frequency components signal, and adding the first and second high-frequency components signals to each other, thus obtaining a high-resolution scaled-up video signal, the parameters used for the level-limiting an constant-multiplication procedure being updated with comparison between the input video signal and the high-resolution scaled-up video signal, the generation of the high resolution scaled-up video signal and the comparison being repeated until a result of the comparison meets a specific requirement to obtain final parameters for the level-limiting and constant-multiplication procedure which are encoded to obtain coded parameters, and to obtain a final high-resolution scaled-up video signal;
• a second encoding step of performing inter-spatial resolution prediction using the final high-resolution scaled-up video signal as a predictive signal generated based on the resolution-lowered video signal, with spatial and temporal prediction to obtain a spatial predictive signal and a temporal predictive signal, respectively, at the resolution of the input video signal, followed by selecting one among the predictive signal, the spatial predictive signal and the temporal predictive signal or by weighting the predictive signal, the spatial predictive signal and the temporal predictive signal and combining the weighted signals, to generate an inter-spatial resolution predictive signal at the resolution of the input video signal, and subtracting the inter-spatial resolution predictive signal from the input video signal, thus obtaining second coded data that exhibits a resolution higher than the resolution-lowered video signal;
• and
• multiplexing the first and second coded data and the coded parameters into a bitstream.

A video-signal layered coding program, encoded on a non-transitory computer readable medium, for encoding an input video signal at a plurality of coding layers exhibiting different spatial resolutions, the program comprising at each coding layer:

• a spatial scaling-down program code of spatially scaling down an input video signal into a resolution-lowered video signal that exhibits a resolution lower than the input video signal;
• a first encoding program code of encoding the resolution-lowered video signal with a decoding procedure, thus obtaining first coded data and a first decoded signal;
• a spatial scaling-up program code of performing a high-resolution procedure by extracting a first high-frequency components signal from the first decoded signal, spatially scaling up the first high-frequency components signal so that the first high-frequency components signal exhibits resolution the same as the input original video signal, applying a level-limiting and constant-multiplication procedure with parameters to the spatially scaled-up first high-frequency components signal to generate a second high-frequency components signal, and adding the first and second high-frequency components signal to each other, thus obtaining a high-resolution scaled-up video signal, the parameters used for the level-limiting and constant-multiplication procedure being updated with comparison between the input video signal and the high resolution scaled-up video signal, the generation of the high-resolution scaled-up video signal and the comparison being repeated until a result of the comparison meets a specific requirement to obtain final parameters for the level-limiting and constant-multiplication procedure which are encoded to obtain coded parameters, and to obtain a final high-resolution scaled-up video signal;
• a second encoding program code of performing inter-spatial resolution prediction using the final high-resolution scaled-up video signal as a predictive signal generated based on the resolution-lowered video signal, with spatial and temporal prediction to obtain a spatial predictive signal and a temporal predictive signal, respectively, at the resolution of the input video signal, followed by selecting one among the predictive signal, the spatial predictive signal and the temporal predictive signal or by weighting the predictive signal, the spatial predictive signal and the temporal predictive signal and combining the weighted signals, to generate an inter-spatial resolution predictive signal at the resolution of the input video signal, and subtracting the inter-spatial resolution predictive signal from the input video signal, thus obtaining second coded data that exhibits a resolution higher than the resolution-lowered video signal;
• and
• a multiplexing code of multiplexing the first and second coded data and the coded parameters into a bitstream.

A video-signal layered decoding apparatus for decoding an input bitstream at a plurality of decoding layers exhibiting different spatial resolutions, the apparatus comprising at each decoding layer:

• a separator to separate an input bitstream into first coded data, second coded data and third coded data, wherein
• the first coded data is an encoded version of a resolution-lowered video signal exhibiting a resolution lower than an original video signal and obtained by spatially scaling down the original video signal,
• the second coded data is a high-resolution scaled-up video signal obtained through a high-resolution procedure by extracting a first high-frequency components signal from a first decoded signal obtained by decoding the resolution-lowered video signal, spatially scaling up the first high-frequency components signal so that the first high-frequency components signal exhibits resolution the same as the original video signal, applying a level-limiting and constant-multiplication procedure with parameters to the spatially scaled up first high-frequency components signal to generate a second high-frequency components signal, and adding the first and second high-frequency components signals to other, thus obtaining a high-resolution scaled-up video signal, the parameters used for the level-limiting and constant-multiplication procedure being updated with comparison between the video signal and the high-resolution scaled-up video signal, the generation of the high-resolution scaled-up video signal and the comparison being repeated until a result of the comparison meets a specific requirement to obtain final parameters for the level-limiting and constant-multiplication procedure, and to obtain a final high-resolution scaled-up video signal, followed by inter-spatial resolution prediction using the final high-resolution scaled-up video signal as a predictive signal generated based on the resolution-lowered video signal, with spatial and temporal prediction to obtain a spatial predictive signal and a temporal predictive signal, respectively, at the resolution of the input video signal, followed by selecting one among the predictive signal, the spatial predictive signal and the temporal predictive signal or by weighting the predictive signal, the spatial predictive signal and the temporal predictive signal and combining the weighted signals, to generate an inter-spatial resolution predictive signal at the resolution of the original video signal, and subtracting the inter-spatial resolution predictive signal from the original video signal, thus obtaining second coded data that exhibits a resolution higher than the resolution-lowered video signal, and
• the third coded data is the coded parameters obtained by encoding the final parameters for the level-limiting and constant-multiplication procedure;
• a first decoder to decode the separated first coded data to obtain a resolution-lowered first decoded signal;
• a reconstructor to decode the separated coded third data to reconstruct the parameters used for the level-limiting and constant-multiplication procedure and spatially scale up a third high-frequency components signal extracted from the first decoded signal so that the third high-frequency components signal exhibits resolution the same as the original video signal, followed by applying a level-limiting and constant-multiplication procedure to the scaled-up third high-frequency components signal using the reconstructed parameters to obtain a fourth high-frequency components signal and adding the fourth high-frequency components signal and a second decoded signal obtained by scaling up the first decoded signal so that the first decoded signal exhibits resolution the same as the original video signal to reconstruct a high-resolution scaled-up video signal;
• and
• a second decoder to decode the separated second coded data to obtain a decoded predictive-error signal, reconstruct a predictive signal through inter-spatial resolution prediction using the reconstructed high-resolution scaled-up video signal as a predictive signal, and add the reconstructed predictive signal and the decoded predictive-error signal, thus obtaining a decoded signal of the same resolution as the original video signal.

A video-signal layered decoding method of decoding an input bitstream at a plurality of decoding layers exhibiting different spatial resolutions, the method comprising at each decoding layer:

• a separating step of separating an input bitstream into first coded data, second coded data and third coded data, wherein
• the first coded data is an encoded version of a resolution-lowered video signal exhibiting a resolution lower than an original video signal and obtained by spatially scaling down the original video signal,
• the second coded data is a high-resolution scaled-up video signal obtained through a high-resolution procedure by extracting a first high-frequency components signal from a first decoded signal obtained by decoding the resolution-lowered video signal, spatially scaling up the first high-frequency components signal so that the first high-frequency components signal exhibits resolution the same as the original video signal, applying a level-limiting and constant-multiplication procedure with parameters to the spatially scaled-up first high-frequency components signal to generate a second high-frequency components signal, and adding the first and second high-frequency components signals to each other, thus obtaining a high-resolution scaled-up video signal, the parameters used for the level-limiting and constant-multiplication procedure being updated with comparison between the video signal and the high-resolution scaled-up video signal, the generation of the high-resolution scaled-up video signal and the comparison being repeated until a result of the comparison meets a specific requirement to obtain final parameters for the level-limiting and constant-multiplication procedure, and to obtain a final high-resolution scaled-up video signal, followed by inter-spatial resolution prediction using the final high-resolution scaled-up video signal as a predictive signal generated based on the resolution-lowered video signal, with spatial and temporal prediction to obtain a spatial predictive signal and a temporal predictive signal, respectively, at the resolution of the input video signal, followed by selecting one among the predictive signal, the spatial predictive signal and the temporal predictive signal or by weighting the predictive signal, the spatial predictive signal and the temporal predictive signal and combining the weighted signals, to generate an inter-spatial resolution predictive signal at the resolution of the original video signal, and subtracting the inter-spatial resolution predictive signal from the original video signal, thus obtaining second coded data that exhibits a resolution higher than the resolution-lowered video signal, and
• the third, coded data is the coded parameters obtained by encoding the final parameters for the level-limiting and constant-multiplication procedure;
• a first decoding step of decoding the separated first coded data to obtain a resolution-lowered first decoded signal;
• a reconstructing step of decoding the separated coded third data to reconstruct the parameters used for the level-limiting and constant-multiplication procedure and spatially scale up a third high-frequency components signal extracted from the first decoded signal so that the third high-frequency components signal exhibits resolution the same as the original video signal, followed by applying a level-limiting and constant-multiplication procedure to the scaled up third high-frequency components signal using the reconstructed parameters to obtain a fourth high-frequency components signal and adding the fourth high-frequency components signal and a second decoded signal obtained by scaling up the first decoded signal so that the first decoded signal exhibits resolution the same as the original video signal to reconstruct a high-resolution scaled-up video signal;
• and
• a second decoding step of decoding the separated second coded data to obtain a decoded predictive-error signal, reconstruct a predictive signal through inter-spatial resolution prediction using the reconstructed high-resolution scaled-up video signal as a predictive signal, and add the reconstructed predictive signal and the decoded predictive-error signal, thus obtaining a decoded signal of the same resolution as the original video signal.

A video-signal layered decoding program, encoded on a non-transitory computer readable medium, for decoding an input bitstream at a plurality of decoding layers exhibiting different spatial resolutions, the program comprising at each decoding layer:

• a separating program code of separating an input bitstream into first coded data, second coded data and third coded data, wherein
• the first coded data is an encoded version of a resolution-lowered video signal exhibiting a resolution lower than an original video signal and obtained by spatially scaling down the original video signal,
• the second coded data is a high-resolution scaled-up video signal obtained through a high-resolution procedure by extracting a first high-frequency components signal from a first decoded signal obtained by decoding the resolution-lowered video signal, spatially scaling up the first high-frequency components signal so that the first high-frequency components signal exhibits resolution the same as the original video signal,
• applying a level-limiting and constant-multiplication procedure with parameters to the spatially scaled-up first high-frequency components signal to generate a second high-frequency components signal, and adding the first and second high-frequency components signals to each other, thus obtaining a high-resolution scaled-up video signal, the parameters used for the level-limiting and constant-multiplication procedure being updated with comparison between the video signal and the high-resolution scaled-up video signal, the generation of the high-resolution scaled-up video signal and the comparison being repeated until a result of the comparison meets a specific requirement to obtain final parameters for the level-limiting and constant-multiplication procedure and to obtain a final high-resolution scaled-up video signal, followed by inter-spatial resolution prediction using the final high-resolution scaled-up video signal as a predictive signal generated based on the resolution-lowered video signal, with spatial and temporal prediction to obtain a spatial predictive signal and a temporal predictive signal, respectively, at the resolution of the input video signal, followed by selecting one among the predictive signal, the spatial predictive signal and the temporal predictive signal or by weighting the predictive signal the spatial predictive signal and the temporal predictive signal and combining the weighted signals, to generate an inter-spatial resolution predictive signal at the resolution of the video signal, and subtracting the inter-spatial resolution predictive signal from the original video signal, thus obtaining second coded data that exhibits a resolution higher than the resolution-lowered video signal, and
• the third coded data is the coded parameters obtained by encoding the final parameters for the level-limiting and constant-multiplication procedure;
• a first decoding program code of decoding the separated first coded data to obtain a resolution-lowered first decoded signal;
• a reconstructing program code of decoding the separated first coded third data to reconstruct the parameters used for the level-limiting and constant-multiplication procedure and spatially scale up a third high-frequency components signal extracted from the first decoded signal so that the third high-frequency components signal exhibits resolution the same as the original video signal, followed by applying a level-limiting and constant-multiplication procedure to the scaled-up third high-frequency components signal using the reconstructed parameters to obtain a fourth high-frequency components signal and adding the fourth high-frequency components signal and a second decoded signal obtained by scaling up the first decoded signal so that the first decoded signal exhibits resolution the same as the original video signal to reconstruct a high-resolution scaled-up video signal;
• and
• a second program code of decoding the separated second coded data to obtain a decoded predictive-error signal, reconstruct a predictive signal through inter-spatial resolution prediction using the reconstructed high resolution scaled-up video signal as a predictive signal, and add the reconstructed predictive signal and the decoded predictive-error signal, thus obtaining a decoded signal of the same resolution as the original video signal.