Picture encoding and/or decoding apparatus and method for providing scalability of a video object whose position changes with time and a recording medium having the same recorded thereon
AssigneeSony Corporation
InventorsTeruhiko Suzuki, Yoichi Yagasaki
Life of this patent
Estimating the term…
Abstract
An apparatus and method for obtaining scalability of a video object (VO) whose position and/or size changes with time. The position of an upper layer picture and that of a lower layer picture in an absolute coordinate system are determined so that corresponding pixels in an enlarged picture and in the upper layer picture may be arranged at the same positions in the absolute coordinate system.
Claims64
A picture encoding device for encoding a first picture using a second picture different in resolution from the first picture, said picture encoding device comprises:
- enlarging/contracting means for enlarging or contracting said second picture based on the difference in resolution between the first and second pictures;
- first picture encoding means for predictive coding said first picture using an output of said enlarging/contracting means as a reference picture;
- second picture encoding means for encoding said second picture;
- position setting means for setting positions of said first picture and said second picture in a pre-set absolute coordinate system and for outputting the first position information or the second position information of the position of said first or second picture, respectively;
- and
- multiplexing means for multiplexing outputs of said first picture encoding means, said second picture encoding means, and said position setting means;
- in which said first picture encoding means recognizes the position of said first picture based on said first position information and converts said second position information in response to an enlarging ratio or a contracting ratio by which said enlarging/contracting means has enlarged or contracted said second picture to obtain a position of said reference picture so as to perform predictive coding.
A picture encoding method for encoding a first picture using a second picture different in resolution from the first picture, said picture encoding method comprising the steps of:
- enlarging or contracting said second picture based on the difference in resolution between the first and second pictures by using an enlarging/contracting device;
- predictive coding said first picture using an output of said enlarging/contracting device as a reference picture by utilizing a first picture encoding device;
- encoding said second picture by utilizing a second picture encoding device;
- setting the positions of said first picture and said second picture in a pre-set absolute coordinate system and outputting the first position information or the second position information on the position of said first or second picture, respectively, by use of a position setting device;
- and
- multiplexing outputs of said first picture encoding device, said second picture encoding device, and said position setting device;
- in which said first picture encoding device is caused to recognize the position of said first picture based on said first position information and convert said second position information in response to an enlarging ratio or a contracting ratio by which said enlarging/contracting device has enlarged or contracted said second picture to obtain a position of said reference picture so as to perform predictive coding.
A picture decoding device for decoding encoded data obtained on predictive encoding of a first picture using a second picture different in resolution from said first picture, said picture decoding device comprises:
- second picture decoding means for decoding said second picture;
- enlarging/contracting means for enlarging/contracting said second picture decoded by said second picture decoding means based on the difference in resolution between said first and second pictures;
- and
- first picture decoding means for decoding said first picture using an output of said enlarging/contracting means as a reference picture;
- in which said encoded data includes first or second position information pertaining to the position of said first picture or said second picture in a pre-set absolute coordinate system;
- and
- in which said first picture decoding means recognizes the position of said first picture based on said first position information and converts said second position information in response to an enlarging ratio or a contracting ratio by which said enlarging/contracting means has enlarged or contracted said second picture to obtain a position of said reference picture so as to decode said first picture.
A picture decoding method for decoding encoded data obtained on predictive encoding of a first picture using a second picture different in resolution from said first picture, said picture decoding method comprising the steps of:
- decoding said second picture by using a device second picture decoding device;
- enlarging/contracting said second picture decoded by said second picture decoding device based on the difference in resolution between said first and second pictures by using an enlarging/contracting device;
- and
- decoding said first picture using an output of said enlarging/contracting device as a reference picture by utilizing a first picture decoding device;
- in which said encoded data includes first or second position information pertaining to the position of said first picture or said second picture in a pre-set absolute coordinate system;
- and
- in which said first picture decoding device is caused to recognize the position of said first picture based on said first position information and convert said second position information in response to an enlarging ratio or a contracting ratio by which said enlarging/contracting device has enlarged or contracted said second picture to obtain a position of said reference picture so as to decode said first picture.
A recording medium having recorded thereon encoded data obtained on encoding a first picture using a second picture different in resolution from the first picture said encoded data including at least first data obtained on predictive encoding said first picture using as a reference picture enlarged or contracted results obtained on enlarging or contracting said second picture based on the difference in resolution between said first and second pictures, second data obtained on encoding said second picture, and first or second position information obtained on setting positions of said first and second pictures in a pre-set absolute coordinate system;
- in which the position of said first picture is recognized based on said first position information and said second position information is converted in response to an enlarging ratio or contracting ratio by which said second picture has been enlarged or contracted to obtain a position of said reference picture so as to perform predictive coding.
A recording method for recording encoded data obtained on encoding a first picture using a second picture different in resolution from the first picture, in which said encoded data includes at least first data obtained on predictive encoding said first picture using as a reference picture enlarged or contracted results obtained on enlarging or contracting said second picture based on the difference in resolution between said first and second pictures, second data obtained on encoding said second picture, and first or second position information obtained on setting positions of said first and second pictures in a pre-set absolute coordinate system;
- wherein the position of said first picture is recognized based on said first position information and said second position information is converted in response to an enlarging ratio or contracting ratio by which said second picture has been enlarged or contracted to obtain a position of said reference picture so as to perform predictive coding.
A picture encoding device for encoding a first picture using a second picture different in resolution from the first picture, said picture encoding device comprises:
- enlarging/contracting means for enlarging or contracting said second picture based on the difference in resolution between the first and second pictures;
- first picture encoding means for predictive coding of said first picture using an output of said enlarging/contracting means as a reference picture;
- second picture encoding means for encoding said second picture;
- position setting means for setting positions of said first picture and said second picture in a pre-set absolute coordinate system and for outputting the first position information or the second position information of the position of said first or second picture, respectively;
- and
- multiplexing means for multiplexing outputs of said first picture encoding means, said second picture encoding means, and said position setting means;
- in which said position setting means sets the positions of said first and second pictures so that a position of said reference picture in said pre-set absolute coordinate system will be coincident with a pre-set position;
- and
- in which said first picture encoding means recognizes the position of said first picture based on the first position information and recognizes the pre-set position to obtain a position of said reference picture so as to perform predictive coding.
A picture encoding method for encoding a first picture using a second picture different in resolution from the first picture, said picture encoding method comprising the steps of:
- enlarging or contracting said second picture based on the difference in resolution between the first and second pictures by using an enlarging/contracting device;
- predictive coding of said first picture using an output of said enlarging/contracting device as a reference picture by utilizing a first picture encoding device;
- encoding said second picture by using a second picture encoding device;
- setting the positions of said first picture and said second picture in a pre-set absolute coordinate system and outputting the first position information or the second position information on the position of said first or second picture, respectively, by use of a position setting device;
- and
- multiplexing outputs of said first picture encoding device, said second picture encoding device, and said position setting device;
- in which said position setting device is caused to set the positions of said first and second pictures so that a position of said reference picture in said pre-set absolute coordinate system will be coincident with the pre-set position;
- and
- in which said first picture encoding device is caused to recognize the position of said first picture based on said first position information and to recognize said pre-set position to obtain a position of said reference picture so as to perform predictive coding.
A picture decoding device for decoding encoded data obtained on predictive encoding of a first picture using a second picture different in resolution from said first picture, said picture decoding device comprises:
- second picture decoding means for decoding said second picture;
- enlarging/contracting means for enlarging/contracting said second picture decoded by said second picture decoding means based on the difference in resolution between said first and second pictures;
- and
- first picture decoding means for decoding said first picture using an output of said enlarging/contracting means as a reference picture;
- in which said encoded data includes first or second position information pertaining to the position of said first picture or said second picture, respectively, in a pre-set absolute coordinate system;
- in which the position of said reference picture in said pre-set absolute coordinate system has been set so as to be coincident with a pre-set position;
- and
- in which said first picture decoding means recognizes the position of said first picture based on said first position information and recognizes the pre-set to obtain a position of said reference picture so as to decode said first picture.
A picture decoding method for decoding encoded data obtained on predictive encoding of a first picture using a second picture different in resolution from said first picture, said picture decoding method comprising the steps of:
- decoding said second picture by using a second picture decoding device;
- enlarging/contracting said second picture decoded by said second picture decoding device based on the difference in resolution between said first and second pictures by using an enlarging/contracting device;
- and
- decoding said first picture using an output of said enlarging/contracting device as a reference picture by utilizing a first picture decoding device;
- in which said encoded data includes first or second position information pertaining to the position of said first picture or said second picture in a pre-set absolute coordinate system;
- in which the position of said reference picture in said pre-set coordinate system has been set so as to coincide with a pre-set position;
- and
- in which said first picture decoding device is caused to recognize the position of said first picture based on the first position information and to recognize the pre-set position to obtain a position of said reference picture so as to decode said first picture.
A recording medium having recorded thereon encoded data obtained on encoding a first picture using a second picture different in resolution from the first picture, said encoded data including at least first data obtained on predictive encoding said first picture using as a reference picture enlarged or contracted results obtained on enlarging or contracting said second picture based on the difference in resolution between said first and second pictures, second data obtained on encoding said second picture, and first or second position information obtained on setting positions of said first and second pictures in a pre-set absolute coordinate system;
- in which said first and second information are set so that the position of said reference picture in said pre-set coordinate system will be coincident with a pre-set position.
A recording method for recording encoded data obtained on encoding a first picture using a second picture different in resolution from said first picture, wherein said encoded data includes at least first data obtained on predictive encoding said first picture using as a reference picture enlarged or contracted results obtained on enlarging or contracting said second picture based on the difference in resolution between said first and second pictures, second data obtained on encoding said second picture, and first or second position information obtained on setting positions of said first and second pictures in a pre-set absolute coordinate system;
- in which said first and second position are set so that the position of said reference picture in said pre-set absolute coordinate system will be coincident with a pre-set position.
A picture encoding device for predictive coding a picture, said picture encoding device comprising:
- first predictive coding means for predictive coding said picture by utilizing a detected motion vector of said picture;
- local decoding means for locally decoding the results of the predictive coding by said first predictive coding means;
- second predictive coding means for predictive coding said picture using a locally decoded picture outputted by said local decoding means as a reference picture;
- and
- multiplexing means for multiplexing the results of the predictive coding by said first and second predictive coding means.
A picture encoding method for predictive coding a picture, said method comprising the steps of:
- predictive coding said picture by utilizing a detected motion vector of said picture to obtain first encoded data;
- locally decoding said first encoded data;
- predictive coding said picture using a locally decoded picture obtained as a result of the local decoding to obtain second encoded data;
- and
- multiplexing said first encoded data and said second encoded data.
A picture decoding device for decoding encoded data said picture decoding device comprising:
- separating means for separating first and second data from said encoded data;
- first decoding means for decoding said first data;
- and
- second decoding means for decoding said second data using an output of said first decoding means as a reference picture;
- in which said encoded data includes a motion vector used in predictive coding said first data, and in which;
- said second decoding means decodes said second data in accordance with said motion vector used in the predictive coding of said first data.
A picture decoding method for decoding encoded data, said picture decoding method comprising the steps of:
- separating first and second data from said encoded data by use of a separating device;
- decoding said first data by use of a first decoding device;
- and
- decoding said second data by utilizing a second decoding device using an output of said first decoding device as a reference picture;
- in which said encoded data includes a motion vector used in predictive coding said first data and in which said second decoding device is caused to decode said second data in accordance with said motion vector used in the predictive coding of said first data.
A recording medium having recorded thereon encoded data which is obtained by predictive coding said picture by utilizing a detected motion vector of said picture to obtain first encoded data, locally decoding said first encoded data, predictive coding said picture using a locally decoded picture obtained as a result of the local decoding to obtain second encoded data, and multiplexing said first encoded data and said second encoded data.
A method for recording encoded data obtained on predictive coding a picture, in which said encoded data is obtained by predictive coding said picture by utilizing a detected motion vector of said picture to obtain first encoded data, locally decoding said first encoded data, predictive coding said picture using a locally decoded picture obtained as a result of the local decoding to obtain second encoded data, and multiplexing said first encoded data and said second encoded data.
A device for encoding data of one or more pictures in which the pictures of two or more layers may represent an I-picture obtained by intra-coding, a P-picture obtained by intra-coding or forward predictive coding, and a B-picture obtained by intra-coding, forward predictive coding, backward predictive coding, or bidirectionally predictive coding, and are encoded on a macro-block basis, wherein whether or not a macro-block is a skip macro-block is determined based on reference picture information which specifies a reference picture used in encoding a macro-block of said B-picture by one of the forward predictive coding, the backward predictive coding, or the bidirectionally predictive coding.
A method for encoding data of one or more pictures in which the pictures of two or more layers may represent an I-picture obtained by intra-coding, a P-picture obtained by intra-coding or forward predictive coding, and a B-picture obtained by intra-coding, forward predictive coding, backward predictive coding, or bidirectionally predictive coding, and are encoded on a macro-block basis, wherein whether or not a macro-block is a skip macro-block is determined based on reference picture information which specifies a reference picture used in encoding a macro-block of said B-picture by one of the forward predictive coding, the backward predictive coding, or the bidirectionally predictive coding.
A picture decoding device for decoding encoded data of one or more pictures in which the pictures of two or more layers may represent an I-picture obtained by intra-coding, a P-picture obtained by intra-coding or forward predictive coding, and a B-picture obtained by intra-coding, forward predictive coding, backward predictive coding, or bidirectionally predictive coding, and decoding the pictures on a macro-block basis, wherein
- whether or not a macro-block is a skip macro-block is determined based on reference picture information which specifies a reference picture used in encoding a macro-block of said B-picture by one of the forward predictive coding, the backward predictive coding, or the bidirectionally predictive coding.
A picture decoding method for decoding encoded data of one or more pictures in which the pictures of two or more layers may represent an I-picture obtained by intra-coding, a P-picture obtained by intra-coding or forward predictive coding, and a B-picture obtained by intra-coding, forward predictive coding, backward predictive coding, or bidirectionally predictive coding, and decoding the pictures on a macro-block basis, wherein whether or not a macro-block is a skip macro-block is determined based on reference picture information which specifies a reference picture used in encoding a macro-block of said B-picture by one of the forward predictive coding, the backward predictive coding, or the bidirectionally predictive coding.
A recording medium having recorded thereon encoded data of one or more pictures in which the pictures of two or more layers may represent an I-picture obtained by intra-coding, a P-picture obtained by intra-coding or forward predictive coding, and a B-picture obtained by intra-coding, forward predictive coding, backward predictive coding, or bidirectionally predictive coding, in which the picture data is encoded on a macro-block basis, wherein whether or not a macro-block is a skip macro-block is determined based on reference picture information which specifies a reference picture used in encoding a macro-block of said B-picture by one of the forward predictive coding, the backward predictive coding, or the bidirectionally predictive coding.
A recording method for recording encoded data of one or more pictures in which the pictures of two or more layers may represent an I-picture obtained by intra-coding, a P-picture obtained by intra-coding or forward predictive coding and a B-picture obtained by intra-coding , forward predictive coding, backward predictive coding, or bidirectionally predictive coding, in which the picture data is encoded on a macro-block basis, wherein whether or not a macro-block is a skip macro-block is determined based on reference picture information which specifies a reference picture used in encoding a macro-block of said B-picture by one of the forward predictive coding, the backward predictive coding, or the bidirectionally predictive coding.
A picture processing device for variable length encoding or variable length decoding a picture changed in size by use of a pre-set table which is modified in accordance with changes in the size of said picture.
A picture processing method for variable length encoding or variable length decoding a picture changed in size by use of a pre-set table, said method comprising the steps of:
- judging whether or not said picture is changed in size;
- and
- modifying said pre-set table used for variable length encoding or variable length decoding in accordance with changes in the size of said picture.
A picture processing device for variable length encoding or variable length decoding encoded data obtained by predictive coding a picture of two or more layers by use of a pre-set table, wherein said pre-set table is modified according to whether or not a picture having a layer different from and a timing the same as the layer of a picture being encoded has been used as a reference picture.
A picture processing method for variable length encoding or variable length decoding encoded data obtained by predictive coding a picture of two or more layers by use of a pre-set table, comprising the steps of modifying said pre-set table used for variable length encoding or variable length decoding according to whether or not a picture having a layer different from and a timing the same as the layer of a picture being encoded has been used as a reference picture.
A picture encoding device for quantizing a picture by a pre-set quantization step comprising a multiplexing device for multiplexing results of quantization of said picture and said pre-set quantization step, in which said pre-set quantization step is quantized only if all of the results of quantization of pixel values in a pre-set block of said picture are not all of the same value.
A picture decoding device for decoding encoded data obtained by quantizing a picture by a pre-set quantization step and multiplexing results of quantization of said picture and said pre-set quantization step, wherein said encoded data includes said pre-set quantization step only if all of the results of quantization of pixel values in a pre-set block of said picture are not all of the same value.
A picture decoding method for decoding encoded data obtained by quantizing a picture by a pre-set quantization step and multiplexing results of quantization of said picture and said pre-set quantization step, wherein said encoded data includes said pre-set quantization step only if all of the results of quantization of pixel values in a pre-set block of said picture are not all of the same value.
A recording medium having recorded thereon encoded data obtained by quantizing a picture by a pre-set quantization step and multiplexing results of quantization of said picture and said pre-set quantization step, wherein said encoded data includes said pre-set quantization step only if all of the results of quantization of pixel values in a pre-set block of said picture are not all of the same value.
A recording method for recording encoded data obtained by quantizing a picture by a pre-set quantization step and multiplexing results of quantization of said picture and said pre-set quantization step, wherein said encoded data includes said pre-set quantization step only if all of the results of quantization of pixel values in a pre-set block of said picture are not all of the same value.
Dependencies are inferred from the claim text.