Encoding/decoding digital frames by down-sampling/up-sampling with enhancement information
AssigneeSony Interactive Entertainment Inc.
InventorRathish Krishnan
Life of this patent
Estimating the term…
Abstract
Input digital frames may be down-sampled to create one or more base frames characterized by a lower resolution than the input digital frames. Enhancement information corresponding to a difference between pixel values for the one or more input digital frames and corresponding pixel values of up-sampled versions of the one or more base frames is then created. The one base frames are encoded to form a set of base data and the enhancement information is encoded to form a set of enhancement data. The base data and enhancement data may then be transmitted over a network or stored in a memory.
Claims78
A method for encoding one or more input digital frames, comprising:
- down-sampling the one or more input digital frames to create one or more base frames characterized by a lower resolution than the input digital frames;
- creating enhancement information corresponding to a difference between pixels values of the one or more input digital frames and corresponding pixel values of up-sampled versions of the one or more base frames;
- encoding the one or more base frames to form a set of base data;
- encoding the enhancement information to form a set of enhancement data;
- and
- transmitting the set of base data and the set of enhancement data over a network or storing the set of base data and the set of enhancement data in a memory.
A system, comprising:
- a processor module;
- a memory coupled to the processor, wherein the memory contains executable instructions configured to implement a method, the method comprising:
- down-sampling one or more input digital frames to create one or more base frames characterized by a lower resolution than the input digital frames;
- creating enhancement information corresponding to a difference between pixels values of the one or more input digital frames and corresponding pixel values of up-sampled versions of the one or more base frames;
- encoding the one or more base frames to form a set of base data;
- encoding the enhancement information to form a set of enhancement data;
- and
- transmitting the set of base data and the set of enhancement data over a network or storing the set of base data and the set of enhancement data in a memory.
A non-transitory computer readable medium having embodied therein computer readable instructions configured, to implement a method, the method comprising:
- down-sampling one or more input digital frames to create one or more base frames characterized by a lower resolution than the input digital frames;
- creating enhancement information corresponding to a difference between pixel values of the one or more input digital frames and corresponding pixel values of up-sampled versions of the one or more base frames;
- encoding the one or more base frames to form a set of base data;
- encoding the enhancement information to form a set of enhancement data;
- and
- transmitting the set of base data and the set of enhancement data over a network or storing the set of base data and the set of enhancement data in a memory.
A method for decoding an input set of data containing one or more encoded digital frames including a set of base data containing one or more encoded base frames corresponding to one or more down-sampled input digital frames, wherein the one or more base frames are characterized by a lower resolution than the input digital frames and a set of enhancement data containing encoded enhancement information corresponding to a difference between pixel values of the one or more input digital frames and corresponding pixel values of up-sampled versions of the one or more base frames, the method comprising:
- decoding the one or more encoded base frames in the set of base data with a decoder to generate the one or more base frames;
- decoding the encoded enhancement information in the set of enhancement data with a decoder to generate the enhancement information;
- reconstructing the input digital frames from the one or more base frames and the enhancement information with a decoder;
- and
- displaying the input digital frames with a display or storing the input digital frames in a memory.
A system, comprising:
- a processor module;
- a memory coupled to the processor, wherein the memory contains executable instructions configured to implement a method for decoding an input set of data containing one or more encoded digital frames including a set of base data containing one or more encoded base frames corresponding to one or more down-sampled input digital frames, wherein the one or more base frames are characterized by a lower resolution than the input digital frames and a set of enhancement data containing enhancement information corresponding to a difference between pixel values of the one or more input digital frames and corresponding pixel values of up-sampled versions of the one or more base frames, the method comprising:
- decoding the one or more encoded base frames in the set of base data with a decoder to generate the one or more base frames;
- decoding the encoded enhancement information in the set of enhancement data with a decoder to generate the enhancement information;
- reconstructing the input digital frames from the one or more base frames and the enhancement information with a decoder;
- and
- displaying the input digital frames with a display or storing the input digital frames in a memory.
A non-transitory computer readable medium having embodied therein computer readable instructions configured, to implement a method for decoding an input set of data containing one or more encoded digital frames including a set of base data containing one or more encoded base frames corresponding to one or more down-sampled input digital frames, wherein the one or more base frames are characterized by a lower resolution than the input digital frames and a set of enhancement data containing enhancement information corresponding to a difference between pixel values of the one or more input digital frames and corresponding pixel values of up-sampled versions of the one or more base frames, the method comprising:
- decoding the one or more encoded base frames in the set of base data with a decoder to generate the one or more base frames;
- decoding the encoded enhancement information in the set of enhancement data with a decoder to generate the enhancement information;
- reconstructing the input digital frames from the one or more base frames and the enhancement information with a decoder;
- and
- displaying the input digital frames with a display or storing the input digital frames in a memory.
A method for decoding an input set of data containing one or more encoded digital frames including a set of base data containing one or more encoded base frames corresponding to one or more down-sampled input digital frames, wherein the one or more base frames are characterized by a lower resolution than the input digital frames and a set of enhancement data containing enhancement information corresponding to a difference between pixel values of the one or more input digital frames and corresponding pixel values of up-sampled versions of the one or more base frames, the method comprising:
- decoding the set of base data with a decoder to generate the one or more base frames;
- ignoring the set of enhancement data;
- and
- displaying the one or more base frames with a display or storing the one or more base frames in a memory.
A system, comprising:
- a processor module;
- a memory coupled to the processor, wherein the memory contains executable instructions configured to implement a method for decoding an input set of data containing one or more encoded digital frames including a set of base data containing one or more encoded base frames corresponding to one or more down-sampled input digital frames, wherein the one or more base frames are characterized by a lower resolution than the input digital frames and a set of enhancement data containing enhancement information corresponding to a difference between pixel values of the one or more input digital frames and corresponding pixel values of up-sampled versions of the one or more base frames, the method comprising:
- decoding the set of base data with a decoder to generate the one or more base frames;
- ignoring the set of enhancement data;
- and
- displaying the one or more base frames with a display or storing the one or more base frames in a memory.
A non-transitory computer readable medium having embodied therein computer readable instructions configured, to implement a method for decoding an input set of data containing one or more encoded digital frames including a set of base data containing one or more encoded base frames corresponding to one or more down-sampled input digital frames, wherein the one or more base frames are characterized by a lower resolution than the input digital frames and a set of enhancement data containing enhancement information corresponding to a difference between pixel values of the one or more input digital frames and corresponding pixel values of up-sampled versions of the one or more base frames, the method comprising:
- decoding the set of base data with a decoder to generate the one or more base frames;
- ignoring the set of enhancement data;
- and
- displaying the one or more base frames with a display or storing the one or more base frames in a memory.
Dependencies are inferred from the claim text.