Video coding system and method using 3-D discrete wavelet transform and entropy coding with motion information

A video encoder comprising:

• a wavelet transformer to transform frames in a video sequence into multiple sub-bands of coefficients, the wavelet transform using motion information of video objects in the frames, wherein the wavelet transformer is configured to perform a temporal wavelet transform on corresponding pixels in a video object along motion trajectories in a temporal direction to produce frames of temporal wavelet coefficients and to perform a spatial wavelet transform on the frames of the temporal wavelet coefficients to produce multiple sub-bands of wavelet coefficients and wherein the temporal wavelet transform comprises:
• forming a pixel array containing pixels that continue from frame to frame in the video sequence;
• examining a pixel in a frame to determine whether the pixel is a terminating pixel that does not continue to a next frame;
• if the pixel is a terminating pixel, terminating the pixel array;
• and
• if the pixel is not a terminating pixel, adding the pixel to the pixel array;
• and
• a coder to code the coefficients of each sub-band independently bit-plane by bit-plane using different coding primitives, wherein the coding primitives comprise:
• zero coding to code new information about a coefficient that is not yet significant in a previous bit-plane;
• and
• sign coding to code a sign of the coefficient once the coefficient is deemed significant.

A computer-readable storage medium encoding computer-executable instructions that, when executed by one or more processors, perform acts comprising:

• estimate motion trajectories of pixels in a video object from frame to frame in a video sequence;
• perform a temporal wavelet transform on the corresponding pixels along the motion trajectories in a temporal direction to produce frames of temporal wavelet coefficients, the temporal wavelet transform comprising:
• forming a pixel array containing pixels that continue from frame to frame in the video sequence;
• examining a pixel in a frame to determine whether the pixel is a terminating pixel that does not continue to a next frame;
• if the pixel is a terminating pixel, terminating the pixel array;
• and
• if the pixel is not a terminating pixel, adding the pixel to the pixel array;
• perform a spatial wavelet transform on the frames of the temporal wavelet coefficients to produce multiple sub-bands of wavelet coefficients;
• and
• code each sub-band of wavelet coefficients independently bit-plane by bit-plane using different coding primitives, wherein the coding primitives comprise:
• zero coding to code new information about a wavelet coefficient that is not yet significant in a previous bit-plane;
• and
• sign coding to code a sign of the wavelet coefficient once the wavelet coefficient is deemed significant.

A video encoder comprising:

• means for estimating motion trajectories of pixels in a video object from frame to frame in a video sequence;
• means for performing a temporal wavelet transform on the corresponding pixels along the motion trajectories in a temporal direction to produce frames of temporal wavelet coefficients, the temporal wavelet transform comprising;
• forming a pixel array containing pixels that continue from frame to frame in the video sequence;
• examining a pixel in a frame to determine whether the pixel is a terminating pixel that does not continue to a next frame;
• if the pixel is a terminating pixel, terminating the pixel array;
• and
• if the pixel is not a terminating pixel, adding the pixel to the pixel array;
• means for performing a spatial wavelet transform on the frames of the temporal wavelet coefficients to produce multiple sub-bands of wavelet coefficients;
• and
• means for coding each sub-band of wavelet coefficients independently bit-plane by bit-plane using different coding primitives, wherein the coding primitives comprise:
• zero coding to code new information about a wavelet coefficient that is not yet significant in a previous bit-plane;
• and
• sign coding to code a sign of the wavelet coefficient once the wavelet coefficient is deemed significant.

A computer-readable storage medium encoding computer-executable instructions that, when executed by one or more processors, perform acts comprising:

• estimate motion trajectories of pixels in a video object from frame to frame in a video sequence;
• perform a temporal wavelet transform on the corresponding pixels along the motion trajectories in a temporal direction to produce frames of temporal wavelet coefficients, the temporal wavelet transform comprising:
• forming a pixel array containing pixels that continue from frame to frame in the video sequence;
• examining a pixel in a frame to determine whether the pixel is a terminating pixel that does not continue to a next frame;
• if the pixel is a terminating pixel, terminating the pixel array;
• and
• if the pixel is not a terminating pixel, adding the pixel to the pixel array;
• perform a spatial wavelet transform on the frames of the temporal wavelet coefficients to produce multiple sub-bands of wavelet coefficients;
• and
• code each sub-band of wavelet coefficients independently.

A computer-readable storage medium encoding computer-executable instructions that, when executed by one or more processors, perform acts comprising:

• estimate motion trajectories of pixels in a video object from frame to frame in a video sequence;
• perform a temporal wavelet transform on the corresponding pixels along the motion trajectories in a temporal direction to produce frames of temporal wavelet coefficients, the temporal wavelet transform:
• forming a pixel array containing pixels that continue from frame to frame in the video sequence;
• examining a pixel in a frame to determine whether the pixel is a terminating pixel that does not continue to a next frame;
• if the pixel is a terminating pixel, terminating the pixel array;
• and
• if the pixel is not a terminating pixel, adding the pixel to the pixel array;
• perform a spatial wavelet transform on the frames of the temporal wavelet coefficients to produce multiple sub-bands of wavelet coefficients;
• and
• code sub-bands of coefficients produced from transforming video frames in an independent manner such that one sub-band of coefficients is coded independently of another sub-band of coefficients;
• construct a bitstream from the independently coded sub-bands;
• and
• wherein the coefficients of each sub-band are coded bit-plane by bit-plane using different coding primitives, wherein the coding primitives comprise:
• zero coding to code new information about a coefficient that is not yet significant in a previous bit-plane;
• and
• sign coding to code a sign of the coefficient once the coefficient is deemed significant.

A computer-readable storage medium encoding computer-executable instructions that, when executed by one or more processors, perform acts comprising:

• coding sub-bands of coefficients produced from transforming video frames in an independent manner such that one sub-band of coefficients is coded independently of another sub-band of coefficients;
• constructing a bitstream from the independently coded sub-bands;
• wherein the coding comprises assigning contexts to the coefficients of each sub-band based on numbers of significant neighboring samples;
• and
• wherein the sub-bands include an LLL (low-low-low) sub-band and an LLH (low-low-high) sub-band and the contexts are assigned as follows:
• LLL and LLH Sub-bands
• h
• v
• a
• d
• Context
• 2
• x
• x
• x
• 0
• 1
• ≧1
• x
• x
• 0
• 1
• 0
• ≧1
• x
• 1
• 1
• 0
• 0
• x
• 2
• 0
• 2
• 0
• x
• 3
• 0
• 1
• 0
• x
• 4
• 0
• 0
• ≧1
• x
• 5
• 0
• 0
• 0
• 3
• 6
• 0
• 0
• 0
• 2
• 7
• 0
• 0
• 0
• 1
• 8
• 0
• 0
• 0
• 0
• 9
• where “h” represents a number of immediate horizontal neighbors that are significant and 0<h<2, “v” represents a number of immediate vertical neighbors that are significant and 0<v<2, “a” represents a number of immediate temporal neighbors that are significant and 0<a<2, and “d” represents a number of immediate diagonal neighbors that are significant and 0<d<12.

A computer-readable storage medium encoding computer-executable instructions that, when executed by one or more processors, perform acts comprising:

• coding sub-bands of coefficients produced from transforming video frames in an independent manner such that one sub-band of coefficients is coded independently of another sub-band of coefficients;
• constructing a bitstream from the independently coded sub-bands;
• wherein the coding comprises assigning contexts to the coefficients of each sub-band based on numbers of significant neighboring samples;
• and
• wherein the sub-bands include an LHH (low-high-high) sub-band and the contexts are assigned as follows:
• LHH Sub-band
• h
• v + a
• d
• Context
• 2
• x
• x
• 0
• 1
• ≧3
• x
• 0
• 1
• ≧1
• ≧4
• 1
• 1
• ≧1
• x
• 2
• 1
• 0
• ≧4
• 3
• 1
• 0
• x
• 4
• 0
• ≧3
• x
• 5
• 0
• ≧1
• ≧4
• 6
• 0
• ≧1
• x
• 7
• 0
• 0
• ≧4
• 8
• 0
• 0
• x
• 9
• where “h” represents a number of immediate horizontal neighbors that are significant and 0<h<2, “v” represents a number of immediate vertical neighbors that are significant and 0<v<2, “a” represents a number of immediate temporal neighbors that are significant and 0<a<2, and “d” represents a number of immediate diagonal neighbors that are significant and 0<d<12.

A computer-readable storage medium encoding computer-executable instructions that, when executed by one or more processors, perform acts comprising:

• coding sub-bands of coefficients produced from transforming video frames in an independent manner such that one sub-band of coefficients is coded independently of another sub-band of coefficients;
• constructing a bitstream from the independently coded sub-bands;
• wherein the coding comprises assigning contexts to the coefficients of each sub-band based on numbers of significant neighboring samples;
• and
• wherein the sub-bands include an HHH (high-high-high) sub-band and the contexts are assigned as follows:
• d
• h + v + a
• Context
• ≧6
• x
• 0
• ≧4
• ≧3
• 1
• ≧4
• x
• 2
• ≧2
• ≧4
• 3
• ≧2
• ≧2
• 4
• ≧2
• x
• 5
• ≧0
• ≧4
• 6
• ≧0
• ≧2
• 7
• ≧0
• 1
• 8
• ≧0
• 0
• 9
• where “h” represents a number of immediate horizontal neighbors that are significant and 0<h<2, “v” represents a number of immediate vertical neighbors that are significant and 0<v<2, “a” represents a number of immediate temporal neighbors that are significant and 0<a<2, and “d” represents a number of immediate diagonal neighbors that are significant and 0<d<12.