Method for video error concealment by updating statistics
AssigneeIndustrial Technology Research Institute
InventorsTsuhan Chen, Trista Pei-Chun Chen, Yuh-Feng Hsu
Life of this patent
Estimating the term…
Abstract
A method of error concealment that includes providing a first set of image data at a first time instant, providing a second set of image data at a second time instant, representing the first set of image data by a model of updating mixture of principal components (UMPC) to form a UMPC model having a plurality of components, receiving the second set of image data, wherein the second set of image data contains error-free data, and updating the UMPC model using the error-free data at the second time instant.
Claims12
A method of error concealment, comprising:
- providing a first set of image data at a first time instant;
- providing a second set of image data at a second time instant;
- representing the first set of image data by a model of updating a mixture of principal components (UMPC) to form a UMPC model having a plurality of components;
- receiving the second set of image data, wherein the second set of image data contains error-free data;
- and
- updating the UMPC model using the error-free data at the second time instant,
- wherein minimizing the error of representation of the error-free data at the second time instant by the UMPC model is achieved through iteration of the following:
- min
- m
- j
- (
- n
- )
- ,
- U
- j
- (
- n
- )
- ,
- w
- i
- ∀
- i
- ,
- j
-
- (
- 1
- ∑
- i
- =
- 0
- ∞
-
- α
- i
- )
-
- ∑
- i
- =
- 0
- ∞
-
- α
- i
-
-
- x
- n
- -
- i
- -
- ∑
- j
- =
- 1
- M
-
- w
- n
- -
- i
- ,
- j
- [
- m
- j
- (
- n
- )
- +
- ∑
- k
- =
- 1
- P
-
- [
- (
- x
- n
- -
- i
- -
- m
- j
- (
- n
- )
- )
- T
-
- u
- jk
- (
- n
- )
- ]
-
- u
- jk
- (
- n
- )
- ︸
- x
- ^
- n
- -
- i
- ,
- j
- ]
-
- 2
- wherein
- n and i are time;
- M is a number of components in the UMPC;
- xi is a data vector at time i;
- mjn is a mean of the jth mixture component estimated at time n;
- ujk(n) is a kth eigen-vector of the jth mixture component estimated at time n;
- Uj(n) is a matrix with P columns of ujk(n) , wherein k=1˜P;
- {circumflex over (x)}ij is a reconstruction of xi with mixture component j;
- {circumflex over (x)}i is a matrix with M columns of {circumflex over (x)}ij, j=1˜M;
- w ij is a weight of {circumflex over (x)}^ij to reconstruct xi;
- wi is a vector with M entries of wij;
- αis a decay factor, wherein 0<α<1;
- and
- q, r are indices of the mixture component.
A method of error concealment, comprising:
- representing a set of image data by a model of updating mixture of principal components (UMPC), each principal component of the UMPC model having a mean, a set of eigenvectors, and a weight at any given time instant, wherein the UMPC model is used for concealing video errors;
- providing the set of image data at a first time instant and at any time instant before the first time instant;
- receiving the set of image data at a second time instant, wherein the set of image data at the second time instant contains at least one error-free region of interest (ROI);
- updating the UMPC model to minimize a representation error of the at least one error-free ROI at the second time instant by the UMPC model;
- receiving the set of image data at a third time instant, wherein the set of image data at the third time instant contains at least one corrupted ROI;
- and
- reconstructing the at least one corrupted ROI at the third time instant using the updated UMPC model at the second time instant, comprising:
- reconstructing the at least one corrupted ROI using each component of the updated UMPC model;
- and
- combining the reconstructed ROI from each component for the at least one corrupted ROI;
- wherein a combination coefficient of the reconstructed ROI from each component is inversely proportional to a reconstruction error of the representation of the corrupted ROI with the each component.
Dependencies are inferred from the claim text.