US 2017/0374347 A1 · 3D-HEVC inter-frame information hiding method based on visual perception

Abstract

A 3D-HEVC inter-frame information hiding method based on visual perception includes steps of information embedding and information extraction. In the step of information embedding, the human visual perception characteristic is considered, stereo salient images are obtained by a stereo image salient model, and the stereo salient images are divided into salient blocks and non-salient blocks with an otsu threshold. The coding quantization parameters are modified according to different modulation rules for different regions. Then, based on the modified quantization parameters, the coding-tree-units are coded to complete the information embedding. In the step of information extraction, no original video is needed, no any side information needs to be transmitted, and the secret information can be blindly extracted. The present invention combines with the human visual perception characteristic, and selects P frames and B frames as embedded frames for effectively reducing the decrease of the stereo video subjective quality.

A 3D-HEVC (Three Dimensional High Efficiency Video Coding) inter-frame information hiding method based on visual perception comprising steps of information embedding and information extraction, wherein:

the step of information embedding comprises:
(1A) at an information embedding terminal, taking Sorg as an original stereo video, recording a left view color video of the Sorg as Lorg, recording a right view color video of the Sorg as Rorg, and taking W as secret information to be embedded, wherein:
W is a binary number which contains nW bits, W=wnW wnW-1 . . . wi . . . w2w1, a width of both a left view color image of the Lorg and a right view color image of the Rorg is M, a height thereof is N, both the M and the N can be divisible by 64, a total frame number of both all left view color images of the Lorg and all right view color images of the Rorg is F, here, F≧1, is a integer and
n
W
∈
[
2
,
2
×
M
×
N
×
F
64
×
64
]
,
wnW wnW-1 . . . wi . . . w2w1 respectively represent a value of (nW)th bit, a value of a (nW−1)th bit, . . . , a value of an ith bit, a value of a second bit and a value of a first bit, each of the wnW wnW−1 . . . wi . . . w2w1 is 0 or 1, 1≦i≦nW;
(1B) obtaining a stereo saliency image of each left view color image of the Lorg through a stereo image saliency model, recording a stereo saliency image of a jth left view color image of the Lorg as Lorg,ju, calculating an otsu threshold of the stereo saliency image of each left view color image of the Lorg, and recording the otsu threshold of the Lorg,ju as yjL, wherein 1≦j≦F,
also, obtaining a stereo saliency image of each right view color image of the Rorg through the stereo image saliency model, recording a stereo saliency image of a jth right view color image of the Rorg as Rorg,j,u, calculating an otsu threshold of the stereo saliency image of each right view color image of the Rorg, and recording the otsu threshold of the Rorg,ju as yjR;
(1C) dividing the stereo saliency image of each left view color image of the Lorg into non-overlapped
(
M
64
×
N
64
)
image blocks each of which has a size of 64×64, recording a kth image block of the Lorg,ju as Borg,j,kL, calculating a mean value of pixel values of all pixels of each image block of the stereo saliency image of each left view color image of the Lorg recording the mean value of the pixel values of all the pixels of the Borg,j,kL as qj,kL, determining whether each image block of the stereo saliency image of each left view color image of the Lorg is a salient block or a non-salient block according to the mean value of the pixel values of all the pixels of each image block of the stereo saliency image of each left view color image of the Lorg and the otsu threshold of the stereo saliency image of each left view color image of the Lorg, wherein:
if the qj,kL is larger than or equal to the yjL, the Borg,j,kL is determined to be the salient block, if the qj,kL is smaller than the yjL, the Borg,j,kL is determined to be the non-salient block, here,
1
≤
k
≤
M
64
×
N
64
,
also, dividing the stereo saliency image of each right view color image of the Rorg into non-overlapped
(
M
64
×
N
64
)
image blocks each of which has a size of 64×64, recording a kth image block of the Rorg,ju as Rorg,j,kR, calculating a mean value of pixel values of all pixels of each image block of the stereo saliency image of each right view color image of the Rorg, recording the mean value of the pixel values of all the pixels of the Borg,j,kR as qj,kR, determining whether each image block of the stereo saliency image of each right view color image of the Rorg is a salient block or a non-salient block according to the mean value of the pixel values of all the pixels of each image block of the stereo saliency image of each right view color image of the Rorg and the otsu threshold of the stereo saliency image of each right view color image of the Rorg, wherein:
if the qj,kR is larger than or equal to the yjR, the Borg,j,kR is determined to be the salient block, if the qj,kR is smaller than the yjR, the Borg,j,kR is determined to be the non-salient block;
(1D) generating a binary pseudorandom sequence which contains nW bits through logistics chaotic mapping, taking the binary pseudorandom sequence as a secret key and recording the secret key as E, here, E=enW enW-1 . . . ei . . . e2e1, perform an XOR (exclusive OR) operation on a value of each bit of the W and a value of each corresponding bit of the E, obtaining an XOR result, taking the XOR result as encrypted information and recording the encrypted information as W′, here, W′=w′nW w′nW-1 . . . w′i . . . w′2 w′1, wherein:
the enW enW-1 . . . ei . . . e2e1 respectively represent a value of the (nW)th bit, a value of the (nW−1)th bit, . . . , a value of the (i)th bit, . . . a value of the second bit and a value of the first bit of the E, each of the enW enW-1 . . . ei . . . e2e1 is 0 or 1, w′nW w′nW-1 . . . w′i . . . w′2 w′1 respectively represent a value of the (nW)th bit, a value of the (nW−1)th bit, . . . , a value of the (i)th bit, . . . a value of the second bit and a value of the first bit of the W′, each of the w′nW w′nW-1 . . . w′i . . . w′2 w′1 is 0 or 1, w is an XOR value of the wi and the ei;
(1E) coding the Lorg and the Rorg in frame through a 3D-HEVC standard coding platform, defining a jth left view color image of the Lorg to be coded or a jth right view color image of the Rorg to be coded as a current frame and recording the current frame as Pj, wherein an initial value of the j is 1;
(1F) judging whether the Pj is a P-frame or a B-frame, wherein if it is, step (1G) is executed, if it is not, step (11) is executed;
(1G) coding the Pj in coding-tree-unit, defining a kth coding-tree-unit to be coded of the Pj as a current coding block and recording the current coding block as Borg,j,k, wherein
1
≤
k
≤
M
64
×
N
64
,
here an initial value of the k is 1;
(1H-a) reading coding quantization parameter of the Borg,j,k and recording the coding quantization parameter as QPorg,j,k, reading a value w′i′ of a i′th bit of the W′ and a value w′i′+1 of a (i′+1)th bit of the W′, transforming the w′i′+1 and the w′i′ into decimal values and recording the decimal value as di′, here,
d
i
′
=
{
0
w
i
′
+
1
′

w
i
′
′
=
00
1
w
i
′
+
1
′

w
i
′
′
=
01
2
w
i
′
+
1
′

w
i
′
′
=
10
3
w
i
′
+
1
′

w
i
′
′
=
11
,
wherein an initial value of the i′ is 1, 1≦i′≦nW−1, and each of w′i′ and w′i′+1 is 0 or 1;
(1H-b) when the Pj is the jth left view color image of the Lorg, judging whether a remainder result of the QPorg,j,k to 4 is equal to the di′, wherein if the remainder result is not equal to the di′, when the Borg,j,kL is a salient block, the QPorg,j,k is downwardly modulated by the w′i′ and the w′i′+1, so that coding quantization parameter embedded with secret information of the Borg,j,k is obtained and recorded as QP′org,j,k, and then step (1H-c) is executed;
when the Borg,j,kL is a non-salient block, the QPorg,j,k is upwardly modulated by the w′i′ and the w′i′+1, so that the coding quantization parameter embedded with secret information of the Borg,j,k is obtained and recorded as the QP′org,j,k, and then the step (1H-c) is executed;
if the remainder result is equal to the di′, the QPorg,j,k is directly recorded as the coding quantization parameter embedded with secret information of the Borg,j,k which is denoted as the QP′org,j,k, QP′org,j,k=QPorg,j,k, and then the step (1H-c) is executed, here, “=” is an assignment symbol in the QP′org,j,k=QPorg,j,k;
when the Pj is the jth right view color image of the Rorg, judging whether a remainder result of the QPorg,j,k to 4 is equal to the di′, wherein if the remainder result is not equal to the di′, when the Borg,j,kR is a salient block, the QPorg,j,k is downwardly modulated by the w′i′ and the w′i′+1, so that coding quantization parameter embedded with secret information of the Borg,j,k is obtained and recorded as QP′org,j,k, and then the step (1H-c) is executed;
when the Borg,j,kR is a non-salient block, the QPorg,j,k is upwardly modulated by the w′i′ and the w′i′+1, so that the coding quantization parameter embedded with secret information of the Borg,j,k is obtained and recorded as the QP′org,j,k, and then the step (1H-c) is executed;
if the remainder result is equal to the di′, the QPorg,j,k is directly recorded as the coding quantization parameter embedded with secret information of the Borg,j,k which is denoted as the QP′org,j,k, QP′org,j,k=QPorg,j,k, and then the step (1H-c) is executed;
(1H-c) judging whether the QP′org,j,k is in a range of [0, 51], wherein if it is, step (1H-d) is executed;
otherwise, when QP′org,j,k>51, the QPorg,j,k is downwardly modulated by the w′i′ and the w′i′+1, the coding quantization parameter embedded with secret information QP′org,j,k of the Borg,j,k is obtained again, and then the step (1H-d) is executed;
when QP′org,j,k<0, the QPorg,j,k is upwardly modulated by the w′i′ and the w′i′+1, the coding quantization parameter embedded with secret information QP′org,j,k of the Borg,j,k is obtained again, and then the step (1H-d) is executed;
(1H-d) coding the Borg,j,k with the QP′org,j,k, completing a secret information embedded process of the Borg,j,k, after completing coding of the Borg,j,k, judging whether the Borg,j,k is a skip block, wherein if it is, step (1H-e) is directly executed, otherwise, i′=i′+2 is set, the step (1H-e) is executed, here, “=” is an assignment symbol in the i′=i′+2;
(1H-e) setting k=k+1, regarding a next coding-tree-unit to be coded of the Pj as a current coding block and recording the next coding-tree-unit to be coded as Borg,j,k, returning to the step (1H-a) to continue till all coding-tree-units of the Pj are completely coded, executing step (1I), wherein “=” is an assignment symbol in the k=k+1;
(11) setting j=j+1, regarding a next left view color image to be coded of the Lorg or a next right view color image to be coded of the Rorg as a current frame and recording the current frame as Pj, returning to the step (1F) and continuing till all left view color images in the Lorg and all right view color images in the Rorg are completely coded, and obtaining video stream embedded with secret information, wherein “=” is an assignment symbol in the j=j+1;
and
(1J) sending initial value information which generates the secret key E to an information extraction terminal;
the step of information extraction comprises:
(2A) defining the video stream embedded with secret information received at an information extraction terminal as a target video stream and recording the target video stream as str.bindec;
(2B) according to the initial value information which generates the secret key E sent from an information embedding terminal, through the logistics chaotic mapping, generating a secret key E which is same as that of the information embedding terminal;
(2C) parsing the str.bindec frame by frame, and defining a frame to be parsed in the str.bindec as a current frame;
(2D) judging the current frame is a P-frame or B-frame, wherein if it is, step (2E) is executed, otherwise, step (2H) is executed;
(2E) parsing the current frame coding-tree-unit by coding-tree-unit, and defining a coding-tree-unit to be parsed in the current frame as a current parsing block;
(2F) judging whether the current parsing block is a skip block, wherein if it is, step (2G) is executed, otherwise, coding quantization parameter embedded with secret information of the current parsing block are parsed and recorded as QP′dec and then a remainder result of QP′dec to 4 is calculated and recorded as d′dec, wherein the d′dec is 0, 1, 2 or 3, and then the decimal d′dec is transformed to binary number, values of two bits extracted from the current parsing block are obtained, such that a secret information extraction process of the current parsing block is completed, and then the step (2G) is executed;
(2G) regarding a next coding-tree-unit to be parsed of the current frame as a current parsing block, and then returning to the step (2F) till all coding-tree-units of the current frame are completely processed, and then step (2H) is executed;
(2H) regarding a next frame to be parsed of the str.bindec as a current frame, and then returning to the step (2D) till all frames of the str.bindec are completely processed, such that secret information extraction is completed;
and
(21) defining extracted values of nW, bits as encrypted information and recording the encrypted information as W′dec, here, W′dec=w′dec,nW w′dec,nW-1 . . . w′dec,i . . . w′dec,2 w′dec,1, and then perform an XOR (exclusive OR) operation on a value of each bit of the W′dec and a value of each corresponding bit of the E, obtaining an XOR result, taking the XOR result as decrypt secret information and recording the decrypt secret information as Wdec, here, wherein:
the Wdec=wdec,nW wdec,nW-1 . . . wdec,i . . . wdec,2wdec,1, wherein:
the w′dec,nW w′dec,nW-1 . . . w′dec,i . . . w′dec,2 w′dec,1 respectively represent a value of the (nW)th bit, a value of the (nW−1)th bit, . . . , a value of the (i)th bit, . . . a value of the second bit and a value of the first bit of the W′dec, each of the w′dec,nW w′dec,nW-1 . . . w′dec,i . . . w′dec,2 w′dec,1 is 0 or 1, wdec,nW wdec,nW-1 . . . wdec,i . . . wdec,2wdec,1 respectively represent a value of the (nW)th bit, a value of the (nW−1)th bit, . . . , a value of the (i)th bit, . . . a value of the second bit and a value of the first bit of the Wdec, each of the wdec,nW wdec,nW-1 . . . wdec,i . . . wdec,2wdec,1 is 0 or 1.

158 more elements

3D-HEVC inter-frame information hiding method based on visual perception

Life of this patent

3D-HEVC inter-frame information hiding method based on visual perception

Life of this patent

Abstract

Claims4