Back to results
US 11,153,606 B2Granted
Face region detection based light field video compression
AssigneeShanghaitech University
InventorsZhiru Shi, Qiang Hu
Life of this patent
Estimating the term…
Abstract
A method of perceptual video coding based on face detection is provided. The method includes calculating a bit allocation scheme for coding a light field video based on a saliency map of the face, calculating an LCU level Lagrange multiplier for coding a light field video based on a saliency map of the face and calculating an LCU level quantization parameter for coding a light field video based on a saliency map of the face.
Claims18
A method of light field video coding, comprising:
- determining a region of interest in a light field video;
- assigning a visual attention value to the region of interest, wherein the visual attention value is different from that for other regions of the light field video;
- calculating a bit allocation scheme based on the visual attention value of the region of interest, wherein the bit allocation scheme is calculated in accordance to:
- R
- n
- ′
- =
- A
- n
- ∑
- i
- =
- 1
- N
-
- A
- i
- *
-
- R
- frame
- A
- n
- =
- ∑
- i
- =
- 1
- N
- b
-
- f
- i
- N
- b
- wherein Rframe is the total bits of a video frame, N is the number of coding units in a video frame, Rn is the allocated bits for the nth coding unit, An represents the visual attention value of the nth coding unit in a video frame, fi is the visual attention value of a pixel, and denotes the set of blocks in a coding unit area, and Nb is the number of pixels in the coding unit;
- and
- encoding the light field video based on the bit allocation scheme.
35 more elements
A light field video system, comprising:
- a light field array system for capturing a plurality of videos and a plurality of depth maps to generate a light field video;
- a processer;
- and
- a memory that stores at least one program to control the light field video system, wherein the processor is configured to execute the program for:
- determining a region of interest in the light field video;
- assigning a visual attention value to the region of interest, wherein the visual attention value is different from that for other regions of the light field video;
- calculating a bit allocation scheme based on the visual attention value of the region of interest, wherein the bit allocation scheme is calculated in accordance to:
- R
- n
- ′
- =
- A
- n
- ∑
- i
- =
- 1
- N
-
- A
- i
- *
-
- R
- frame
- A
- n
- =
- ∑
- i
- =
- 1
- N
- b
-
- f
- i
- N
- b
- wherein Rframe is the total bits of a video frame, N is the number of coding units in a video frame, Rn is the allocated bits for the nth coding unit, An represents the visual attention value of the nth coding unit in a video frame, fi is the visual attention value of a pixel, and denotes the set of blocks in a coding unit area, and Nb is the number of pixels in the coding unit;
- and
- encoding the light field video based on the bit allocation scheme.
39 more elements
Dependencies are inferred from the claim text.