US 2014/0153651 A1 · METHOD AND APPARATUS FOR REFRAMING AND ENCODING A VIDEO SIGNAL

Abstract

Reframing is used to re-size an image or video content, e.g. for displaying video signals with a given aspect ratio on a display having a different aspect ratio. Window cropping parameters (position and size over time) are constrained in order to optimise the rate/distortion of the encoded output video signal. Initial reframing is improved by computing a saliency map representing a user attention map which considers the video coding context and by providing a macroblock coding efficiency cost map and then taking the saliency map or a combined saliency/coding cost map into account so that the coding cost for said reframed video signal is smaller than the coding cost for other candidate reframing windows' sizes and positions.

Claims18

Dependent claims

1-10. (canceled)

Method for reframing an original video signal, followed by an encoding of the reframed video signal, said method including the steps:

computing a saliency map for a current picture of said original video signal, said saliency map representing a user attention map;
providing a macroblock coding efficiency cost map for said current picture of said original video signal;
selecting a candidate reframing window size and position within said current picture of said original video signal;
by using said saliency map or said combined saliency and macroblock coding efficiency cost map, determining in said original video signal a different position and/or size of the reframing window, for which different position and/or size the coding cost for said reframed video signal are smaller than the coding cost for said candidate reframing window size and position;
encoding said corresponding reframed video signal.

2 more elements

Apparatus for reframing an original video signal, followed by an encoding of the reframed video signal, said apparatus including:

computing means which compute a saliency map for a current picture of said original video signal, and for providing a macroblock coding efficiency cost map for said current picture, said saliency map representing a user attention map;
selecting means which select a candidate reframing window size and position within said current picture of said original video signal, and for determining in said original video signal a different position and/or size of the reframing window, by using said saliency map or said combined saliency and macroblock coding efficiency cost map, for which different position and/or size the coding cost for said reframed video signal are smaller than the coding cost for said candidate reframing window size and position;
encoding means for said corresponding reframed video signal.

Dependencies are inferred from the claim text.

Facts

Application

14/233,556Filed 25 Jun 2012

Priority

EP 11305937.219 Jul 2011

Published

5 Jun 2014

Term ends

Not estimatedThe source records don’t support an estimate.

Classification9 codes

H04N 7/01
Television systems: conversion of standards , e.g. involving analogue television standards or digital television standards processed at pixel level
H04N 19/115
Characterised by the element, parameter or selection affected or controlled by the adaptive coding: selection of the code volume for a coding unit…
H04N 19/14
Incoming video signal characteristics or properties: coding unit complexity, e.g. amount of activity or edge presence estimation
H04N 19/154
Characterised by the element, parameter or criterion affecting or controlling the adaptive coding: measured or subjectively estimated visual…

Method and apparatus for reframing and encoding a video signal

Life of this patent

Method and apparatus for reframing and encoding a video signal

Life of this patent

Abstract

Claims18