# US 2018/0324436 A1 · Encoding a video stream having a privacy mask

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0324436 A1
- Document ID: US20180324436A1
- Status: Published application
- Kind: A1
- Application number: 15/589,350
- Filed: 2017-05-08
- Published: 2018-11-08
- Earliest claimed: 2017-05-08
- Assignees: Axis AB
- Applicants: Axis AB
- Inventors: Xing Danielsson Fan
- Web page: https://patentgrep.com/patent/US20180324436A1

## CPC

- H04N 19/137: Motion inside a coding unit, e.g. average field, frame or block difference
- H04N 19/114: Adapting the group of pictures [GOP] structure, e.g. number of B-frames between two anchor frames (H04N19/107 takes precedence)
- H04N 19/119: Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
- H04N 19/132: Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
- H04N 19/159: Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
- H04N 19/177: the unit being a group of pictures [GOP]
- H04N 19/51: Motion estimation or motion compensation
- H04N 19/527: Global motion vector estimation
- H04N 19/61: in combination with predictive coding
- H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Methods and apparatus, including computer program products, implementing and using techniques for encoding a video sequence having a plurality of image frames, wherein at least some of the image frames include a privacy mask. An original total amount of motion is estimated in a received image frame. A reduced amount of motion is determined in the image frame, based on the estimated total amount of motion for the image frame and the size and position of the privacy mask. The image frames are encoded into a sequence of output image frames, wherein a temporal frame distance is adjusted based on the determined reduced amount of motion

## Claims

### Claim 1

A method for encoding a video sequence comprising a plurality of image frames, wherein at least some of the image frames include a privacy mask, the method comprising:
estimating an original total amount of motion in a received image frame;
determining a reduced amount of motion in the image frame, based on the estimated total amount of motion for the image frame and the size and position of the privacy mask; and
encoding the plurality of image frames into a sequence of output image frames, wherein a temporal frame distance is adjusted based on the determined reduced amount of motion.

### Claim 2 (depends on 1)

The method of claim 1, wherein the temporal frame distance represents a distance between image frames input to an encoder.

### Claim 3 (depends on 1)

The method of claim 1, wherein the temporal distance represents an intra-frame distance in the sequence of output image frames output from an encoder.

### Claim 4 (depends on 1)

The method of claim 1, wherein estimating an original total amount of motion in the received image frame includes:
estimating a motion map of the image frame, the motion map dividing the image frame into blocks, wherein each block contains information about the amount of motion taking place in the block; and
estimating the original total amount of motion in the image frame from the estimated motion in the individual blocks.

### Claim 5 (depends on 4)

The method of claim 4, wherein the privacy mask coincides with one or more blocks of the motion map.

### Claim 6 (depends on 1)

The method of claim 1, further comprising:
receiving data specifying one or more of: the type, size and position of the privacy mask.

### Claim 7 (depends on 1)

The method of claim 1, wherein the privacy mask is one of: an opaque privacy mask, a blurring privacy mask, and a pixelation privacy mask.

### Claim 8 (depends on 7)

The method of claim 7, wherein determining a reduced amount of motion includes deducting from the estimated original total amount of motion all motion occurring behind the opaque privacy mask.

### Claim 9 (depends on 7)

The method of claim 7, wherein determining a reduced amount of motion includes deducting from the estimated original total amount of motion a portion of the motion occurring behind the pixelation privacy mask.

### Claim 10 (depends on 1)

The method of claim 1, wherein the temporal frame distance is adjusted dynamically in response to receiving and determining reduced amounts of motion for additional frames in the video sequence.

### Claim 11

An encoder system for encoding a video sequence comprising a plurality of image frames, wherein at least some of the image frames include a privacy mask, the encoder system comprising:
a motion estimation module configured to:
estimate an original total amount of motion in a received image frame, and determine a reduced amount of motion in the image frame, based on the estimated total amount of motion for the image frame and the size and position of the privacy mask; and
an encoder configured to:
encode the plurality of image frames into a sequence of output image frames, wherein a temporal frame distance is adjusted based on the determined reduced amount of motion.

### Claim 12

A computer program product for encoding a video sequence comprising a plurality of image frames, wherein at least some of the image frames include a privacy mask, the computer program product comprising a non-transitory computer readable storage medium having program code embodied therewith, the program code being executable by a processor to perform a method comprising:
estimating an original total amount of motion in a received image frame;
determining a reduced amount of motion in the image frame, based on the estimated total amount of motion for the image frame and the size and position of the privacy mask; and
encoding the plurality of image frames into a sequence of output image frames, wherein a temporal frame distance is adjusted based on the determined reduced amount of motion.

### Claim 13 (depends on 12)

The computer program product of claim 12, wherein the temporal frame distance represents a distance between image frames input to an encoder.

### Claim 14 (depends on 12)

The computer program product of claim 12, wherein the temporal distance represents an intra-frame distance in the sequence of output image frames output from an encoder.

### Claim 15 (depends on 12)

The computer program product of claim 12, wherein estimating an original total amount of motion in the received image frame includes:
estimating a motion map of the image frame, the motion map dividing the image frame into blocks, wherein each block contains information about the amount of motion taking place in the block; and
estimating the original total amount of motion in the image frame from the estimated motion in the individual blocks.

### Claim 16 (depends on 12)

The computer program product of claim 12, wherein the method further comprises:
receiving data specifying one or more of: the type, size and position of the privacy mask.

### Claim 17 (depends on 12)

The computer program product of claim 12, wherein the privacy mask is an opaque privacy mask and determining a reduced amount of motion includes deducting from the estimated original total amount of motion all motion occurring behind the opaque privacy mask.

### Claim 18 (depends on 12)

The computer program product of claim 12, wherein the privacy mask is a pixilation privacy mask and determining a reduced amount of motion includes deducting from the estimated original total amount of motion a portion of the motion occurring behind the pixelation privacy mask.

### Claim 19 (depends on 12)

The computer program product of claim 12, wherein the temporal frame distance is adjusted dynamically in response to receiving and determining reduced amounts of motion for additional frames in the video sequence.
