# US 10,313,690 B2 · Systems and methods for reducing artifacts in temporal scalable layers of video

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,313,690 B2
- Document ID: US10313690B2
- Status: Granted
- Kind: B2
- Application number: 15/288,926
- Filed: 2016-10-07
- Published: 2017-04-13
- Granted: 2019-06-04
- Earliest claimed: 2015-10-08
- Assignees: Sharp Kabushiki Kaisha
- Applicants: Sharp Kabushiki Kaisha
- Inventors: Jon Arthur Fairhurst; Christopher Andrew Segall; Sachin G. Deshpande
- Web page: https://patentgrep.com/patent/US10313690B2

## CPC

- H04N 19/198: {including smoothing of a sequence of encoding parameters, e.g. by averaging, by choice of the maximum, minimum or median value}
- H04N 19/117: Filters, e.g. for pre-processing or post-processing (sub-band filter banks H04N19/635)
- H04N 19/126: Details of normalisation or weighting functions, e.g. normalisation matrices or variable uniform quantisers
- H04N 19/172: the region being a picture, frame or field
- H04N 19/187: the unit being a scalable video layer
- H04N 19/31: in the temporal domain
- H04N 19/587: involving temporal sub-sampling or interpolation, e.g. decimation or subsequent interpolation of pictures in a video sequence
- H04N 19/59: involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution
- H04N 19/85: using pre-processing or post-processing specially adapted for video compression
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A device may be configured to receive video data including a sequence of frames. The sequence of video frames may have a high frame rate. A high frame rate may include frame rate of 120 Hz or higher. In one example, for every other frame included in the sequence of frames, the device may generate a modified frame. A modified frame may include a frame based on a weighted average of a current frame and a previous frame.

## Claims

### Claim 1

A method of generating a bitstream including video data having multiple temporal layers, the method comprising:
receiving video data including a sequence of frames having a frame rate of 2*N;
for every other frame included in the sequence of frames, generating a respective modified frame by performing a pixel averaging operation using the frame and its respective previous frame in the video sequence, where the pixel averaging operation includes applying a first weight value to the previous frame and applying a second weight value to the frame and adding the weighed pixel values of the previous frame and the frame;
replacing every other frame included in the sequence of frames with a corresponding generated modified frame to generate a modified sequence of frames having a frame rate of 2*N;
associating each of the generated modified frames within the generated modified sequence of frames with a temporal sub-layer having a frame rate of N;
encoding the generated modified sequence of frames to generate a bitstream of video data; and
outputting the bitstream of video data.

### Claim 2 (depends on 1)

The method of claim 1, wherein the sequence of frames has a frame rate of 120 Hz.

### Claim 3 (depends on 1)

The method of claim 1, wherein the sum of the first weight value and the second weight value equals one.

### Claim 4 (depends on 3)

The method of claim 3, further comprising signaling the first weight value and the second weight value.

### Claim 5 (depends on 4)

The method of claim 4, wherein signaling the first weight value and the second weight value includes signaling the first weight value and the second weight value as part of a service announcement.

### Claim 6

A method of reconstructing video data from a bitstream including video data having multiple temporal layers, the method comprising:
receiving a bitstream of video data including a sequence of frames having a frame rate of 2*N and wherein every other frame is associated with a temporal sub-layer having a frame rate of N;
for every other frame included in the sequence of frames, generating a reconstructed frame by performing an inverse pixel averaging operation using the frame and its respective previous frame in the video sequence, where the inverse pixel averaging operation includes applying a first weight value to the previous frame, subtracting weighted previous frame from the frame, and dividing the resulting difference value by a second weight value;
replacing every other frame included in the sequence of frames with a corresponding reconstructed frame to generate a sequence of frames having a frame rate of 2*N.

### Claim 7 (depends on 6)

The method of claim 6, wherein the sum of the first weight value and the second weight value equals one.

### Claim 8

A device for reconstructing video data from a bitstream including video data having multiple temporal layers, the device comprising one or more processors configured to:
receive a bitstream of video data including a sequence of frames having a frame rate of 2*N and wherein every other frame is associated with a with a temporal sub-layer having a frame rate of N;
for every other frame included in the sequence of frames, generating a reconstructed frame by performing an inverse pixel averaging operation using the frame and its respective previous frame in the video sequence, where the inverse pixel averaging operation includes applying a first weight value to the previous frame, subtracting weighted previous frame from the frame, and dividing the resulting difference value by a second weight value;
replacing every other frame included in the sequence of frames with a corresponding reconstructed frame to generate a sequence of frames having a frame rate of 2*N.

### Claim 9 (depends on 8)

The device of claim 8, wherein the sum of the first weight value and the second weight value equals one.

### Claim 10 (depends on 9)

The device of claim 9, wherein the second weight value is determined as having one of the following values: 1/1.25, 1/1.5, 1/1.75, and ½.

### Claim 11 (depends on 3)

The method of claim 3, wherein the second weight has a value of 1/1.25.

### Claim 12 (depends on 3)

The method of claim 3, wherein the second weight has a value of 1/1.5.

### Claim 13 (depends on 3)

The method of claim 3, wherein the second weight has a value of 1/1.75.

### Claim 14 (depends on 3)

The method of claim 3, wherein the second weight has a value of ½.

### Claim 15 (depends on 4)

The method of claim 4, wherein signaling the first weight value and the second weight value include signaling the first weight and the second weight as a two-bit value.

### Claim 16 (depends on 15)

The method of claim 15, wherein a two-bit value of ‘11’ indicates that the first weight has a value of 0.5.

### Claim 17 (depends on 6)

The method of claim 6, wherein the sequence of frames has a frame rate of 120 Hz.

### Claim 18 (depends on 7)

The method of claim 7, further comprising determining that the second weight has a value of 1/1.25.

### Claim 19 (depends on 7)

The method of claim 7, further comprising determining that the second weight has a value of 1/1.5.

### Claim 20 (depends on 9)

The device of claim 9, wherein the sequence of frames has a frame rate of 120 Hz.
