# US 10,321,143 B1 · Systems and methods for increasing resolution of video data

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,321,143 B1
- Document ID: US10321143B1
- Status: Granted
- Kind: B1
- Application number: 15/856,562
- Filed: 2017-12-28
- Published: 2019-07-04
- Granted: 2019-06-11
- Earliest claimed: 2017-12-28
- Assignees: Facebook, Inc.
- Applicants: Facebook, Inc.
- Inventors: Douglas Michael Mayle
- Web page: https://patentgrep.com/patent/US10321143B1

## CPC

- H04N 19/37: with arrangements for assigning different transmission priorities to video input data or to video coded data
- H04L 65/70: Media network packetisation
- H04L 65/762: {at the source (reformatting of additional data in video distribution servers H04N21/2355)}
- H04L 65/765: {intermediate}
- H04N 19/112: according to a given display mode, e.g. for interlaced or progressive display mode
- H04N 19/33: in the spatial domain
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

Systems, methods, and non-transitory computer readable media can obtain a first plurality of frames of a video having a first resolution. For each frame of the first plurality of frames, a portion of a corresponding frame of a version of the video having a second resolution that is higher than the first resolution can be sampled to generate a bias for the frame. A second plurality of frames of the video including the respective bias can be generated, wherein the second plurality of frames corresponds to the first plurality of frames. A second plurality of frames of the video including the respective bias can be generated.

## Claims

### Claim 1

A computer-implemented method comprising:
obtaining, by a computing system, a first plurality of frames of a video having a first resolution;
sampling, by the computing system, for each frame of the first plurality of frames, a portion of a corresponding frame of a version of the video having a second resolution that is higher than the first resolution to generate a bias for the frame;
generating, by the computing system, a second plurality of frames of the video including the respective bias, wherein the second plurality of frames corresponds to the first plurality of frames; and
generating, by the computing system, a bias series indicating a location of the bias in each frame of the second plurality of frames.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1, wherein each frame of the first plurality of frames and each frame of the second plurality of frames is an I-frame.

### Claim 3 (depends on 1)

The computer-implemented method of claim 1, wherein the bias is selected from one or more of: a scanning bias, a pseudo random bias, a random bias, or a stippled bias.

### Claim 4 (depends on 3)

The computer-implemented method of claim 3, wherein the bias is a pseudo random bias, wherein the bias series includes an initial value to be input into a pseudo random number generator, and wherein the location of the bias in each frame of the second plurality of frames is indicated by a corresponding number generated by the pseudo random number generator.

### Claim 5 (depends on 1)

The computer-implemented method of claim 1, further comprising transmitting the second plurality of frames and the bias series to a decoder.

### Claim 6 (depends on 5)

The computer-implemented method of claim 5, wherein a set of weights associated with each frame of the second plurality of frames is determined, and wherein the second plurality of frames is combined based on the associated sets of weights to generate a combined frame that provides image data at a higher resolution than the first resolution.

### Claim 7 (depends on 6)

The computer-implemented method of claim 6, wherein one or more frames of the video are reconstructed by the decoder based on the combined frame.

### Claim 8 (depends on 6)

The computer-implemented method of claim 6, wherein the set of weights associated with each frame of the second plurality of frames includes a weight for each pixel of the frame.

### Claim 9 (depends on 8)

The computer-implemented method of claim 8, wherein a pixel including the bias in a frame of the second plurality of frames is assigned a higher weight than a pixel not including the bias in the frame.

### Claim 10 (depends on 6)

The computer-implemented method of claim 6, wherein the second plurality of frames depicts the same scene or scenes having a similarity metric that satisfies that a threshold value.

### Claim 11

A system comprising:
at least one hardware processor; and
a memory storing instructions that, when executed by the at least one processor, cause the system to perform:
obtaining a first plurality of frames of a video having a first resolution;
sampling, for each frame of the first plurality of frames, a portion of a corresponding frame of a version of the video having a second resolution that is higher than the first resolution to generate a bias for the frame;
generating a second plurality of frames of the video including the respective bias, wherein the second plurality of frames corresponds to the first plurality of frames; and
generating a bias series indicating a location of the bias in each frame of the second plurality of frames.

### Claim 12 (depends on 11)

The system of claim 11, wherein the instructions further cause the system to perform transmitting the second plurality of frames and the bias series to a decoder.

### Claim 13 (depends on 12)

The system of claim 12, wherein a set of weights associated with each frame of the second plurality of frames is determined, and wherein the second plurality of frames is combined based on the associated sets of weights to generate a combined frame that provides image data at a higher resolution than the first resolution.

### Claim 14 (depends on 13)

The system of claim 13, wherein one or more frames of the video are reconstructed by the decoder based on the combined frame.

### Claim 15 (depends on 13)

The system of claim 13, wherein the set of weights associated with each frame of the second plurality of frames includes a weight for each pixel of the frame.

### Claim 16

A non-transitory computer readable medium including instructions that, when executed by at least one hardware processor of a computing system, cause the computing system to perform a method comprising:
obtaining a first plurality of frames of a video having a first resolution;
sampling, for each frame of the first plurality of frames, a portion of a corresponding frame of a version of the video having a second resolution that is higher than the first resolution to generate a bias for the frame;
generating a second plurality of frames of the video including the respective bias, wherein the second plurality of frames corresponds to the first plurality of frames; and
generating a bias series indicating a location of the bias in each frame of the second plurality of frames.

### Claim 17 (depends on 16)

The non-transitory computer readable medium of claim 16, wherein the method further comprises transmitting the second plurality of frames and the bias series to a decoder.

### Claim 18 (depends on 17)

The non-transitory computer readable medium of claim 17, wherein a set of weights associated with each frame of the second plurality of frames is determined, and wherein the second plurality of frames is combined based on the associated sets of weights to generate a combined frame that provides image data at a higher resolution than the first resolution.

### Claim 19 (depends on 18)

The non-transitory computer readable medium of claim 18, wherein one or more frames of the video are reconstructed by the decoder based on the combined frame.

### Claim 20 (depends on 18)

The non-transitory computer readable medium of claim 18, wherein the set of weights associated with each frame of the second plurality of frames includes a weight for each pixel of the frame.
