# US 9,438,849 B2 · Systems and methods for transmitting video frames

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 9,438,849 B2
- Document ID: US9438849B2
- Status: Granted
- Kind: B2
- Application number: 14/054,090
- Filed: 2013-10-15
- Published: 2014-04-17
- Granted: 2016-09-06
- Earliest claimed: 2012-10-17
- Assignees: Dolby Laboratories Licensing Corporation
- Applicants: Dolby Laboratories Licensing Corporation
- Inventors: Limin Liu; Ning Xu; Alfred She; James E. Crenshaw
- Web page: https://patentgrep.com/patent/US9438849B2

## CPC

- H04N 7/01: Conversion of standards {, e.g. involving analogue television standards or digital television standards processed at pixel level}
- H04N 5/38: Transmitter circuitry {for the transmission of television signals according to analogue transmission standards} (H04N5/14 takes precedence)
- H04N 7/0127: {by changing the field or frame frequency of the incoming video signal, e.g. frame rate converter}
- H04N 19/132: Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
- H04N 19/30: using hierarchical techniques, e.g. scalability (H04N19/63 takes precedence)
- H04N 19/37: with arrangements for assigning different transmission priorities to video input data or to video coded data
- H04N 19/587: involving temporal sub-sampling or interpolation, e.g. decimation or subsequent interpolation of pictures in a video sequence
- H04N 21/234327: {by decomposing into layers, e.g. base layer and one or more enhancement layers}
- H04N 21/23614: {Multiplexing of additional data and video streams (arrangements for simultaneous broadcast of plural pieces of information H04H20/28)}
- H04N 21/4348: {Demultiplexing of additional data and video streams}
- H04N 21/6379: directed to encoder {, e.g. for requesting a lower encoding rate}
- H04N 19/467: characterised by the embedded information being invisible, e.g. watermarking
- H04N 21/84: Generation or processing of descriptive data, e.g. content descriptors {(systems specially adapted for using meta-information in broadcast systems H04H60/73)}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Systems and methods for transmitting video frames are described. Specifically, frame rate modification techniques such as blending and/or packing processes are used to translate high frame-rate signals into low-frame rate signals, which are transmitted over limited bandwidth transmission media to a video signal receiver. Information pertaining to the blending and/or packing processes is transferred to the video signal receiver in the form of a map that is used to reconstruct the high frame-rate signals from the low-frame rate signals. The high frame-rate signals may be used by certain types of newer equipment designed to use such signals. However, legacy equipment that cannot use the high frame-rate signals may opt to use certain embodiments described herein that are designed to be backward-compatible. When backward-compatible, the video signal receiver generates suitable low frame-rate signals as well as the high frame-rate signals, thereby accommodating both legacy as well as newer equipment.

## Claims

### Claim 1

A method of propagating a video signal, the method comprising:
providing a high frame-rate input video bit stream to a video signal transmitter;
generating from said high frame-rate input video bit stream, a first low frame-rate video bit stream, said first low frame-rate video bit stream comprising a blended frame that is generated by executing a blending process upon a plurality of frames of said high frame-rate video bit stream, wherein executing said blending process comprises calculating an average pixel value from a plurality of corresponding pixels in said plurality of frames of said high frame-rate video bit stream;
generating from said high frame-rate input video bit stream, a second low frame-rate video bit stream, said second low frame-rate video bit stream comprising a packed frame that is generated by executing a first packing process upon said plurality of frames of said high frame-rate video bit stream, wherein executing said first packing process comprises using a Zeno packing algorithm to generate a Zeno frame from said plurality of frames of said high frame-rate video bit stream;
deriving a secondary bit stream from said first low frame-rate video bit stream, wherein deriving said secondary bit stream from said first low frame-rate video bit stream comprises generating a reconstructed blended frame by decoding said base layer signal;
generating a residual video bit stream by comparing said secondary bit stream to said second low frame-rate video bit stream, wherein said comparing comprises determining a difference signal between said second low frame-rate video bit stream and said secondary bit stream;
encoding said first low frame-rate video bit stream to generate a base layer signal;
encoding said residual video bit stream to generate an enhancement layer signal; and
transmitting said base layer signal and said enhancement layer signal out of said video signal transmitter.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
generating a decision map by executing said first packing process, wherein the decision map provides spatial and temporal resolution information about the second low frame-rate video bit stream; and
transmitting said decision map out of said video signal transmitter.

### Claim 3 (depends on 2)

The method of claim 2, further comprising:
generating a predicted Zeno frame by executing a second packing process upon said reconstructed blended frame.

### Claim 4 (depends on 3)

The method of claim 3, wherein executing said second packing process comprises using said decision map generated by executing said first packing process.

### Claim 5 (depends on 3)

The method of claim 3, further comprising:
generating a predicted Zeno frame by executing upon said reconstructed blended frame at least one of: a) a second packing process or b) a first temporal up-sampling function.

### Claim 6 (depends on 5)

The method of claim 5, wherein executing said second packing process comprises:
temporally up-sampling said decision map generated by executing said first packing process; and
using the up-sampled decision map for executing said second packing process.

### Claim 7 (depends on 2)

The method of claim 2, further comprising:
receiving in a video signal receiver, said base layer signal, said enhancement layer signal, and said decision map;
decoding said received base layer signal, the decoding comprising generating a received blended frame;
decoding said received enhancement layer signal, the decoding comprising generating a received residual bit stream; and
reconstructing said high frame-rate input video bit stream in said video signal receiver by using two or more of: a) said received blended frame or a signal derived from said received blended frame, b) said received residual bit stream or a signal derived from said received residual bit stream, and c) the received decision map or a signal derived from the received decision map.

### Claim 8

A video system comprising a video signal transmitter, the video signal transmitter comprising a first processing circuit that includes a processor, the first processing circuit configured for:
receiving a high frame-rate input video bit stream and generating therefrom, a first low frame-rate video bit stream, said first low frame-rate video bit stream comprising a blended frame that is generated by executing a blending process upon a plurality of frames of said high frame-rate video bit stream, wherein executing said blending process comprises calculating an average pixel value from a plurality of corresponding pixels in said plurality of frames of said high frame-rate video bit stream;
receiving said high frame-rate input video bit stream and generating therefrom, a second low frame-rate video bit stream, said second low frame-rate video bit stream comprising a packed frame that is generated by executing a first packing process upon said plurality of frames of said high frame-rate video bit stream, wherein executing said first packing process comprises using a Zeno packing algorithm to generate a Zeno frame from said plurality of frames of said high frame-rate video bit stream;
deriving a secondary bit stream from said first low frame-rate video bit stream, wherein deriving said secondary bit stream from said first low frame-rate video bit stream comprises generating a reconstructed blended frame by decompressing said base layer signal;
generating a residual video bit stream by comparing said secondary bit stream to said second low frame-rate video bit stream, wherein said comparing comprises determining a difference signal between said second low frame-rate video bit stream and said secondary bit stream;
compressing said first low frame-rate video bit stream to generate a base layer signal;
compressing said residual video bit stream to generate an enhancement layer signal; and
transmitting said base layer signal and said enhancement layer signal out of said video signal transmitter.

### Claim 9 (depends on 8)

The system of claim 8, wherein the first processing circuit is further configured for:
generating a decision map by executing said first packing process, wherein the decision map provides spatial and temporal resolution information about the second low frame-rate video bit stream; and
transmitting said decision map out of said video signal transmitter.

### Claim 10 (depends on 8)

The system of claim 8 further comprising a video signal receiver, the video signal receiver comprising a second processing circuit that includes another processor, the second processing circuit configured for:
receiving a) said base layer signal in one of a compressed or an uncompressed format, b) said enhancement layer signal in one of a compressed or an uncompressed format, and c) said decision map in one of a compressed or an uncompressed format; and
reconstructing said high frame-rate input video bit stream, in part, by executing an unpacking process using the received decision map.

### Claim 11

A method of receiving a video signal, the method comprising:
receiving in a video signal receiver, an enhancement layer signal comprising at least one packed frame that is generated by executing a packing process upon a plurality of frames of a high frame-rate video bit stream, wherein executing said packing process comprises using a Zeno packing algorithm to generate a Zeno frame from said plurality of frames of the high frame-rate video bit stream;
receiving in the video signal receiver, a decision map that provides spatial and temporal resolution information of the at least one packed frame;
decoding the enhancement layer signal, the decoding comprising generating a residual bit stream;
reconstructing the high frame-rate input video bit stream in the video signal receiver, wherein the reconstructing comprises using at least two of: a) said residual bit stream, b) a signal derived from said residual bit stream, c) said decision map, or d) a signal derived from said decision map;
receiving in the video signal receiver, a base layer signal comprising at least one blended frame that is generated by executing a blending process upon said plurality of frames of said high frame-rate video bit stream, wherein executing said blending process comprises calculating an average pixel value from a plurality of corresponding pixels in said plurality of frames of said high frame-rate video bit stream; and
decoding said base layer signal, the decoding comprising generating in said video signal receiver, a received blended frame.

### Claim 12 (depends on 11)

The method of claim 11, wherein reconstructing said high frame-rate input video bit stream in said video signal receiver further comprises using at least one of a) said received blended frame or b) a signal derived from said received blended frame.