# US 2016/0366445 A1 · Use of frame caching to improve packet loss recovery

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2016/0366445 A1
- Document ID: US20160366445A1
- Status: Published application
- Kind: A1
- Application number: 15/096,076
- Filed: 2016-04-11
- Published: 2016-12-15
- Earliest claimed: 2004-12-30
- Assignees: Microsoft Technology Licensing, LLC
- Applicants: Microsoft Technology Licensing, LLC
- Inventors: Chih-Lung Lin; Minghui Xia; Pohsiang Hsu; Shankar Regunathan; Thomas W. Holcomb
- Web page: https://patentgrep.com/patent/US20160366445A1

## CPC

- H04N 19/89: involving methods or arrangements for detection of transmission errors at the decoder
- H04N 19/103: Selection of coding mode or of prediction mode
- H04N 19/124: Quantisation
- H04N 19/166: concerning the amount of transmission errors, e.g. bit error rate [BER]
- H04N 19/172: the region being a picture, frame or field
- H04N 19/188: {the unit being a video data packet, e.g. a network abstraction layer [NAL] unit}
- H04N 19/46: Embedding additional information in the video signal during the compression process (H04N19/517, H04N19/68, H04N19/70 take precedence)
- H04N 19/573: Motion compensation with multiple frame prediction using two or more reference frames in a given prediction direction
- H04N 19/61: in combination with predictive coding
- H04N 19/91: Entropy coding, e.g. variable length coding [VLC] or arithmetic coding
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Various new and non-obvious apparatus and methods for using frame caching to improve packet loss recovery are disclosed. One of the disclosed embodiments is a method for using periodical and synchronized frame caching within an encoder and its corresponding decoder. When the decoder discovers packet loss, it informs the encoder which then generates a frame based on one of the shared frames stored at both the encoder and the decoder. When the decoder receives this generated frame it can decode it using its locally cached frame.

## Claims

### Claim 1

A method of transmitting a signal over a network, comprising the steps of:
assigning a portion of the signal to packets;
an encoder encoding a portion of the packets into frames,;
transmitting the frames over the network to a decoder;
caching at least one frame at the decoder; and
the decoder interpreting at least one subsequent frame transmitted from the encoder using at least in part the cached frame.

### Claim 2 (depends on 1)

The method of claim 1, wherein the method further comprises caching at least one frame at the encoder.

### Claim 3 (depends on 2)

The method of claim 2, wherein the method further comprises caching the frame at the encoder periodically.

### Claim 4 (depends on 3)

The method of claim 3, wherein the period between caches may be a set interval or may be a variable interval.

### Claim 5 (depends on 2)

The method of claim 2, wherein the at least one subsequent frame is generated at the encoder using at least in part the cached encoder frame.

### Claim 6 (depends on 5)

The method of claim 5, wherein copies of the same frame are cached at the decoder and at the encoder and the method further comprises caching the frame at the encoder in synchronization with caching the frame at the decoder.

### Claim 7 (depends on 1)

The method of claim 1, wherein packet loss is detected by the decoder, and wherein a packet loss detection signal is sent through a feedback channel to the encoder.

### Claim 8 (depends on 7)

The method of claim 7, wherein the packet loss has a time associated with it and wherein the packet loss time is sent to the encoder.

### Claim 9 (depends on 7)

The method of claim 7, wherein the encoder receives the packet loss signal, and upon receipt of the signal constructs a packet loss frame using the frame cached at the encoder.

### Claim 10 (depends on 9)

The method of claim 9, wherein the packet loss frame further comprises a frame header and wherein the packet loss frame is distinctively named in the frame header.

### Claim 11 (depends on 1)

The method of claim 1, wherein the encoder sends a cached frame to the decoder periodically.

### Claim 12 (depends on 1)

The method of claim 1, wherein the signal is an image signal, a video signal, an audio signal, or a speech signal.

### Claim 13 (depends on 1)

A computer-readable medium storing computer-executable instructions for causing a computer system to perform the method of claim 1.

### Claim 14 (depends on 1)

The method of claim 1, wherein at least one frame cached at the encoder is a reference frame.

### Claim 15

A system of streaming video within a lossy network comprising:
an encoder to encode data packets into frames;
an encoder cache in which to store a copy of at least a portion of a frame;
a decoder cache in which to store a copy of at least a portion of a frame;
a decoder being operable to detect packet loss; and upon such detection, signaling the encoder to encode a subsequent SP cache frame using the portion of a frame stored in the encoder cache; and
a transmitter to transmit the frames from the encoder to the decoder.

### Claim 16 (depends on 15)

The system of claim 15, wherein the frame further comprises a header, and wherein the SP cache frame is distinctively named in the header.

### Claim 17 (depends on 15)

The system of claim 15, further comprising a synchronizer which synchronizes the portion of a frame in the encoder cache with the portion of a frame in the decoder cache.

### Claim 18 (depends on 15)

The system of claim 15, wherein the encoder transmits a copy of the portion of a frame stored in the encoder cache to the decoder.

### Claim 19 (depends on 15)

The system of claim 15, wherein the decoder uses the portion of a frame stored in the decoder cache to decode at least one subsequent frame transmitted from the encoder.

### Claim 20

A video processor, comprising:
means to encode data packets into frames;
means to cache at least one frame at an encoder;
means to transmit the frames from the encoder to a decoder;
means to decode the frames at the decoder;
means to cache at least one frame at the decoder;
means to synchronize the cached frame at the encoder and the cached frame at the decoder;
means to detect packet loss;
means to use the cached frame at the encoder to generate a special reference frame when packet loss is detected; and
means to interpret the special reference frame at the decoder using the frame cached at the decoder.
