# US 2015/0103885 A1 · Real time ip video transmission with high resilience to network errors

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2015/0103885 A1
- Document ID: US20150103885A1
- Status: Published application
- Kind: A1
- Application number: 14/511,871
- Filed: 2014-10-10
- Published: 2015-04-16
- Earliest claimed: 2013-10-11
- Applicants: ooVoo LLC
- Inventors: Chang Feng; Minyi Yang
- Web page: https://patentgrep.com/patent/US20150103885A1

## CPC

- H04L 43/0835: {One way packet loss}
- H04L 41/5025: by proactively reacting to service quality change, e.g. by reconfiguration after service quality degradation or upgrade
- H04L 43/0841: {Round trip packet loss}
- H04L 43/0864: Round trip delays
- H04N 19/107: between spatial and temporal predictive coding, e.g. picture refresh
- H04N 19/164: Feedback from the receiver or from the transmission channel
- H04N 19/188: {the unit being a video data packet, e.g. a network abstraction layer [NAL] unit}
- H04N 19/66: involving data partitioning, i.e. separation of data into packets or partitions according to importance
- H04N 19/895: in combination with error concealment
- H04L 41/509: {wherein the managed service relates to media content delivery, e.g. audio, video or TV}
- H04N 7/15: Conference systems
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A method and system related to video transmission to increase resiliency to network errors, such as packet loss. Packet loss can lead to low quality or broken audio, pixilation, image freeze, and other distortions of a video signal. The system and method utilizes packet retransmission and FEC in combination to increase error recovery. Further, the system and method takes into account unique data source characteristics in order increase resilience to network error while minimizing overhead. Finally, the system and method takes into account network conditions, especially in networks with heterogeneous conditions, by separating uplinks and downlinks and adjusting to each individual link in order to provide optimal protection for each link.

## Claims

### Claim 1

A computer program product, comprising a computer usable medium having a computer readable program code embodied therein, said computer readable program code adapted to be executed to implement a method for providing network error resiliency, said method comprising:
receiving a video transmission;
encoding the video transmission into source video packets;
storing the source video packets in a retransmission buffer;
using forward error correction to encode the source video packets into FEC repair packets;
transmitting the source video packets and the FEC repair packets, wherein a receiver processes the source video packets and the FEC repair packets; and
receiving a receiver report transmitted by the receiver.

### Claim 2 (depends on 1)

The computer program product according to claim 1, wherein the receiver report comprises a report of the source video packets that were not received and source video packets that could not be repaired by the FEC repair packets.

### Claim 3 (depends on 1)

The computer program product according to claim 1, wherein the source video packets in the retransmission buffer are transmitted if the receiver report is not received within a certain amount of time.

### Claim 4 (depends on 2)

The computer program product according to claim 2, wherein the retransmission buffer removes all source video packets that were received based on the receiver report.

### Claim 5 (depends on 4)

The computer program product according to claim 4, wherein any source video packets remaining in the retransmission buffer are transmitted.

### Claim 6 (depends on 5)

The computer program product according to claim 5, wherein the receiver report further comprises network loss conditions.

### Claim 7 (depends on 6)

The computer program product according to claim 6, wherein the network loss conditions comprise round trip time measurements, retransmission buffer lengths, and retransmission rates.

### Claim 8 (depends on 1)

The computer program product according to claim 1, wherein a sender manager monitors the source video packets in the retransmission buffer in relation to at least one threshold.

### Claim 9 (depends on 8)

The computer program product according to claim 8, wherein the threshold comprises at least one of a purge threshold, a video source pause threshold, and active purge threshold.

### Claim 10

A method for providing network error resiliency, said method comprising:
receiving a video transmission;
encoding the video transmission into source video packets;
storing the source video packets in a retransmission buffer;
using forward error correction to encode the source video packets into FEC repair packets;
transmitting the source video packets and the FEC repair packets, wherein a receiver processes the source video packets and the FEC repair packets; and
receiving a receiver report transmitted by the receiver.

### Claim 11 (depends on 10)

The computer program product according to claim 10, wherein the receiver report comprises a report of the source video packets that were not received and source video packets that could not be repaired by the FEC repair packets.

### Claim 12 (depends on 10)

The computer program product according to claim 10, wherein the source video packets in the retransmission buffer are transmitted if the receiver report is not received within a certain amount of time.

### Claim 13 (depends on 10)

The computer program product according to claim 10, wherein the retransmission buffer removes all source video packets that were received based on the receiver report.

### Claim 14 (depends on 13)

The computer program product according to claim 13, wherein any source video packets remaining in the retransmission buffer are transmitted.

### Claim 15 (depends on 14)

The computer program product according to claim 14, wherein the receiver report further comprises at least one network loss condition.

### Claim 16 (depends on 15)

The computer program product according to claim 15, wherein the network loss condition comprises at least one of a round trip time measurement, a retransmission buffer length, and a retransmission rate.

### Claim 17 (depends on 10)

The computer program product according to claim 10, wherein a sender manager monitors the source video packets in the retransmission buffer in relation to at least one threshold.

### Claim 18 (depends on 17)

The computer program product according to claim 17, wherein the threshold comprises at least one of a purge threshold, a video source pause threshold, and active purge threshold.

### Claim 19

A computer program product, comprising a computer usable medium having a computer readable program code embodied therein, said computer readable program code adapted to be executed to implement a method for providing network error resiliency, said method comprising:
receiving video packets and FEC repair packets;
holding the video packets in a receiver buffer;
holding the FEC repair packets in a FEC decoder;
repairing the video packets using the FEC repair packets;
transmitting a request for a retransmission of any video packets that could not be repaired by the FEC repair packets;
receiving retransmitted video packets and retransmitted FEC repair packets;
decoding the video packets and the repaired video packets; and
rendering received video packets and repaired video packets into a video demonstration.

### Claim 20 (depends on 19)

The computer program product according to claim 19, wherein a request for a retransmission of any video packets that could not be repaired comprises a receiver report.

### Claim 21 (depends on 20)

The computer program product according to claim 20, wherein the receiver report further comprises network loss conditions.

### Claim 22 (depends on 21)

The computer program product according to claim 21, wherein the network loss conditions comprise round trip time measurements, retransmission buffer lengths, and retransmission rates.

### Claim 23 (depends on 22)

The computer program product according to claim 22, wherein a receiver manager monitors the video packets in the receiver buffer in relation to at least one threshold.

### Claim 24 (depends on 23)

The computer program product according to claim 23, wherein the receiver report further comprises information from the receiver manager regarding at least one of the thresholds.

### Claim 25 (depends on 24)

The computer program product according to claim 24, wherein the threshold comprises at least one of a timeout occurrence, a receiver buffer length, and a new video frame.

### Claim 26

A method for providing network error resiliency, said method comprising:
receiving video packets and FEC repair packets;
holding the video packets in a receiver buffer;
holding the FEC repair packets in a FEC decoder;
repairing the video packets using the FEC repair packets;
transmitting a request for a retransmission of any video packets that could not be repaired by the FEC repair packets;
receiving retransmitted video packets and retransmitted FEC repair packets;
decoding the video packets and the repaired video packets; and
rendering received video packets and repaired video packets into a video demonstration.

### Claim 27 (depends on 26)

The computer program product according to claim 26, wherein a request for a retransmission of any video packets that could not be repaired comprises a receiver report.

### Claim 28 (depends on 27)

The computer program product according to claim 27, wherein the receiver report further comprises network loss conditions.

### Claim 29 (depends on 28)

The computer program product according to claim 28, wherein the network loss conditions comprise round trip time measurements, retransmission buffer lengths, and retransmission rates.

### Claim 30 (depends on 29)

The computer program product according to claim 29, wherein a receiver manager monitors the video packets in the receiver buffer in relation to at least one threshold.

### Claim 31 (depends on 30)

The computer program product according to claim 30, wherein the receiver report further comprises information from the receiver manager regarding at least one of the thresholds.

### Claim 32 (depends on 31)

The computer program product according to claim 31, wherein the threshold comprises at least one of a timeout occurrence, a receiver buffer length, and a new video frame.

### Claim 33

A computer program product, comprising a computer usable medium having a computer readable program code embodied therein, said computer readable program code adapted to be executed to implement a method for providing network error resiliency, said method comprising:
receiving video transmission from at least two sources, wherein a video transmission comprises video packets and FEC repair packets;
transmitting each video transmission to one or more receivers;
repairing the video packets using the FEC repair packets;
transmitting the repaired video packets to one or more receivers; and
sending a receiver report to the video transmission source.

### Claim 34 (depends on 33)

The computer program product according to claim 33, wherein the receiver report comprises a report of the video packets that were not received and video packets that could not be repaired by the FEC repair packets.

### Claim 35 (depends on 34)

The computer program product according to claim 34, wherein the receiver report further comprises network loss conditions.

### Claim 36 (depends on 35)

The computer program product according to claim 35, wherein the network loss conditions comprise round trip time measurements, retransmission buffer lengths, and retransmission rates

### Claim 37

A computer program product, comprising a computer usable medium having a computer readable program code embodied therein, said computer readable program code adapted to be executed to implement a method for providing network error resiliency, said method comprising:
receiving video packets and FEC repair packets from at least two sources;
holding the video packets in a singer buffer;
holding the FEC repair packets in a single FEC decoder;
receiving receiver reports from at least one receiver, wherein a receiver report comprises requests for retransmission of missing video packets at a receiver;
transmitting requested missing video packets to each corresponding receiver;
receiving receiver reports from each receiver, wherein each receiver report does not comprise a request for retransmission of missing video packets; and
removing all video packets from the single buffer.

### Claim 38 (depends on 37)

The computer program product according to claim 37, wherein the receiver report further comprises network loss conditions.

### Claim 39 (depends on 38)

The computer program product according to claim 38, wherein the network loss conditions comprise round trip time measurements, retransmission buffer lengths, and retransmission rates.

### Claim 40 (depends on 39)

The computer program product according to claim 39, wherein a receiver manager monitors the video packets in the receiver buffer in relation to at least one threshold.

### Claim 41 (depends on 40)

The computer program product according to claim 40, wherein the receiver report further comprises information from the receiver manager regarding at least one of the thresholds.

### Claim 42 (depends on 41)

The computer program product according to claim 41, wherein the threshold comprises at least one of a timeout occurrence and a receiver buffer length.
