System and method of error control for interactive low-bit rate video transmission
AssigneeNorth Carolina State University
InventorInjong Rhee
Life of this patent
Estimating the term…
Abstract
A new retransmission-based error control technique that does not incur any additional latency in frame playout times and is suitable for interactive video applications. This retransmission technique combined with layered video coding yields good error resilience for interactive video conferencing. The technique exploits the temporal dependency of inter-coded frames and can be easily incorporated into motion-compensation based coding standards such as MPEG and H.261, achieving very good compression efficiency.
Claims22
A system for displaying an incoming stream of video images comprising:
- (a) means for receiving said stream of video images in the form of frames comprised of packets, each frame based on a reference frame, and each frame having a predesignated playout time;
- (b) means for determining whether any frame packets were lost during transmission;
- (c) means for requesting that any lost frame packets be retransmitted;
- (d) means for determining whether retransmitted lost frame packets have arrived prior to the frame's playout time;
- (e) means for reconstructing said frame using the originally transmitted frame packets and, if necessary, said retransmitted lost frame packets, provided said retransmitted lost frame packets arrived before the expiration of the frame's playout time;
- (f) display means for displaying the reconstructed frame;
- (g) means for storing the just displayed reconstructed frame as said reference frame;
- and
- (h) means for reconstructing said reference frame using the just displayed reconstructed frame and said retransmitted lost frame packets that did not arrive before the expiration of the frame's playout time.
A system for displaying an incoming stream of video images comprising:
- (a) means for receiving said stream of video images in the form of frames comprised of packets, each frame based on a reference frame, and each frame having a predesignated extendable playout time wherein every i.sup.th, i being a integer, frame has a variable extended temporal dependency distance that can be set to any number of frames while all other frames have a temporal dependency distance of one frame;
- (b) means for determining whether any frame packets were lost during transmission;
- (c) means for requesting that any lost frame packets be retransmitted;
- (d) means for determining whether retransmitted lost frame packets have arrived prior to the frame's playout time;
- (e) means for reconstructing said frame using the originally transmitted frame packets and, if necessary, said retransmitted lost frame packets, provided said retransmitted lost frame packets arrived before the expiration of the frame's playout time;
- (f) display means for displaying the reconstructed frame;
- (g) means for storing the just displayed reconstructed frame as said reference frame;
- and
- (h) means for reconstructing said reference frame using the just displayed reconstructed frame and said retransmitted lost frame packets that did not arrive before the expiration of the frame's playout time.
A system for displaying an incoming stream of video images comprising:
- (a) means for receiving said stream of video images in the form of frames comprised of packets, each frame based on a reference frame, and each frame having a predesignated playout time;
- (b) means for packetizing each frame into high priority signals and low priority signals wherein only high priority signal data is used for reconstruction of a frame;
- (c) means for determining whether any frame packets were lost during transmission;
- (d) means for requesting that any lost frame packets be retransmitted;
- (e) means for determining whether retransmitted lost frame packets have arrived prior to the frame's playout time;
- (f) means for reconstructing said frame using the originally transmitted frame packets and, if necessary, said retransmitted lost frame packets, provided said retransmitted lost frame packets arrived before the expiration of the frame's playout time;
- (g) display means for displaying the reconstructed frame;
- (h) means for storing the just displayed reconstructed frame as said reference frame;
- and
- (i) means for reconstructing said reference frame using the just displayed reconstructed frame and said retransmitted lost frame packets that did not arrive before the expiration of the frame's playout time.
A system for displaying an incoming stream of video images comprising:
- (a) means for receiving said stream of video images in the form of frames comprised of packets, each frame based on a reference frame, and each frame having a predesignated extendable playout time wherein every i.sup.th, i being a integer, frame has a variable extended temporal dependency distance that can be set to any number of frames while all other frames have a temporal dependency distance of one frame;
- (b) means for packetizing each frame into high priority signals and low priority signals wherein only high priority signal data is used for reconstruction of a frame;
- (c) means for determining whether any frame packets were lost during transmission;
- (d) means for requesting that any lost frame packets be retransmitted;
- (e) means for determining whether retransmitted lost frame packets have arrived prior to the frame's playout time;
- (f) means for reconstructing said frame using the originally transmitted frame packets and, if necessary, said retransmitted lost frame packets, provided said retransmitted lost frame packets arrived before the expiration of the frame's playout time;
- (g) display means for displaying the reconstructed frame;
- (h) means for storing the just displayed reconstructed frame as said reference frame;
- and
- (i) means for reconstructing said reference frame using the just displayed reconstructed frame and said retransmitted lost frame packets that did not arrive before the expiration of the frame's playout time.
A method of displaying an incoming stream of video images comprising the steps of:
- (a) receiving said stream of video images in the form of frames comprised of packets, each frame based on a reference frame, and each frame having a predesignated playout time;
- (b) determining whether any frame packets were lost during transmission;
- (c) requesting that any lost frame packets be retransmitted;
- (d) determining whether retransmitted lost frame packets have arrived prior to the frame's playout time;
- (e) reconstructing said frame using the originally transmitted frame packets and, if necessary, said retransmitted lost frame packets, provided said retransmitted lost frame packets arrived before the expiration of the frame's playout time;
- (f) displaying the reconstructed frame;
- (g) storing the just displayed reconstructed frame as said reference frame;
- and
- (h) reconstructing said reference frame using the just displayed reconstructed frame and said retransmitted lost frame packets that did not arrive before the expiration of the frame's playout time.
A method of displaying an incoming stream of video images comprising the steps of:
- (a) receiving said stream of video images in the form of frames comprised of packets, each frame based on a reference frame, and each frame having a predesignated extendable playout time wherein every ith frame has a variable extended temporal dependency distance that can be set to any number of frames while all other frames have a temporal dependency distance of one frame;
- (b) determining whether any frame packets were lost during transmission;
- (c) requesting that any lost frame packets be retransmitted;
- (d) determining whether retransmitted lost frame packets have arrived prior to the frame's playout time;
- (e) reconstructing said frame using the originally transmitted frame packets and, if necessary, said retransmitted lost frame packets, provided said retransmitted lost frame packets arrived before the expiration of the frame's playout time;
- (f) displaying the reconstructed frame;
- (g) storing the just displayed reconstructed frame as said reference frame;
- and
- (h) reconstructing said reference frame using the just displayed reconstructed frame and said retransmitted lost frame packets that did not arrive before the expiration of the frame's playout time.
A method of displaying an incoming stream of video images comprising the steps of:
- (a) receiving said stream of video images in the form of frames comprised of packets, each frame based on a reference frame, and each frame having a predesignated playout time;
- (b) packetizing each frame into high priority signals and low priority signals wherein only high priority signal data is used for reconstruction of a frame;
- (c) determining whether any frame packets were lost during transmission;
- (d) requesting that any lost frame packets be retransmitted;
- (e) determining whether retransmitted lost frame packets have arrived prior to the frame's playout time;
- (f) reconstructing said frame using the originally transmitted frame packets and, if necessary, said retransmitted lost frame packets, provided said retransmitted lost frame packets arrived before the expiration of the frame's playout time;
- (g) displaying the reconstructed frame;
- (h) storing the just displayed reconstructed frame as said reference frame;
- and
- (i) reconstructing said reference frame using the just displayed reconstructed frame and said retransmitted lost frame packets that did not arrive before the expiration of the frame's playout time.
A method of displaying an incoming stream of video images comprising the steps of:
- (a) receiving said stream of video images in the form of frames comprised of packets, each frame based on a reference frame, and each frame having a predesignated extendable playout time wherein every i.sup.th frame has a variable extended temporal dependency distance that can be set to any number of frames while all other frames have a temporal dependency distance of one frame;
- (b) packetizing each frame into high priority signals and low priority signals wherein only high priority signal data is used for reconstruction of a frame;
- (c) determining whether any frame packets were lost during transmission;
- (d) requesting that any lost frame packets be retransmitted;
- (e) determining whether retransmitted lost frame packets have arrived prior to the frame's playout time;
- (f) reconstructing said frame using the originally transmitted frame packets and, if necessary, said retransmitted lost frame packets, provided said retransmitted lost frame packets arrived before the expiration of the frame's playout time;
- (g) displaying the reconstructed frame;
- (h) storing the just displayed reconstructed frame as said reference frame;
- and
- (i) reconstructing said reference frame using the just displayed reconstructed frame and said retransmitted lost frame packets that did not arrive before the expiration of the frame's playout time.
Dependencies are inferred from the claim text.