US 7,734,821 B2Granted

Media coding for loss recovery with remotely predicted data units

AssigneeMicrosoft Corporation

InventorsAlbert Szu-Chi Wang, Ming-Chieh Lee

Life of this patent

Estimating the term…

Loading patent…

Abstract

An improved loss recovery method for coding streaming media classifies each data unit in the media stream as an independent data unit (I unit), a remotely predicted unit (R unit) or a predicted data unit (P unit). Each of these units is organized into independent segments having an I unit, multiple P units and R units interspersed among the P units. The beginning of each segment is the start of a random access point, while each R unit provides a loss recovery point that can be placed independently of the I unit. This approach separates the random access point from the loss recovery points provided by the R units, and makes the stream more impervious to data losses without substantially impacting coding efficiency. The most important data units are transmitted with the most reliability to ensure that the majority of the data received by the client is usable. The I units are the least sensitive to transmission losses because they are coded using only their own data. While they provide the best coding efficiency, the P units are the most sensitive to data loss because the loss of one P unit renders useless all of the P units that depend on it. The remotely predicted units are dependent on the I unit, or in an alternative implementation, on another R unit.

Claims20

Dependent claims

A system for decoding video data streamed in encoded form over a network characterized by variable available bandwidth and latency, the system including:

a processor;
memory;
and
computer-readable media storing computer-executable instructions for causing the system to operate as a parser and a decoder;
the parser being adapted for parsing part of a bitstream to determine a type value for a unit of video data in one video image, wherein the type value is one of plural possible type values including an intra type value, a first single-unit single-reference inter-prediction type value, and a second single-unit single-reference inter-prediction type value;
and
the decoder being adapted for:
when the type value for the unit is the intra type value, decoding at least some of the video data for the unit using an intra decoding mode including intra decoding;
when the type value for the unit is the first single-unit single-reference inter-prediction type value, decoding at least some of the video data for the unit using a first inter decoding mode that favors quality at the expense of decoding flexibility for a given bitrate, wherein the decoder uses at most one motion vector and one reference identifier per block in the first inter decoding mode;
and
when the type value for the unit is the second single-unit single-reference inter-prediction type value, decoding at least some of the video data for the unit using a second inter decoding mode different than the first inter decoding mode, wherein the second inter decoding mode favors decoding flexibility at the expense of quality for the given bitrate, and wherein the decoder also uses at most one motion vector and one reference identifier per block in the second inter decoding mode;
thereby enabling the decoder to select between the second inter decoding mode and the first inter decoding mode during decoding.

9 more elements

A system for decoding video data including plural units, wherein each of the plural units is for video data in one video image, the system comprising:

a processor:
memory;
and
computer-readable media storing computer-executable instructions for causing the system to operate as a parser and a decoder;
the parser being adapted for, for each of the plural units, parsing part of a bitstream to determine a type value for the unit, wherein the type value is one of plural possible type values, the plural possible type values including an intra type value, a first single-unit single-reference inter-prediction type value, and a second single-unit single-reference inter-prediction type value;
and
the decoder being adapted for, for each of the plural units:
when the type value for the unit is the intra type value, decoding at least some of the video data for the unit using an intra decoding mode;
when the type value for the unit is the first single-unit single-reference inter-prediction type value, decoding at least some of the video data for the unit using a first inter decoding mode, wherein the decoder uses at most one motion vector and one reference identifier per block in the first inter decoding mode;
and
when the type value for the unit is the second single-unit single-reference inter-prediction type value, decoding at least some of the video data for the unit using a second inter decoding mode, wherein the decoder also uses at most one motion vector and one reference identifier per block in the second inter decoding mode, and wherein the second inter decoding mode differs from the first inter decoding mode;
wherein, for motion compensation in the first and second inter decoding modes, the decoder is further adapted to select from among plural reference images based upon one or more reference identifiers parsed from the bitstream in addition to the type values for the plural units.

9 more elements

A system for decoding video data, the system comprising:

a processor;
memory;
and
computer-readable media storing computer-executable instructions for causing the system to operate as a parser and a decoder;
the parser being adapted for parsing part of a bitstream to determine a type value for a unit of the video data, wherein the type value is one of plural possible type values, the plural possible type values including an intra type value, a first single-unit single-reference inter-prediction type value, and a second single-unit single-reference inter-prediction type value, wherein the type value for the unit is in encoded form in the bitstream, and wherein the parsing comprises entropy decoding the type value for the unit;
and
the decoder being adapted for:
when the type value for the unit is the intra type value, decoding at least some of the video data for the unit using intra decoding;
when the type value for the unit is the first single-unit single-reference inter-prediction type value, decoding at least some of the video data for the unit using first inter decoding, wherein the decoder uses at most one motion vector and one reference identifier per block in the first inter decoding;
and
when the type value for the unit is the second single-unit single-reference inter-prediction type value, decoding at least some of the video data for the unit using second inter decoding different than the first inter decoding, wherein the decoder also uses at most one motion vector and one reference identifier per block in the second inter decoding.

8 more elements

Dependencies are inferred from the claim text.

Facts

Application: 11/088,696Filed 22 Mar 2005 · continuation
Priority: 12 Mar 1999
Published: US 2005/0198346 A18 Sep 2005
Granted: 8 Jun 2010
Term ends: Not estimatedThe source records don’t support an estimate.

Classification26 codes

H04N 19/107
Selection of coding mode or of prediction mode: between spatial and temporal predictive coding, e.g. picture refresh
G10L 19/005
Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals,…:…
H04L 65/70
Network streaming of media packets: media network packetisation
H04N 19/114
Selection of coding mode or of prediction mode: adapting the group of pictures [GOP] structure, e.g. number of B-frames between two anchor frames

Family

Application09/267,563Parent of this continuation · filed 12 Mar 1999
Application10/329,107Parent of this continuation · filed 23 Dec 2002
US 2005/0198346 A1Pre-grant publication · published 8 Sep 2005
US 6,912,584 B2Parent of this continuation
US 6,499,060 B1Parent of this continuation
US 2003/0086494 A1Published application
US 7,734,821 B2This patent

From the US filing history. Foreign family members aren’t listed.