Architecture for combining media processing with networking
AssigneeZenverge, Inc.
InventorsAnthony D. Masterson, Amir M. Mobini
Life of this patent
Estimating the term…
Abstract
Systems and methods for processing media streams for transport over a network based on network conditions. An integrated circuit comprises a media processing unit coupled to receive feedback from a network processing unit. The media processing unit converts a media stream from a compressed input stream to a compressed output stream such that the compressed output stream has characteristics that are best suited for the network conditions. Network conditions can include, for example, characteristics of the network (e.g., latency or bandwidth) or characteristics of the remote playback devices (e.g., playback resolution). Changes in the network conditions can result in a change in the conversion process.
Claims17
An integrated circuit for converting media streams, comprising:
- a frame converter circuit configured to:
- extract motion vectors and a first set of compressed domain error terms from frames of an input media stream in a first compressed format, the first compressed format including input frames that are interframe compressed and intraframe compressed, and the first set of compressed domain error terms representing information related to transients not encoded by the motion vectors;
- and
- convert the input media stream in the first compressed format into an intermediate media stream in a second format without decompressing the intraframe compressed frames of the input media stream and by applying the extracted motion vectors and adding the first set of compressed domain error terms to the interframe compressed frames, the intermediate media stream in the second format contains intraframe compressed frames but not interframe compressed frames;
- an image processor configured to receive the intermediate media stream from the frame converter and perform image enhancement on the intermediate media stream by removing noise from the frames of the intermediate media stream in order to generate processed intermediate media stream;
- and
- an encoder configured to receive the processed intermediate media stream and encode the processed intermediate media stream into an output media stream in a third compressed format by applying the extracted motion vectors to the processed intermediate media stream and adding second set of compressed domain error terms, the third compressed format being different from the first compressed format and including frames that are interframe compressed and intraframe compressed.
A method for converting media streams in an integrated circuit, comprising:
- extracting motion vectors and a first set of compressed domain error terms from frames of an input media stream in a first compressed format, the first compressed format including input frames that are interframe compressed and intraframe compressed, and the first set of compressed domain error terms representing information related to transients not encoded by the motion vectors;
- converting the input media stream in the first compressed format into an intermediate media stream in a second format without decompressing the intraframe compressed frames of the input media stream and by applying the extracted motion vectors and adding the first set of compressed domain error terms to the interframe compressed frames, the intermediate media stream in the second format contains intraframe compressed frames but not interframe compressed frames;
- receiving the intermediate media stream by an image processor;
- performing image enhancement on the intermediate frames by removing noise from the frames of the intermediate media stream in order to generate processed intermediate media stream by the image processor;
- receiving the processed intermediate media stream by an encoder;
- and
- encoding, at the encoder, the processed intermediate media stream into an output media stream in a third compressed format by applying the extracted motion vectors to the processed intermediate media stream and adding a second set of compressed domain error terms, the third compressed format being different from the first compressed format and including frames that are interframe compressed and intraframe compressed.
A media device, comprising:
- a frame converter circuit configured to:
- extract motion vectors and a first set of compressed domain error terms from frames of an input media stream in a first compressed format, the first compressed format including input frames that are interframe compressed and intraframe compressed and the first set of compressed domain error terms representing information related to transients not encoded by the motion vectors;
- and
- convert the input media stream in the first compressed format into an intermediate media stream in a second format without decompressing the intraframe compressed frames of the input media stream and by applying the extracted motion vectors and adding the first set of compressed domain error terms to the interframe compressed frames, the intermediate media stream in the second format contains intraframe compressed frames but not interframe compressed frames;
- an image processor configured to receive the intermediate media stream from the frame converter and perform image enhancement on the intermediate media stream by removing noise from the frames of the intermediate media stream in order to generate processed intermediate media stream;
- and
- an encoder configured to receive the processed intermediate media stream and encode the processed intermediate media stream into an output media stream in a third compressed format by applying the extracted motion vectors to the processed intermediate media stream and adding a second set of compressed domain error terms, the third compressed format being different from the first compressed format and including frames that are interframe compressed and intraframe compressed.
Dependencies are inferred from the claim text.