Media gateway with overlay channels
AssigneeTexas Instruments Incorporated
InventorsRaghu NAMBIATH, Vivekanand CHENGALVALA, Djordje SENICIC, Nagashankar CHANDRASHEKAR
Life of this patent
Estimating the term…
Abstract
A network media gateway is disclosed with a processor configured to include a plurality of decoder channels, a plurality of overlay channels, an overlay renderer, a video mixer, and an encoder channel. A digital signal processor embedded in a network media gateway is also disclosed, and a mixing method implemented on a digital signal processor is also disclosed.
Claims20
A network media gateway comprising:
- a processor, configured to include:
- a plurality of decoder channels configured to transport a corresponding plurality of decoded video streams;
- a plurality of overlay channels configured to transport a corresponding plurality of overlay content;
- an overlay renderer configured to receive the plurality of overlay content transported by the plurality of overlay channels and outputs a first rendered overlay content that is stored in the processor;
- a video mixer configured to receive a plurality of decoded video streams transported by the plurality of decoder channels and the first rendered overlay content from the processor, and mixes the plurality of decoded video streams with the first rendered overlay content from the processor, thereby forming and outputting a plurality of encoded mixed steams;
- and
- an encoder channel configured to receive the plurality of encoded mixed streams output by the video mixer and transports the plurality of encoded mixed streams.
A digital signal processor (DSP) embedded in a network media gateway, the DSP comprising:
- a receiver configured to receive overlay content data as rendered overlay content pixels;
- a memory buffer configured to store the received rendered overlay content pixels, each pixel being stored with the following information:
- a beginning coordinate pair of a pixel that represents the beginning of a row of pixels on which the pixel being stored is located,
- an offset from the beginning coordinate pair, and
- payload data that includes a luminance value Y, a red chrominance value Cr, a blue chrominance value Cb, and an alpha compositing value α particular to pixel being stored;
- and
- a processor configured to receive a first decoded video stream and mixes the first decoded video stream with the rendered overlay content pixels stored in the memory buffer, and to receive a different second decoded video stream and mix the second decoded video stream with the same overlay content pixels stored in the memory buffer.
A method implemented on a digital signal processor (DSP) of mixing rendered overlay content pixels stored in a memory buffer and a decoded video stream, thereby forming a encoded mixed stream, each pixel of the rendered overlay content pixels being stored with a beginning coordinate pair of a pixel that represents the beginning of a row of pixels on which the pixel being stored is located, an offset from the beginning coordinate pair, and payload data that includes a luminance value Yov, a red chrominance value Crov, a blue chrominance value Cbov, and an alpha compositing value α particular to the pixel being stored, the method comprising:
- performing, by the DSP, trans-sizing of the stored rendered overlay content pixels stored in the memory buffer based on a destination encoder channel;
- for each row of pixels stored in the memory buffer, mixing by the DSP the stored rendered overlay content pixels in the row and the pixels in corresponding rows of pixels in the decoded video stream to form a an encoded mixed stream according to the following equations:
- Ymix=Ydec*(1−α)+Yov*α,
- Cbmix=Cbdec*(1−α)+Cbov*α, and
- Crmix=Crdec*(1−α)+Crov*α, wherein
- Ymix, Cbmix, and Crmix are the luminance values, blue chrominance values, and red chrominance values, respectively, of the pixels in the encoded mixed stream, and Ydec, Cbdec, and Crdec are the luminance values, blue chrominance values, and red chrominance values, respectively, of the decoded video stream;
- and
- outputting, by the DSP, the encoded mixed stream.
Dependencies are inferred from the claim text.