# US 8,788,716 B2 · Wireless multimedia transport method and apparatus > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 8,788,716 B2 - Document ID: US8788716B2 - Status: Granted - Kind: B2 - Application number: 13/415,394 - Filed: 2012-03-08 - Published: 2012-06-28 - Granted: 2014-07-22 - Earliest claimed: 2009-05-13 - Assignees: STMicroelectronics S.r.l. - Applicants: Osamu Kobayashi - Inventors: Osamu Kobayashi - Web page: https://patentgrep.com/patent/US8788716B2 ## CPC - H04L 65/613: for the control of the source by the destination (control signals issued by the client directed to the server or network components specially adapted for selective content distribution H04N21/637) - H04L 65/752: adapting media to network capabilities - H04L 65/762: {at the source (reformatting of additional data in video distribution servers H04N21/2355)} - H04L 65/80: Responding to QoS - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) ## Abstract Apparatus and methods for wireless data transmission in a multimedia network are disclosed. Disclosed is a network having a source coupled to a sink using a virtual channel that includes a wireless communication channel. A source end of the system provides a packetizing data stream having a stream of payloads such that each payload is associated with its respective originating source stream. The system configured to encode the packetized data stream for wireless transport. A non-wireless source end of the system receives quality of service information from downstream. Thereby enabling adjustments to the source content and packetized data streams. ## Claims ### Claim 1 A multimedia data transmission apparatus, for use in a multimedia communication device, the apparatus comprising: a receiver suitable for receiving multimedia source input from a source; a data transmitter suitable for wirelessly transmitting said source input as a source output sent to a sink as a wireless signal establishing a data link between the source and sink; a quality of service receiver configured to wirelessly receive quality of service information from the sink concerning the data link; and a quality of service output for directing the quality of service information upstream toward the source. ### Claim 2 (depends on 1) The multimedia data transmission apparatus as recited in claim 1 wherein, the receiver comprises a means for receiving said source input; the data transmitter comprises a means for wirelessly transmitting said source output as a wireless signal; the quality of service receiver comprises means for wirelessly receiving said quality of service information from the sink; and the quality of service output comprises a means for outputting said quality of service information upstream. ### Claim 3 (depends on 1) The multimedia data transmission apparatus as recited in claim 1 wherein, the receiver comprises a physical interface arranged to enable the source input to be received using the physical interface. ### Claim 4 (depends on 3) The multimedia data transmission apparatus as recited in claim 3 wherein the apparatus converts the source input into the source output configured in a wireless compatible format suitable for transmission as the wireless signal. ### Claim 5 (depends on 4) The multimedia data transmission apparatus as recited in claim 4 wherein the source input comprises a packetized data stream. ### Claim 6 (depends on 5) The multimedia data transmission apparatus as recited in claim 5 wherein the source input comprises at least one source data stream and wherein the packetized data stream comprises a plurality transfer units with each transfer unit containing multimedia data from at least one of said at least one source data stream. ### Claim 7 (depends on 5) The multimedia data transmission apparatus as recited in claim 5 wherein the apparatus is configured to receive the source input as a plurality of source data streams and is adapted to multiplex said plurality of source data streams into a stream of transfer units configured such each transfer unit includes data from at least one of the plurality of source data streams to form the packetized data stream. ### Claim 8 (depends on 7) The multimedia data transmission apparatus as recited in claim 7 wherein the apparatus converts the packetized data stream into the wireless compatible source output. ### Claim 9 (depends on 1) The multimedia data transmission apparatus as recited in claim 1 wherein the receiver, multimedia data output, quality of service receiver, and quality of service output are arranged in a system on a chip configuration. ### Claim 10 (depends on 1) The multimedia data transmission apparatus as recited in claim 1 wherein the apparatus is incorporated onto a source device that generates the source input. ### Claim 11 A multimedia source device configured to enable wireless transmission of multimedia source output to a sink using a wireless data link between source and sink, the device further configured to wirelessly receive quality of service information from the sink wherein said quality of service information is associated with the condition of the wireless data link, the source device further configured to enable adjustment of the source output to adapt to changes in the wireless data link. ### Claim 12 (depends on 11) The source device as recited in claim 11 comprising, a processor for providing the source input; a transmitter for wirelessly transmitting the source output as a wireless signal to the sink thereby establishing said wireless data link; and a receiver suitable for receiving the quality of service information from the sink. ### Claim 13 (depends on 12) The source device as recited in claim 12 wherein the receiver is configured to receive the quality of service information concerning the condition of the wireless data link between source and sink; and wherein the source device adjusts the source input to accommodate changes in the condition of the wireless data link. ### Claim 14 (depends on 13) The source device as recited in claim 13 wherein the processor enables adjustment of the source input to accommodate a deterioration of signal quality in the data link and also enables adjustments in the source input to accommodate improvement in signal quality in the data link. ### Claim 15 (depends on 14) The source device as recited in claim 14 wherein the processor comprises a means for adjusting the source input to accommodate the deterioration and the improvement of signal quality in the data link. ### Claim 16 (depends on 14) The source device as recited in claim 14 wherein when the link signal quality deteriorates, the processor enables adjustment of the source input to accommodate a deterioration of signal quality by performing at least one of altering a refresh rate in the source input, reducing a resolution of the source input, changing a format of the source input, increasing compression for the source input, or lowering a data rate in the wireless signal. ### Claim 17 (depends on 13) The source device as recited in claim 13 wherein the processor provides source input that comprises at least one source data stream and adjusts the source input to accommodate changes in the condition of the wireless data link. ### Claim 18 (depends on 13) The source device as recited in claim 13 further comprising a scheduler for multiplexing the at least one source data stream into a packetized source data stream that is received by the transmitter for wirelessly transmitting the packetized source data stream to the sink in a wireless compatible format. ### Claim 19 (depends on 18) The source device as recited in claim 18 wherein when the link signal quality deteriorates, at least one of the processor and the scheduler enable adjustment of the source input to accommodate a deterioration of signal quality. ### Claim 20 (depends on 19) The source device as recited in claim 19 wherein when the link signal quality deteriorates, at least one of the processor and the scheduler enable adjustment of the source input to accommodate a deterioration of signal quality by performing at least one of altering a refresh rate in the source input, reducing a resolution of the source input, changing a format of the source input, increasing compression for the source input, removing filler packets from the packetized data stream, deleting source data streams from the packetized data stream. ### Claim 21 (depends on 18) The source device as recited in claim 18 wherein the scheduler that multiplexes the at least one source data stream into the packetized source data stream generates packetized source data stream such that it comprises a stream of transfer units such that each packet unit includes data packets from at least one of said source data streams. ### Claim 22 (depends on 21) The source device as recited in claim 21 wherein each transfer unit includes attribute information that characterizes the packets with the transfer unit. ### Claim 23 (depends on 22) The source device as recited in claim 22 wherein the attribute information is removed from each transfer unit to form a stripped transfer unit, and wherein the source device transmits the removed attribute information to the sink device prior to transmitting the stripped transfer units enabling decoding of the stripped transfer units at the sink. ### Claim 24 A multimedia data transmission apparatus, for use in a multimedia communication apparatus, wherein the apparatus is configured to wirelessly send source output to a sink as a wireless signal in a wireless data link between a source and the sink and wirelessly receive quality of service information from the sink concerning the data link and transmit the quality of service information upstream to said source thereby enabling the source to adjust source input to accommodate changes the wireless signal. ### Claim 25 (depends on 24) The multimedia data transmission apparatus as recited in claim 24, wherein the apparatus comprises, a receiver suitable for receiving the source input from a source; a scheduler adapted to packetize the source input such that it forms a packetized data stream comprising a stream of transfer units; an encoder for converting the packetized data stream into the source output having a wireless compatible transmission format; a transmitter for wirelessly transmitting the source output as the wireless signal to a sink; a quality of service receiver configured to wirelessly receive quality of service information concerning the data link; and a quality of service output for outputting said quality of service information upstream to said source. ### Claim 26 (depends on 25) The multimedia data transmission apparatus as recited in claim 25 wherein, the receiver comprises a means for receiving the source input; the scheduler comprises a means for packetizing the source input; the encoder comprises a means for converting the packetized data stream into the source output having a wireless compatible transmission format; the transmitter comprises a means for wirelessly transmitting the source output; the quality of service receiver comprises a means for wirelessly receiving the quality of service information; and the quality of service output comprises a means for outputting the quality of service information upstream. ### Claim 27 (depends on 26) The multimedia data transmission apparatus as recited in claim 26 wherein, source input received comprises a plurality of source data streams; and the scheduler packetizes the source data streams into the packetized data stream such that it comprises a stream of transfer units with each unit comprising packets from at least one of said plurality of source data streams. ### Claim 28 (depends on 27) The multimedia data transmission apparatus as recited in claim 27 wherein, at least some of the attribute information relevant to a decoding of the transfer units is removed from the transfer units of the stream of transfer units associated with the attribute information; and the attribute information and the associated stream of transfer units comprise the source output which is wirelessly transmitted to a sink device. ### Claim 29 (depends on 27) The multimedia data transmission apparatus as recited in claim 27 wherein, at least some of the attribute information relevant to a decoding of the transfer units is removed from the transfer units of the stream of transfer units associated with the attribute information; and the attribute information and the associated stream of transfer units comprise the source output which is wirelessly transmitted to a sink such that the attribute information is transmitted prior to the transmission of the associated stream of transfer units. ### Claim 30 (depends on 27) The multimedia data transmission apparatus as recited in claim 27 wherein, at least some of the attribute information relevant to a decoding of the transfer units is removed from the transfer units of the stream of transfer units associated with the attribute information; the attribute information and the associated stream of transfer units comprise the source output; the attribute information is wirelessly transmitted to a sink; and the associated stream of transfer units is wirelessly transmitted to the sink such that the device such that said stream of transfer units and said the attribute information are transmitted separately. ### Claim 31 A multimedia communication apparatus comprising, a receiver suitable for receiving a packetized source data stream associated with a source device; a convertor unit for converting the packetized data stream into a source output having a wireless transmission format; a transmitter for wirelessly transmitting the source output to a sink as a wireless signal over a wireless data link between the communication apparatus and the sink; a quality of service receiver configured to wirelessly receive quality of service information concerning the quality of the data link; and a quality of service output for directing the received quality of service information upstream toward said source. ### Claim 32 (depends on 31) The multimedia communication apparatus recited in claim 31 wherein upon a change in said received quality of service information the apparatus provides an alert signal that is associated with a change in status of the quality of service information and directs the alert signal upstream toward said source. ### Claim 33 (depends on 32) The multimedia communication apparatus recited in claim 32 wherein the receiver receives the packetized source data stream through a main link in a communication channel and the quality of service information is directed upstream using a supplemental link in the communication channel. ### Claim 34 A multimedia communication sink device suitable for receiving a wireless signal via a wireless data link between the sink and an associated source and monitoring the link such that wireless quality of service information concerning the link enabling the quality of service information to be wirelessly provided back to the source, the sink configured to enable translation of the wireless signal into a source packetized source data stream configured to enable adapting to changing characteristics of the packetized source data stream. ### Claim 35 (depends on 34) The sink device recited in claim 34 wherein, the sink comprises a receiver means for wirelessly receiving the wireless signal via the wireless data link; the sink comprises a means for monitoring the link characteristics of the wireless data link to obtain the quality of service information; the sink comprises a wireless means for wirelessly providing the quality of service information back to the source; the sink comprises a means for translating the wireless signal into the packetized data stream; and the sink comprises a decoding means that enables adapting to changing characteristics of the packetized source data stream. ### Claim 36 (depends on 34) The sink device recited in claim 34 wherein the sink comprises a receiver suitable for wirelessly receiving the wireless signal using said data link; comprises a convertor enabling the conversion of the wireless signal into the source packetized data stream; and enables adaptation to changes in the packetized source data stream to correctly decode the packetized source data stream. ### Claim 37 (depends on 34) The sink device recited in claim 34 wherein the sink is configured to receive a wireless signal that includes a stream of transfer units in the packetized data stream and configured to receive attribute information associated with stream of transfer units prior to receiving the associated stream of transfer units and wherein the sink enables the decoding of the associated stream of transfer units using the attribute information. ### Claim 38 (depends on 37) The sink device recited in claim 37 wherein, the sink is configured to receive attribute information that is sent separately from and prior to the receipt of the associated transfer units; the sink is configured to receive the packetized data stream with the attribute information substantially removed from each of transfer units associated with said attribute information; and the sink is configured to reconstruct originating source input using the separately sent attribute information and the associated transfer units. ### Claim 39 (depends on 37) The sink device recited in claim 37 wherein, the sink is configured to receive the packetized data stream with the attribute information substantially removed from packet headers of the transfer units associated with said attribute information; the sink is configured to receive attribute information that is sent prior to the receipt of the associated transfer units and in portions of transfer units that do not contain multimedia data; and the sink is configured to reconstruct originating source input using the attribute information and the associated transfer units. ### Claim 40 A method for regulating multimedia data transmission, the method comprising: establishing a wireless data link suitable for transmitting a wireless signal; wirelessly transmitting source output as a wireless signal over the data link; wirelessly receiving quality of service information concerning the condition of the data link; and directing the source quality of service information upstream toward a source. ### Claim 41 (depends on 40) The method as recited in claim 40 further comprising: configuring the source input as a packetized data stream containing a stream of transfer units; and transforming the packetized data stream into the source output having a wireless data format. ### Claim 42 (depends on 41) The method as recited in claim 41 further comprising adjusting the packetized data stream based on the condition of the data link. ### Claim 43 (depends on 42) The method as recited in claim 42 wherein when the condition of the data link deteriorates said adjusting of the packetized data stream comprises reducing the amount of multimedia data contained in the data stream. ### Claim 44 (depends on 42) The method as recited in claim 42 wherein when the condition of the data link deteriorates said adjusting of the packetized data stream the comprises performing at least one of altering a refresh rate in the source input, reducing a resolution of the source input, changing a format of the source input, increasing compression for the source input, removing filler packets from the packetized data stream, deleting source data streams from the packetized data stream. ### Claim 45 (depends on 42) The method as recited in claim 42 wherein when the condition of the data link deteriorates said adjusting of the packetized data stream comprises deleting at least one of the source data streams from the packetized data stream. ### Claim 46 (depends on 42) The method as recited in claim 42 wherein when the condition of the data link deteriorates said adjusting of the packetized data stream further comprises increasing the size of payload in each transfer unit. ### Claim 47 A non-transitory computer readable medium having a computer program executable by a processor for performing wireless transmission of multimedia data, the computer program comprising: computer coded instructions for establishing a wireless data link suitable for transmitting a wireless signal; computer coded instructions for wirelessly transmitting source output as a wireless signal over the data link; computer coded instructions for wirelessly receiving quality of service information concerning the condition of the data link; and computer coded instructions for outputting the quality of service output for directing the source quality of service information upstream toward a source.