# US 2012/0254457 A1 · System and method of adaptive transport of multimedia data

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2012/0254457 A1
- Document ID: US20120254457A1
- Status: Published application
- Kind: A1
- Application number: 13/437,541
- Filed: 2012-04-02
- Published: 2012-10-04
- Earliest claimed: 2011-04-03
- Inventors: Jeremiah Condon; Greg Smith; Matthew Szatmary; Donald Bisdorf
- Web page: https://patentgrep.com/patent/US20120254457A1

## CPC

- H04L 65/612: for unicast
- H04L 65/70: Media network packetisation
- H04L 65/752: adapting media to network capabilities
- H04L 65/762: {at the source (reformatting of additional data in video distribution servers H04N21/2355)}
- H04N 21/23439: {for generating different versions}
- H04N 21/2383: Channel coding {or modulation} of digital bit-stream, e.g. QPSK modulation (arrangements for detecting or preventing errors in the information received by adapting the channel coding H04L1/0009; analogue front ends or means for connecting modulators, demodulators or transceivers to a transmission line H04L27/0002)
- H04N 21/2385: Channel allocation (H04N21/266 takes precedence); Bandwidth allocation (H04N21/24 takes precedence {; allocation of channels according to the instantaneous demands of the users in time-division multiplex systems H04J3/1682; admission control, resource allocation in open networks H04L12/5692; arrangements for maintenance or administration in data switching networks involving bandwidth and capacity management H04L41/0896; negotiating bandwidth in wireless networks H04W28/16})
- H04N 21/2402: {Monitoring of the downstream path of the transmission network, e.g. bandwidth available (traffic monitoring in data switching networks H04L43/00; monitoring data switching networks utilization H04L43/0876)}
- H04N 21/242: Synchronisation processes, e.g. processing of PCR [Programme Clock References] {(arrangements for synchronising broadcast or distribution via plural systems in broadcast distribution systems H04H20/18)}
- H04N 21/2662: Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
- H04N 21/6373: for rate control {, e.g. request to the server to modify its transmission rate (flow control in packet networks H04L47/10)}
- H04N 21/6405: Multicasting {(data broadcast and multicast in packet switching networks H04L12/18)}
- H04N 21/6408: Unicasting
- H04N 21/8455: {involving pointers to the content, e.g. pointers to the I-frames of the video stream}
- H04N 21/85406: {involving a specific file format, e.g. MP4 format}
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Network-based content distribution is improved by controlling the flow of multimedia data and streaming characteristics to ensure real-time, consistent delivery. An adaptive media distribution system includes at least one original source of a media channel, a plurality of content playback devices, and one or more stream controllers disposed between the original sources and the playback devices. Each media channel provides audio and/or video content on one or more switchable streams, each stream being encoded with different characteristics such as bitrate. The stream controllers receive streams and determine how the streams should be allocated to the playback devices so as to provide consistent delivery of the content in accordance with playback demand and the stream attributes or information.

## Claims

### Claim 1

An adaptive media distribution system, comprising:
at least one original source of a media channel providing audio and/or video content on one or more switchable streams, each stream being encoded with different attributes or information;
a plurality of content playback devices; and
one or more stream controllers disposed between the original sources and the playback devices, each stream controller being operative to receive a plurality of the switchable streams and determine how the streams should be allocated to the playback devices to provide consistent delivery of the content in accordance with playback demand and the stream attributes or information.

### Claim 2 (depends on 1)

The adaptive media distribution system of claim 1, wherein each media channel comprises a continuous audio and or video signal with a series of audio and/or video frames encoded and encapsulated in a media container.

### Claim 3 (depends on 1)

The adaptive media distribution system of claim 1, wherein each media channel comprises a continuous audio and or video signal with a series of audio and/or video frames encoded and encapsulated in an MP4 container, transport stream, or other format.

### Claim 4 (depends on 1)

The adaptive media distribution system of claim 1, wherein the bitrate of the stream is one of the stream attributes.

### Claim 5 (depends on 1)

The adaptive media distribution system of claim 1, wherein the stream controllers allocate the streams using splicing point markers encoded in the streams to switch from one stream to another.

### Claim 6 (depends on 1)

The adaptive media distribution system of claim 1, wherein the stream controllers allocate the streams to the playback devices by switching from one stream to another using external synchronization.

### Claim 7 (depends on 1)

The adaptive media distribution system of claim 1, wherein the stream controllers include stream buffers to time-synchronize the streams.

### Claim 8 (depends on 1)

The adaptive media distribution system of claim 1, wherein sequence numbers are inserted into the streams enabling the controllers and playback devices to detect and recalculate lost data using forward error correction (FEC).

### Claim 9 (depends on 1)

The adaptive media distribution system of claim 1, wherein the switchable streams utilize unicast or multicast protocols.

### Claim 10 (depends on 1)

The adaptive media distribution system of claim 1, wherein the stream controllers determine how the streams should be allocated using current or historical information.

### Claim 11 (depends on 1)

The adaptive media distribution system of claim 1, wherein the stream control ers determine how the streams should be allocated using current or historical information.

### Claim 12 (depends on 1)

The adaptive media distribution system of claim 1, wherein the streams contain live or time-shifted content

### Claim 13 (depends on 1)

The adaptive media distribution system of claim 1, wherein the stream controllers determine how the streams should be allocated using feedback from other stream controllers of playback devices.

### Claim 14 (depends on 1)

The adaptive media distribution system of claim 1, wherein each controller maintains a catalog of the media channels available to it, including a list of the switchable streams associated with each channel.

### Claim 15 (depends on 1)

The adaptive media distribution system of claim 1, wherein each controller maintains a catalog of the media channels available to it, including:
a list of the switchable streams available for each channel,
the network address providing each stream,
the protocol being used to transmit each stream, and
the anticipated bitrate of each stream.

### Claim 16 (depends on 1)

The adaptive media distribution system of claim 1, wherein each playback device maintains a catalog of available media channels.

### Claim 17 (depends on 1)

The adaptive media distribution system of claim 1, wherein:
each playback device maintains a catalog of available media channels; and
when a playback device receives a user command to begin playing a media channel, the playback device consults its catalog of channels, determines the address of the stream controller for that channel, and sends a subscription message to the controller to request the desired channel.

### Claim 18 (depends on 1)

The adaptive media distribution system of claim 1, wherein, when a playback device receives a user command to begin playing a media channel, the playback device consults its catalog of channels, determines the address of the stream controller for that channel, and sends a subscription message to the controller to request the desired channel along with the maximum acceptable bitrate.

### Claim 19 (depends on 1)

The adaptive media distribution system of claim 1, wherein, when a playback device receives a user command to begin playing a media channel, the playback device consults its catalog of channels, determines the address of the stream controller for that channel, and sends a subscription message to the controller to request the desired channel along with the maximum acceptable bitrate and request priority level.

### Claim 20 (depends on 1)

The adaptive media distribution system of claim 1, wherein each stream controller has a maximum limit and a preferred limit for incoming data, and a maximum limit and a preferred limit for outgoing data.

### Claim 21 (depends on 1)

The adaptive media distribution system of claim 1, wherein:
each stream controller has a maximum limit and a preferred limit for incoming data, and a maximum limit and a preferred limit for outgoing data; and
the controllers choose switchable streams that provide the highest bandwidth without exceeding their maximum incoming and outgoing data limits.

### Claim 22 (depends on 1)

The adaptive media distribution system of claim 1, wherein:
each stream controller has a maximum limit and a preferred limit for incoming data, and a maximum limit and a preferred limit for outgoing data;
requests are sent to the stream controllers at periodic intervals indicating whether a particular playback device wishes to remain at the current bitrate, increase to a higher bitrate, or reduce to a lower bitrate; and
the controllers attempt to accommodate the requests without exceeding their maximum incoming and outgoing data limits.

### Claim 23 (depends on 1)

The adaptive media distribution system of claim 1, wherein:
each stream controller has a maximum limit and a preferred limit for incoming data, and a maximum limit and a preferred limit for outgoing data;
a controller will allocate the streams to satisfy the highest number of recipients with the strongest preferences to switch streams, while minimizing any increase in incoming or outgoing data volume.

### Claim 24

A media distribution method, comprising the steps of:
providing audio and/or video content on one or more switchable streams from at least one original source of a media channel, each stream being encoded with different attributes or information; and
allocating the content to a plurality of playback devices by switching from one stream to another based upon playback demand and the stream attributes or information.

### Claim 25 (depends on 24)

The method of claim 24, wherein each media channel comprises a continuous audio and or video signal with a series of audio and/or video frames encoded and encapsulated in a media container.

### Claim 26 (depends on 24)

The method of claim 24, wherein each media channel comprises a continuous audio and or video signal with a series of audio and/or video frames encoded and encapsulated in an MP4 container, transport stream, or other format.

### Claim 27 (depends on 24)

The method of claim 24, wherein the bitrate of the stream is one of the stream attributes.

### Claim 28 (depends on 24)

The method of claim 24, including the steps of:
encoding splicing point markers in the streams; and
switching from one stream to another using the splicing point markers.

### Claim 29 (depends on 24)

The method of claim 24, including the step of switching from one stream to another using external synchronization.

### Claim 30 (depends on 24)

The method of claim 24, further including the step of buffering the streams to time-synchronize the streams.

### Claim 31 (depends on 24)

The method of claim 24, including the step of inserting sequence numbers into the streams to detect and recalculate lost data using forward error correction (FEC).

### Claim 32 (depends on 24)

The method of claim 24, wherein the switchable streams utilize unicast or multicast protocols.

### Claim 33 (depends on 24)

The method of claim 24, including the step of choosing switchable streams that provide the highest bandwidth without exceeding maximum data limits.

### Claim 34 (depends on 24)

The method of claim 24, including the steps of:
receiving requests indicating whether a particular playback device wishes to remain at the current bitrate, increase to a higher bitrate, or reduce to a lower bitrate; and
accommodating the requests without maximum data limits.

### Claim 35 (depends on 24)

The method of claim 24, including the step of allocating the streams to satisfy the highest number of recipients with the strongest preferences to switch streams, while minimizing any increase in data volume.

### Claim 36 (depends on 24)

The method of claim 24, including the step of allocating the streams using current or historical information.

### Claim 37 (depends on 24)

The method of claim 24, wherein the streams contain live or time-shifted content.

### Claim 38 (depends on 24)

The method of claim 24, including the step of allocating the streams using feedback from other stream controllers of playback devices.
