# US 2012/0254456 A1 · Media file storage format and adaptive delivery system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2012/0254456 A1
- Document ID: US20120254456A1
- Status: Published application
- Kind: A1
- Application number: 13/077,831
- Filed: 2011-03-31
- Published: 2012-10-04
- Earliest claimed: 2011-03-31
- Assignees: Juniper Networks, Inc.
- Inventors: Zubair Visharam; Sunil Mukundan; Karthik Narayanan; Jaspel Kohli; Kumar Narayanan; Prabakar Sundarrajan
- Web page: https://patentgrep.com/patent/US20120254456A1

## CPC

- H04N 21/2343: involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements {(video transcoding H04N19/40; media packet handling at the source H04L65/762)}
- H04L 65/612: for unicast
- H04L 65/762: {at the source (reformatting of additional data in video distribution servers H04N21/2355)}
- H04L 65/80: Responding to QoS
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

A method and apparatus for creating universal adaptive bit rate streams using a generic container format to store audio, video, and supplemental data that allows seamless trans-containerization from one adaptive streaming format to another.

## Claims

### Claim 1

A method for publication and delivery of multiple format streams, comprising:
receiving a media stream for a content that is of a first format and is encoded for a specific bit rate;
extracting raw encoded content data from the media stream, wherein any formatting from the first format in the raw encoded content data is removed;
creating stream information for the raw encoded content data that indicates data frames within the raw encoded content data;
inserting the raw encoded content data into a data section in a structured file;
inserting the stream information into a header section in the structured file.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
after the extraction of the raw encoded content from the media stream, transcoding the raw encoded content to a bit rate different from the specific bit rate.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
after the extraction of the raw encoded content from the media stream, transcoding the raw encoded content to second format in a particular bit rate.

### Claim 4 (depends on 1)

The method of claim 1, further comprising:
sending the structured file to a plurality of edge servers.

### Claim 5 (depends on 4)

The method of claim 4, further comprising:
receiving the structured file at an edge server, among the plurality of edge servers;
storing the structured file in at least one storage device in communication with the edge server;
receiving, by the edge server, a request for the content in a second format at the specific bit rate;
retrieving the stored structured file from the at least one storage device;
extracting, by the edge server, raw encoded content data from the data section in the structured file using information in the header section of the structured file;
formatting, by the edge server, the extracted raw encoded content data into an output stream in the second format;
streaming, by the edge server, the output stream to a requestor.

### Claim 6 (depends on 5)

The method of claim 5, further comprising:
creating, by the edge server, a playlist or manifest for the output stream formatted in the second format;
streaming, by the edge server, the playlist or manifest to the requestor along with the output stream.

### Claim 7 (depends on 4)

The method of claim 4, further comprising:
receiving the structured file at an edge server, among the plurality of edge servers;
storing the structured file in at least one storage device in communication with the edge server;
receiving, by the edge server, a request for the content in a second format at a first bit rate different from the specific bit rate;
retrieving the stored structured file from the at least one storage device;
extracting, by the edge server, raw encoded content data from the data section in the structured file using information in the header section of the structured file;
transcoding, by the edge server, the extracted raw encoded content data into the first bit rate;
formatting, by the edge server, the transcoded extracted raw encoded content data into an output stream in the second format;
streaming, by the edge server, the output stream to a requestor.

### Claim 8 (depends on 7)

The method of claim 7, further comprising:
creating, by the edge server, a playlist or manifest for the output stream formatted in the second format;
streaming, by the edge server, the playlist or manifest to the requestor along with the output stream.

### Claim 9 (depends on 4)

The method of claim 4, further comprising:
receiving the structured file at an edge server, among the plurality of edge servers;
storing the structured file in at least one storage device in communication with the edge server;
receiving, by the edge server, a request for the content at the specific bit rate;
automatically detecting a requester client type and specifying a second format for the request;
retrieving the stored structured file from the at least one storage device;
extracting, by the edge server, raw encoded content data from the data section in the structured file using information in the header section of the structured file;
formatting, by the edge server, the extracted raw encoded content data into an output stream in the second format;
streaming, by the edge server, the output stream to the requestor.

### Claim 10 (depends on 1)

The method of claim 1, further comprising:
storing the structured file in at least one storage device;
receiving a request for the content in a second format at the specific bit rate;
retrieving the stored structured file from the at least one storage device;
extracting raw encoded content data from the data section in the structured file using information in the header section of the structured file;
formatting the extracted raw encoded content data into an output stream in the second format;
streaming the output stream to the requestor.

### Claim 11 (depends on 10)

The method of claim 10, further comprising:
creating a playlist or manifest for the output stream formatted in the second format;
streaming the playlist or manifest to the requestor along with the output stream.

### Claim 12 (depends on 1)

The method of claim 1, wherein the media stream includes multiple bit rate streams in a scalable format.

### Claim 13 (depends on 1)

The method of claim 1, wherein the media stream includes one or more live streams.

### Claim 14 (depends on 13)

The method of claim 13, wherein the raw encoded content data insertion step dynamically inserts new streams into the data section of the structured file.

### Claim 15 (depends on 13)

The method of claim 13, wherein the raw encoded content data insertion step dynamically inserts additional bit rates of the raw encoded data into the data section of the structured file.

### Claim 16 (depends on 1)

The method of claim 1, wherein the media stream includes media streams from a plurality of cameras.

### Claim 17 (depends on 1)

The method of claim 1, wherein the media stream includes one or more media files.

### Claim 18 (depends on 1)

The method of claim 1, further comprising:
inserting ad insertion cues into the header section in the structured file.

### Claim 19 (depends on 1)

The method of claim 1, further comprising:
inserting encryption keys into the header section in the structured file.

### Claim 20

A computer readable storage medium, storing instructions which, when executed by one or more computing devices, cause performance of steps comprising:
receiving a media stream for a content that is of a first format and is encoded for a specific bit rate;
extracting raw encoded content data from the media stream, wherein any formatting from the first format in the raw encoded content data is removed;
creating stream information for the raw encoded content data that indicates data frames within the raw encoded content data;
inserting the raw encoded content data into a data section in a structured file;
inserting the stream information into a header section in the structured file.

### Claim 21 (depends on 20)

The computer readable storage medium of claim 20, further comprising:
after the extraction of the raw encoded content from the media stream, transcoding the raw encoded content to a bit rate different from the specific bit rate.

### Claim 22 (depends on 20)

The computer readable storage medium of claim 20, further comprising:
after the extraction of the raw encoded content from the media stream, transcoding the raw encoded content to second format in a particular bit rate.

### Claim 23 (depends on 20)

The computer readable storage medium of claim 20, further comprising:
sending the structured file to a plurality of edge servers.

### Claim 24 (depends on 23)

The computer readable storage medium of claim 23, further comprising:
receiving the structured file at an edge server, among the plurality of edge servers;
storing the structured file in at least one storage device in communication with the edge server;
receiving, by the edge server, a request for the content in a second format at the specific bit rate;
retrieving the stored structured file from the at least one storage device;
extracting, by the edge server, raw encoded content data from the data section in the structured file using information in the header section of the structured file;
formatting, by the edge server, the extracted raw encoded content data into an output stream in the second format;
streaming, by the edge server, the output stream to a requestor.

### Claim 25 (depends on 24)

The computer readable storage medium of claim 24, further comprising:
creating, by the edge server, a playlist or manifest for the output stream formatted in the second format;
streaming, by the edge server, the playlist or manifest to the requestor along with the output stream.

### Claim 26 (depends on 23)

The computer readable storage medium of claim 23, further comprising:
receiving the structured file at an edge server, among the plurality of edge servers;
storing the structured file in at least one storage device in communication with the edge server;
receiving, by the edge server, a request for the content in a second format at a first bit rate different from the specific bit rate;
retrieving the stored structured file from the at least one storage device;
extracting, by the edge server, raw encoded content data from the data section in the structured file using information in the header section of the structured file;
transcoding, by the edge server, the extracted raw encoded content data into the first bit rate;
formatting, by the edge server, the transcoded extracted raw encoded content data into an output stream in the second format;
streaming, by the edge server, the output stream to a requestor.

### Claim 27 (depends on 26)

The computer readable storage medium of claim 26, further comprising:
creating, by the edge server, a playlist or manifest for the output stream formatted in the second format;
streaming, by the edge server, the playlist or manifest to the requestor along with the output stream.

### Claim 28 (depends on 23)

The computer readable storage medium of claim 23, further comprising:
receiving the structured file at an edge server, among the plurality of edge servers;
storing the structured file in at least one storage device in communication with the edge server;
receiving, by the edge server, a request for the content at the specific bit rate;
automatically detecting a requester client type and specifying a second format for the request;
retrieving the stored structured file from the at least one storage device;
extracting, by the edge server, raw encoded content data from the data section in the structured file using information in the header section of the structured file;
formatting, by the edge server, the extracted raw encoded content data into an output stream in the second format;
streaming, by the edge server, the output stream to the requestor.

### Claim 29 (depends on 20)

The computer readable storage medium of claim 20, further comprising:
storing the structured file in at least one storage device;
receiving a request for the content in a second format at the specific bit rate;
retrieving the stored structured file from the at least one storage device;
extracting raw encoded content data from the data section in the structured file using information in the header section of the structured file;
formatting the extracted raw encoded content data into an output stream in the second format;
streaming the output stream to the requestor.

### Claim 30 (depends on 29)

The computer readable storage medium of claim 29, further comprising:
creating a playlist or manifest for the output stream formatted in the second format;
streaming the playlist or manifest to the requestor along with the output stream.

### Claim 31 (depends on 20)

The computer readable storage medium of claim 20, wherein the media stream includes multiple bit rate streams in a scalable format.

### Claim 32 (depends on 20)

The computer readable storage medium of claim 20, wherein the media stream includes one or more live streams.

### Claim 33 (depends on 32)

The computer readable storage medium of claim 32, wherein the raw encoded content data insertion step dynamically inserts new streams into the data section of the structured file.

### Claim 34 (depends on 32)

The computer readable storage medium of claim 32, wherein the raw encoded content data insertion step dynamically inserts additional bit rates of the raw encoded data into the data section of the structured file.

### Claim 35 (depends on 20)

The computer readable storage medium of claim 20, wherein the media stream includes media streams from a plurality of cameras.

### Claim 36 (depends on 20)

The computer readable storage medium of claim 20, wherein the media stream includes one or more media files.

### Claim 37 (depends on 20)

The computer readable storage medium of claim 20, further comprising:
inserting ad insertion cues into the header section in the structured file.

### Claim 38 (depends on 20)

The computer readable storage medium of claim 20, further comprising:
inserting encryption keys into the header section in the structured file.

### Claim 39

A system for publication and delivery of multiple format streams, comprising:
a subsystem, implemented at least partially in hardware, that receives a media stream for a content that is of a first format and is encoded for a specific bit rate;
a subsystem, implemented at least partially in hardware, that extracts raw encoded content data from the media stream, wherein any formatting from the first format in the raw encoded content data is removed;
a subsystem, implemented at least partially in hardware, that creates stream information for the raw encoded content data that indicates data frames within the raw encoded content data;
a subsystem, implemented at least partially in hardware, that inserts the raw encoded content data into a data section in a structured file;
a subsystem, implemented at least partially in hardware, that inserts the stream information into a header section in the structured file.

### Claim 40 (depends on 39)

The system of claim 39, further comprising:
a subsystem, implemented at least partially in hardware, that, after the extraction of the raw encoded content from the media stream, transcodes the raw encoded content to a bit rate different from the specific bit rate.

### Claim 41 (depends on 39)

The system of claim 39, further comprising:
a subsystem, implemented at least partially in hardware, that, after the extraction of the raw encoded content from the media stream, transcodes the raw encoded content to second format in a particular bit rate.

### Claim 42 (depends on 39)

The system of claim 39, further comprising:
a subsystem, implemented at least partially in hardware, that sends the structured file to a plurality of edge servers.

### Claim 43 (depends on 42)

The system of claim 42, further comprising:
a subsystem, implemented at least partially in hardware, that receives the structured file at an edge server, among the plurality of edge servers;
a subsystem, implemented at least partially in hardware, that stores the structured file in at least one storage device in communication with the edge server;
a subsystem, at the edge server, implemented at least partially in hardware, that receives a request for the content in a second format at the specific bit rate;
a subsystem, implemented at least partially in hardware, that retrieves the stored structured file from the at least one storage device;
a subsystem, at the edge server, implemented at least partially in hardware, that extracts raw encoded content data from the data section in the structured file using information in the header section of the structured file;
a subsystem, at the edge server, implemented at least partially in hardware, that formats the extracted raw encoded content data into an output stream in the second format;
a subsystem, at the edge server, implemented at least partially in hardware, that streams the output stream to a requestor.

### Claim 44 (depends on 43)

The system of claim 43, further comprising:
a subsystem, at the edge server, implemented at least partially in hardware, that creates a playlist or manifest for the output stream formatted in the second format;
a subsystem, at the edge server, implemented at least partially in hardware, that streams the playlist or manifest to the requestor along with the output stream.

### Claim 45 (depends on 42)

The system of claim 42, further comprising:
a subsystem, at the edge server, implemented at least partially in hardware, that receives the structured file among the plurality of edge servers;
a subsystem, implemented at least partially in hardware, that stores the structured file in at least one storage device in communication with the edge server;
a subsystem, at the edge server, implemented at least partially in hardware, that receives a request for the content in a second format at a first bit rate different from the specific bit rate;
a subsystem, implemented at least partially in hardware, that retrieves the stored structured file from the at least one storage device;
a subsystem, at the edge server, implemented at least partially in hardware, that extracts raw encoded content data from the data section in the structured file using information in the header section of the structured file;
a subsystem, at the edge server, implemented at least partially in hardware, that transcodes the extracted raw encoded content data into the first bit rate;
a subsystem, at the edge server, implemented at least partially in hardware, that formats the transcoded extracted raw encoded content data into an output stream in the second format;
a subsystem, at the edge server, implemented at least partially in hardware, that streams the output stream to a requestor.

### Claim 46 (depends on 45)

The system of claim 45, further comprising:
a subsystem, at the edge server, implemented at least partially in hardware, that creates a playlist or manifest for the output stream formatted in the second format;
a subsystem, at the edge server, implemented at least partially in hardware, that streams the playlist or manifest to the requestor along with the output stream.

### Claim 47 (depends on 42)

The system of claim 42, further comprising:
a subsystem, implemented at least partially in hardware, that receives the structured file at an edge server, among the plurality of edge servers;
a subsystem, implemented at least partially in hardware, that stores the structured file in at least one storage device in communication with the edge server;
a subsystem, at the edge server, implemented at least partially in hardware, that receives a request for the content at the specific bit rate;
a subsystem, at the edge server, implemented at least partially in hardware, that automatically detects a requester client type and specifying a second format for the request;
a subsystem, implemented at least partially in hardware, that retrieves the stored structured file from the at least one storage device;
a subsystem, at the edge server, implemented at least partially in hardware, that extracts raw encoded content data from the data section in the structured file using information in the header section of the structured file;
a subsystem, at the edge server, implemented at least partially in hardware, that formats the extracted raw encoded content data into an output stream in the second format;
a subsystem, at the edge server, implemented at least partially in hardware, that streams the output stream to the requestor.

### Claim 48 (depends on 39)

The system of claim 39, further comprising:
a subsystem, implemented at least partially in hardware, that stores the structured file in at least one storage device;
a subsystem, implemented at least partially in hardware, that receives a request for the content in a second format at the specific bit rate;
a subsystem, implemented at least partially in hardware, that retrieves the stored structured file from the at least one storage device;
a subsystem, implemented at least partially in hardware, that extracts raw encoded content data from the data section in the structured file using information in the header section of the structured file;
a subsystem, implemented at least partially in hardware, that formats the extracted raw encoded content data into an output stream in the second format;
a subsystem, at implemented at least partially in hardware, that streams the output stream to the requestor.

### Claim 49 (depends on 48)

The system of claim 48, further comprising:
a subsystem, implemented at least partially in hardware, that creates a playlist or manifest for the output stream formatted in the second format;
a subsystem, implemented at least partially in hardware, that streams the playlist or manifest to the requestor along with the output stream.

### Claim 50 (depends on 39)

The system of claim 39, wherein the media stream includes multiple bit rate streams in a scalable format.

### Claim 51 (depends on 39)

The system of claim 39, wherein the media stream includes one or more live streams.

### Claim 52 (depends on 51)

The system of claim 51, wherein the raw encoded content data insertion subsystem dynamically inserts new streams into the data section of the structured file.

### Claim 53 (depends on 51)

The system of claim 51, wherein the raw encoded content data insertion subsystem dynamically inserts additional bit rates of the raw encoded data into the data section of the structured file.

### Claim 54 (depends on 39)

The system of claim 39, wherein the media stream includes media streams from a plurality of cameras.

### Claim 55 (depends on 39)

The system of claim 39, wherein the media stream includes one or more media files.

### Claim 56 (depends on 39)

The system of claim 39, further comprising:
a subsystem, implemented at least partially in hardware, that inserts ad insertion cues into the header section in the structured file.

### Claim 57 (depends on 39)

The system of claim 39, further comprising:
a subsystem, implemented at least partially in hardware, that inserts encryption keys into the header section in the structured file.
