# US 2006/0156363 A1 · File storage for scalable media

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2006/0156363 A1
- Document ID: US20060156363A1
- Status: Published application
- Kind: A1
- Application number: 11/170,765
- Filed: 2005-06-29
- Published: 2006-07-13
- Earliest claimed: 2005-01-07
- Assignees: Microsoft Corporation
- Inventors: Feng Wu; Xiaoyan Sun; Gang Bai; Bin Zhu
- Web page: https://patentgrep.com/patent/US20060156363A1

## CPC

- H04N 21/2662: Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
- H04N 19/31: in the temporal domain
- H04N 19/34: Scalability techniques involving progressive bit-plane based encoding of the enhancement layer, e.g. fine granular scalability [FGS]
- H04N 21/234327: {by decomposing into layers, e.g. base layer and one or more enhancement layers}
- H04N 21/23439: {for generating different versions}
- H04N 21/238: Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams {(hybrid fiber coaxial [HFC] networks for downstream channel allocation for video distribution H04L12/2801; flow control in packet networks H04L47/10; real-time communication protocols in data switching networks H04L65/00; scheduling or organising the servicing of application requests H04L67/60)}
- H04N 21/25825: {involving client display capabilities, e.g. screen resolution of a mobile phone (optimising the visualisation of content during browsing in the Internet G06F16/9577; processing of terminal status or physical abilities in wireless networks H04W8/22; authentication in wireless network security H04W12/06)}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Exemplary generic file storage for scalable media is described. In one implementation, stored scalable media streams are related as nodes of a directed acyclic graph (DAG) in which directed edges between the nodes describe relationships between scalable media streams. Many different presentations of a media content can be delivered from a DAG storage file. Data space is reduced because different presentations can avail of the same sub-trees in the DAG. In one implementation, exemplary DAG storage files for scalable media have an information structure that allows the DAG file to self-tailor and/or allocate the scalabilities of the media content presentations it is capable of delivering in order to suit the characteristics of a requesting entity.

## Claims

### Claim 1

A method, comprising:
identifying multiple scalable streams of media content; and
representing each scalable stream as a node in a directed acyclic graph, wherein each edge between two nodes represents a dependency relationship between two of the multiple scalable streams.

### Claim 2 (depends on 1)

The method as recited in claim 1, wherein each node also includes stream properties of the scalable stream represented by the node.

### Claim 3 (depends on 1)

The method as recited in claim 1, wherein each node also includes rate-distortion properties of the scalable stream represented by the node.

### Claim 4 (depends on 1)

The method as recited in claim 1, further comprising storing the multiple scalable streams as a storage file on a computing device, wherein the storing maintains relationships of the directed acyclic graph.

### Claim 5 (depends on 1)

The method as recited in claim 1, further comprising:
identifying multiple sets of scalable media streams, wherein each set represents a different presentation of scaled media content and scaled playback characteristics; and
representing each scaled stream of each set as a node in the directed acyclic graph, wherein the nodes of each set have a dependency relationship with each other represented by the edges.

### Claim 6 (depends on 5)

The method as recited in claim 5, wherein the multiple sets include common scalable streams represented by common nodes of the directed acyclic graph.

### Claim 7 (depends on 6)

The method as recited in claim 6, further comprising maximizing the number of the common nodes.

### Claim 8 (depends on 5)

The method as recited in claim 5, further comprising arranging the directed acyclic graph to minimize the number of nodes representing a same scalable stream.

### Claim 9 (depends on 5)

The method as recited in claim 5, further comprising arranging the directed acyclic graph to eliminate storing a single scalable stream common to multiple sets more than once in the storage file.

### Claim 10 (depends on 1)

The method as recited in claim 1, further comprising:
identifying ensembles, each ensemble including a collection of variously scaled presentations for a single media content and a single codec; and
arranging the directed acyclic graph such that different ensembles share no common nodes.

### Claim 11 (depends on 1)

The method as recited in claim 1, further comprising addressing a set of the scalable streams by their presentation, wherein selection of one of the nodes representing the presentation also selects other dependent nodes in the set.

### Claim 12 (depends on 11)

The method as recited in claim 11, further comprising allocating an available bandwidth among each selected scalable stream according to rate-distortion data stored with each selected node.

### Claim 13 (depends on 11)

The method as recited in claim 11, further comprising:
assigning a weighting factor to the edges between the nodes, wherein the weighting factor is based on a degree of the dependency; and
allocating an available bandwidth among each selected scalable stream in a set according to rate-distortion data stored with each selected node factored by at least one weighting factor of an edge.

### Claim 14

A data structure for a computer storage file, comprising:
a directed acyclic graph, wherein each node represents a scalable media stream and each edge between nodes represents a dependency relationship between two scalable media streams; and
data objects associated with at least some of the nodes, wherein a data object associated with a node determines at least in part the scaling of a media stream associated with the node.

### Claim 15 (depends on 14)

The data structure for a computer storage file as recited in claim 14, wherein the data object associated with the node includes rate-distortion data for the scalable media stream associated with the node.

### Claim 16 (depends on 15)

The data structure for a computer storage file as recited in claim 15, wherein the rate-distortion data determines at least in part an allocation of bandwidth for the scalable media stream associated with the node.

### Claim 17 (depends on 15)

The data structure for a computer storage file as recited in claim 15, further comprising graph edges representing dependency relationships between media streams of a presentation set, wherein a presentation set includes multiple scalable media streams to provide scaled media content and scaled playback characteristics.

### Claim 18 (depends on 17)

The data structure for a computer storage file as recited in claim 17, further comprising multiple presentation sets,
wherein the multiple presentation sets share common nodes representing common scalable media streams and
wherein graph edges from nodes of different presentation sets to a common node are weighted to represent respective contributions of the common node to each of different presentation sets.

### Claim 19 (depends on 18)

The data structure for a computer storage file as recited in claim 18, wherein the directed acyclic graph is arranged to maximize the number of common nodes shared by multiple presentation sets.

### Claim 20

A system, comprising:
means for arranging scalable media streams for computer storage according to relationships of a directed acyclic graph, wherein each node represents a scalable media steam and edges between nodes represent dependencies between the scalable media streams;
means for sharing sub-trees of the directed acyclic graph among different parts of the tree to reduce data space, wherein the different parts of the tree represent differently scaled presentations of the media content; and
means for selecting a node to provide one of the presentations to an application, wherein the presentation requested by the application has scalable properties including one of a frame rate, size, quality, color, frequency, channel, and/or view represented by the node and by additional nodes dependent on the node, wherein a sub-tree of nodes representing the presentation is selected by deriving a directed tree from the selected node to a base layer node to reconstruct the presentation.
