# US 2004/0024898 A1 · Delivering multimedia descriptions

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2004/0024898 A1
- Document ID: US20040024898A1
- Status: Published application
- Kind: A1
- Application number: 10/296,162
- Filed: 2003-06-03
- Published: 2004-02-05
- Earliest claimed: 2000-07-10
- Inventors: Ernest Yiu Cheong Wan
- Web page: https://patentgrep.com/patent/US20040024898A1

## CPC

- H04N 21/858: Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot
- G06F 16/30: of unstructured textual data (document management systems G06F16/93)
- G06F 16/4393: {Multimedia presentations, e.g. slide shows, multimedia albums}
- H04N 21/23412: {for generating or manipulating the scene composition of objects, e.g. MPEG-4 objects}
- H04N 21/234318: {by decomposing into objects, e.g. MPEG-4 objects}
- H04N 21/262: Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists {(scheduling strategies for dispatcher in multiprogramming arrangements G06F9/4881; arrangements for scheduling broadcast services or broadcast-related services H04H60/06; flow control in packet networks H04L47/10; establishing a time schedule or organising the servicing of application requests H04L67/62)}
- H04N 21/44012: {involving rendering scenes according to scene graphs, e.g. MPEG-4 scene graphs}
- H04N 21/8543: using a description language, e.g. Multimedia and Hypermedia information coding Expert Group [MHEG], eXtensible Markup Language [XML] {(information retrieval of semistructured data, the underlying structure being taken into account, e.g. mark-up language structure data G06F16/80)}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Disclosed is method of processing a document (20) described in a mark up language (eg. XML). Initially, a structure (21a) and a text content (21b) of the document are separated, and then the structure (22) is transmitted, for example by streaming, before the text content (23). Parsing of the received structure (22) is commenced before the text content (23) is received. Also disclosed is a method of forming a streamed presentation (37, 38) from at least one media object having content (31, 32) and description (33) components. A presentation description (35) is generated (36) from at least one component description of the media object and is then processed (34) to schedule delivery of component descriptions and content of the presentation to generate elementary data streams associated with the component descriptions (38) and content (37). Another method of forming a streamed presentation of at least one media object having content and description components is also disclosed. A presentation template (53) is provided that defines a structure of a presentation description (56). The template is then applied (54) to at least one description component (52) of the associated media object to form the presentation description from each description component. The presentation description is then stream encoded with each associated media object (51) to form the streamed presentation (57, 58), whereby the media object is reproducible using the presentation description.

## Claims

### Claim 1

A method of forming a streamed presentation from at least one media object having content and description components, said method comprising the steps of:
generating a presentation description from at least one component description of said at least one media object; and
processing said presentation description to schedule delivery of component descriptions and content of said presentation to generate elementary data streams associated with said component descriptions and content.

### Claim 2 (depends on 1)

A method according to claim 1 wherein said processing further comprises arranging said component descriptions into multiple ones of said data streams.

### Claim 3 (depends on 1)

A method according to claim 1 wherein said presentation description comprises references to said description components and said description components are streamed with said at least one media object.

### Claim 4 (depends on 1)

A method according to claim 1 wherein said presentation description is formed by importing said description components, and said generation operates to stream only said presentation description and said at least one media object.

### Claim 5

A method of forming a streamed presentation of at least one media object having content and description components, said method comprising the steps of:
providing a presentation template that defines a structure of a presentation description;
applying said template to at least one description component of at least one associated media object to form said presentation description from each said description component; and
stream encoding said presentation description with each said associated media object to form said streamed presentation, whereby said at least one media object is reproducible using said presentation description.

### Claim 6

A method of forming a presentation description for streaming content with description, said method comprising the steps of:
providing a presentation template that defines a structure of a presentation description;
applying said template to at least one description component of at least one associated media object to form said presentation description from each said description component, said presentation description defining a sequential relationship between description components desired for streamed reproduction and content components associated with said desired descriptions.

### Claim 7 (depends on 1, 6)

A method according to claim 6 further comprising applying said presentation description to the method of claim 1.

### Claim 8 (depends on 1, 5, 6)

A method according to claim 1, 5 or 6 wherein said streamed presentation comprises a description tree having at least one node referencing a description object.

### Claim 9 (depends on 8)

A method according to claim 8 wherein said streamed presentation further comprises at least one further node referencing at least one said media object.

### Claim 10 (depends on 1, 5, 6)

A method according to claim 1, 5 or 6 wherein said stream encoding comprises:
parsing said presentation description to form a plurality of presentation sequential description objects, each said description object being associable with at least one associated media object; and
forming a streamed sequence of said description objects and related said associated media objects, said streamed sequence being said streamed presentation.

### Claim 11 (depends on 10)

A method according to claim 10 wherein a relationship between said description objects and said associated media objects is defined by further objects forming part of said streamed presentation, each said further object comprising a tree structure having nodes each referencing at least one of said description objects and said media objects.

### Claim 12 (depends on 1, 5, 6)

A method according to claim 1, 5 or 6 wherein said presentation description comprises an XML document describing content intended for reproduction in a time sequential manner.

### Claim 13 (depends on 1, 5, 6)

A method according to claim 1, 5 or 6 wherein said presentation description is formed by modifying an SMIL description used to specify the timing and synchronization of said media objects and said descriptions

### Claim 14

A streamed presentation comprising a plurality of content objects interspersed amongst a plurality of description objects, said description objects comprising references to multimedia content reproducible from said content objects.

### Claim 15

A streamed multimedia presentation comprising a first stream representing a tree structure of said presentation, at least one second stream having object descriptors each referenced from said tree structure, at least one third stream comprising content referenced from said object descriptors and intended for reproduction in said presentation, and at least one fourth stream comprising descriptions of said content referenced from said object descriptors.

### Claim 16 (depends on 15)

A streamed presentation according to claim 15 wherein said third stream comprises an MPEG-4 stream.

### Claim 17 (depends on 16)

A streamed presentation according to claim 16 wherein said second stream comprises an Object Content Information stream having URI's referencing MPEG-7 information represented in said fourth stream.

### Claim 18

A method of delivering an XML document, said method comprising the steps of:
dividing the document to separate XML structure from XML text; and
delivering said document in a plurality of data streams, at least one said stream comprising said XML structure and at least one other of said streams comprising said XML text.

### Claim 19 (depends on 18)

A method according to claim 18 wherein said dividing comprises converting said XML documents into a tree representation.

### Claim 20 (depends on 19)

A method according to claim 19 wherein said tree representation is divided in a breadth-first manner.

### Claim 21 (depends on 19)

A method according to claim 19 wherein said tree representation is divided in a depth-first manner.

### Claim 22

A method of processing a document described in a mark up language, said method comprising the steps of:
separating a structure and a text content of said document;
sending the structure before the text content; and
commencing to parse the received structure before the text content is received.

### Claim 23 (depends on 22)

A method according to claim 22, further comprising the step of ignoring the received text content if it is found not to be required or unable to be interpreted as the result of parsing the corresponding structure.

### Claim 24 (depends on 23)

A method according to claim 23, wherein said ignoring step comprises inhibiting a buffering of the text to be ignored.

### Claim 25 (depends on 22)

A method according to claim 22, wherein the mark up language is XML.

### Claim 26 (depends on 22)

A method according to claim 22, wherein said separating step comprises encoding the structure and the text content as two separate streams.

### Claim 27 (depends on 26)

A method according to claim 26 wherein said document is formed as a tree hierarchy representation and said separating step further comprises interpreting said document in a depth-first fashion to form said two streams.

### Claim 28 (depends on 26)

A method according to claim 26 wherein said document is formed as a tree hierarchy representation and said separating step further comprises interpreting said document in a breadth-first fashion to form said two streams.

### Claim 29 (depends on 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28)

Apparatus for performing the method of any one of claims 1 to 12 or 17 to 28.

### Claim 30 (depends on 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12)

A computer readable medium, having a program recorded thereon, where the program is configured to make a computer execute a procedure form a streamed presentation, said procedure being according to the method of any one of claims 1 to 12, or 17 to 28.

### Claim 31

A method of forming a streamed presentation having streamed description substantially as described herein with reference to FIGS. 2, 3, and 4C of the drawings.

### Claim 32

A method of forming a streamed presentation having streamed description substantially as described herein with reference to FIGS. 2, 5, and 4C of the drawings.

### Claim 33

A streamed presentation substantially as described herein with reference to FIG. 4B or 4C of the drawings.
