# US 2013/0159006 A1 · Object-based Audio-Visual Terminal and Bitstream Structure

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2013/0159006 A1
- Document ID: US20130159006A1
- Status: Published application
- Kind: A1
- Application number: 13/767,632
- Filed: 2013-02-14
- Published: 2013-06-20
- Earliest claimed: 2000-01-13
- Assignees: The Trustees of Columbia University in the City of New York
- Inventors: Alexandros Eleftheriadis; Hari Kalva
- Web page: https://patentgrep.com/patent/US20130159006A1

## CPC

- G11B 27/032: on tapes (G11B27/036, G11B27/038 take precedence)
- G06T 1/60: Memory management
- G10L 19/002: Dynamic bit allocation (for perceptual audio coders G10L19/032)
- G10L 19/008: Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing
- G11B 27/034: on discs (G11B27/036, G11B27/038 take precedence)
- H04N 5/265: Mixing
- H04N 7/52: Systems for transmission of a pulse code modulated video signal with one or more other pulse code modulated signals, e.g. an audio signal or a synchronizing signal (assembling of a multiplex stream by combining a video stream with other content or additional data, remultiplexing of multiplex streams, insertion of stuffing bits into the multiplex stream, assembling of a packetised elementary stream at server side H04N21/236; disassembling of a multiplex stream, remultiplexing of multiplex streams, extraction or processing of Service Information, disassembling of packetised elementary stream at client side H04N21/434)
- H04N 21/23412: {for generating or manipulating the scene composition of objects, e.g. MPEG-4 objects}
- H04N 21/234318: {by decomposing into objects, e.g. MPEG-4 objects}
- H04N 21/2541: {Rights Management (protecting software against unauthorised usage in a vending or licensing environment G06F21/10; security in data switching network management H04L41/28; security management or policies for network security H04L63/20; access security in wireless networks H04W12/08)}
- H04N 21/426: Internal components of the client {; Characteristics thereof} (H04N5/44 takes precedence)
- H04N 21/43072: {of multiple content streams on the same device}
- H04N 21/4331: {Caching operations, e.g. of an advertisement for later insertion during playback}
- H04N 21/44012: {involving rendering scenes according to scene graphs, e.g. MPEG-4 scene graphs}
- H04N 21/835: Generation of protective data, e.g. certificates {(protecting software against unauthorised usage in a vending or licensing environment G06F21/10)}
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

As information to be processed at an object-based video or audio-visual (AV) terminal, an object-oriented bitstream includes objects, composition information, and scene demarcation information. Such bitstream structure allows on-line editing, e.g. cut and paste, insertion/deletion, grouping, and special effects. In the interest of ease of editing, AV objects and their composition information are transmitted or accessed on separate logical channels (LCs). Objects which have a lifetime in the decoder beyond their initial presentation time are cached for reuse until a selected expiration time. The system includes a de-multiplexer, a controller which controls the operation of the AV terminal, input buffers, AV objects decoders, buffers for decoded data, a composer, a display, and an object cache.

## Claims

### Claim 1

A method for processing audio data, comprising:
receiving in a data bitstream, over time, a plurality of audio information and composition information, wherein said audio information includes one or more objects, each object being individually encoded;
processing said composition information received in the data bitstream to compose a single audio arrangement from said audio information; and
outputting said single audio arrangement.

### Claim 2 (depends on 1)

The method of claim 1, wherein the receiving includes receiving from a network connection.

### Claim 3 (depends on 1)

The method of claim 1, wherein the receiving includes receiving from local memory.

### Claim 4 (depends on 1)

The method of claim 1, wherein said one or more objects has immediate aural relevancy.

### Claim 5 (depends on 4)

The method of claim 4, further comprising storing said audio information in memory.

### Claim 6 (depends on 5)

The method of claim 5, wherein said memory is a cache memory.

### Claim 7 (depends on 6)

The method of claim 6, further comprising storing said audio information beyond its initial presentation time.

### Claim 8 (depends on 1)

The method of claim 1, wherein the outputting further includes outputting the single audio arrangement via a plurality of speakers.

### Claim 9 (depends on 1)

The method of claim 1, wherein the outputting further includes transmitting the single audio arrangement.

### Claim 10

A system for processing audio data, comprising:
a controller circuit for receiving in a data bitstream, over time, a plurality of audio information and composition information, wherein said audio information includes one or more objects, each object being individually encoded;
a composer circuit for processing said composition infoiination received in the data bitstream to compose a single audio arrangement from said audio information; and
an output circuit for outputting said single audio arrangement.

### Claim 11 (depends on 10)

The system of claim 10, wherein the controller circuit is adapted for receiving from a network connection.

### Claim 12 (depends on 10)

The system of claim 10, wherein the controller circuit is adapted for receiving from local memory.

### Claim 13 (depends on 10)

The system of claim 10, wherein said one or more objects has immediate aural relevancy.

### Claim 14 (depends on 13)

The system of claim 13, further comprising a storage circuit for storing said audio information in memory.

### Claim 15 (depends on 14)

The system of claim 14, wherein said memory is a cache memory.

### Claim 16 (depends on 15)

The system of claim 15, wherein the storage circuit is further configured to store said audio information beyond its initial presentation time.

### Claim 17 (depends on 10)

The method of claim 10, further comprising a plurality of speakers coupled with the output circuit for performing the single audio arrangement.

### Claim 18 (depends on 10)

The method of claim 10, further comprising a transmitter coupled with the output circuit for transmitting the single audio arrangement.
