# US 2009/0222272 A1 · Controlling Spatial Audio Coding Parameters as a Function of Auditory Events

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2009/0222272 A1
- Document ID: US20090222272A1
- Status: Published application
- Kind: A1
- Application number: 11/989,974
- Filed: 2006-07-24
- Published: 2009-09-03
- Earliest claimed: 2005-08-02
- Assignees: Dolby Laboratories Licensing Corporation
- Inventors: Alan Jeffrey Seefeldt; Mark Stuart Vinton
- Web page: https://patentgrep.com/patent/US20090222272A1

## CPC

- H04S 3/008: {in which the audio signals are in digital form, i.e. employing more than two discrete digital channels (data reduction aspects thereof based on psychoacoustics G10L19/02)}
- G10L 19/008: Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing
- H04S 2420/03: Application of parametric coding in stereophonic audio systems
- H04S: STEREOPHONIC SYSTEMS
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

An audio encoder or encoding method receives a plurality of input channels and generates one or more audio output channels and one or more parameters describing desired spatial relationships among a plurality of audio channels that may be derived from the one or more audio output channels, by detecting changes in signal characteristics with respect to lime in one or more of the plurality of audio input channels, identifying as auditory event boundaries changes in signal characteristics with respect to lime in the one or more of the plurality of audio input channels, an audio segment between consecutive boundaries constituting an auditory event in the channel or channels, and generating all or some of the one or more parameters al least partly in response to auditory events and/or the degree of change in signal characteristics associated with the auditory event boundaries. An auditory-event-responsive audio upmixer or upmixing method is also disclosed.

## Claims

### Claim 1

An audio encoding method in which an encoder receives a plurality of input channels and generates one or more audio output channels and one or more parameters describing desired spatial relationships among a plurality of audio channels that may be derived from the one or more audio output channels, comprising
detecting changes in signal characteristics with respect to time in one or more of the plurality of audio input channels,
identifying as auditory event boundaries changes in signal characteristics with respect to time in said one or more of the plurality of audio input channels, wherein an audio segment between consecutive boundaries constitutes an auditory event in the channel or channels, and
generating all or some of said one or more parameters at least partly in response to auditory events and/or the degree of change in signal characteristics associated with said auditory event boundaries.

### Claim 2

An audio processing method in which a processor receives a plurality of input channels and generates a number of audio output channels larger than the number of input channels, comprising
detecting changes in signal characteristics with respect to time in one or more of the plurality of audio input channels,
identifying as auditory event boundaries changes in signal characteristics with respect to time in said one or more of the plurality of audio input channels, wherein an audio segment between consecutive boundaries constitutes an auditory event in the channel or channels, and
generating said audio output channels at least partly in response to auditory events and/or the degree of change in signal characteristics associated with said auditory event boundaries.

### Claim 3 (depends on 1, 2)

A method according to claim 1 or claim 2 wherein an auditory event is a segment of audio that tends to be perceived as separate and distinct.

### Claim 4 (depends on 1, 2)

A method according to claim 1 or claim 2 wherein said signal characteristics include the spectral content of the audio.

### Claim 5

(canceled)

### Claim 6 (depends on 1, 2)

A method according to claim 1 or claim 2 wherein said identifying identifies as an auditory event boundary a change in signal characteristics with respect to time that exceeds a threshold.

### Claim 7 (depends on 1)

A method according to claim 1 wherein one or more parameters depend at least in part on the identification of the dominant input channel, and, in generating such parameters, the identification of the dominant input channel may change only at an auditory event boundary.

### Claim 8 (depends on 1)

A method according to claim 1 wherein all or some of said one or more parameters are generated at least partly in response to a continuing measure of the degree of change in signal characteristics associated with said auditory event boundaries.

### Claim 9 (depends on 8)

The method of claim 8 wherein one or more parameters depend at least in part on a time varying estimate of the covariance between one or more pairs of input channels, and, in generating such parameters, the covariance is time-smoothed using a smoothing time constant responsive to changes in the strength of auditory events over time.

### Claim 10 (depends on 1, 2)

A method according to claim 1 or claim 2 wherein each of the audio channels are represented by samples within blocks of data.

### Claim 11 (depends on 10)

A method according to claim 10 wherein said signal characteristics are the spectral content of audio in a block.

### Claim 12 (depends on 11)

A method according to claim 11 wherein the detection of changes in signal characteristics with respect to time is the detection of changes in spectral content of audio from block to block.

### Claim 13 (depends on 12)

A method according to claim 12 wherein auditory event temporal start and stop boundaries each coincide with a boundary of a block of data.

### Claim 14 (depends on 1, 2)

Apparatus adapted to perform the methods of any one of claim 1 or claim 2.

### Claim 15 (depends on 14)

A computer program, stored on a computer-readable medium, for causing a computer to control the apparatus of claim 14.

### Claim 16 (depends on 1, 2)

A computer program, stored on a computer-readable medium, for causing a computer to perform the methods of claim 1 or claim 2.

### Claim 17

(canceled)

### Claim 18

(canceled)

### Claim 19

An audio encoder in which the encoder receives a plurality of input channels and generates one or more audio output channels and one or more parameters describing desired spatial relationships among a plurality of audio channels that may be derived from the one or more audio output channels, comprising
means for detecting changes in signal characteristics with respect to time in one or more of the plurality of audio input channels,
means for identifying as auditory event boundaries changes in signal characteristics with respect to time in said one or more of the plurality of audio input channels, wherein an audio segment between consecutive boundaries constitutes an auditory event in the channel or channels, and
means for generating all or some of said one or more parameters at least partly in response to auditory events and/or the degree of change in signal characteristics associated with said auditory event boundaries.

### Claim 20

An audio encoder in which the encoder receives a plurality of input channels and generates one or more audio output channels and one or more parameters describing desired spatial relationships among a plurality of audio channels that may be derived from the one or more audio output channels, comprising
a detector that detects changes in signal characteristics with respect to time in one or more of the plurality of audio input channels and identifies as auditory event boundaries changes in signal characteristics with respect to time in said one or more of the plurality of audio input channels, wherein an audio segment between consecutive boundaries constitutes an auditory event in the channel or channels, and
a parameter generator that generates all or some of said one or more parameters at least partly in response to auditory events and/or the degree of change in signal characteristics associated with said auditory event boundaries.

### Claim 21

An audio processor in which the processor receives a plurality of input channels and generates a number of audio output channels larger than the number of input channels, comprising
means for detecting changes in signal characteristics with respect to time in one or more of the plurality of audio input channels,
means for identifying as auditory event boundaries changes in signal characteristics with respect to time in said one or more of the plurality of audio input channels, wherein an audio segment between consecutive boundaries constitutes an auditory event in the channel or channels, and
means for generating said audio output channels at least partly in response to auditory events and/or the degree of change in signal characteristics associated with said auditory event boundaries.

### Claim 22

An audio processor in which the processor receives a plurality of input channels and generates a number of audio output channels larger than the number of input, comprising
a detector that detects changes in signal characteristics with respect to time in one or more of the plurality of audio input channels and identifies as auditory event boundaries changes in signal characteristics with respect to time in said one or more of the plurality of audio input channels, wherein an audio segment between consecutive boundaries constitutes an auditory event in the channel or channels, and
an upmixer that generates said audio output channels at least partly in response to auditory events and/or the degree of change in signal characteristics associated with said auditory event boundaries.
