# US 2008/0304670 A1 · Method of and a Device for Generating 3d Sound

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2008/0304670 A1
- Document ID: US20080304670A1
- Status: Published application
- Kind: A1
- Application number: 12/066,506
- Filed: 2006-09-06
- Published: 2008-12-11
- Earliest claimed: 2005-09-13
- Assignees: Koninklijke Philips Electronics N.V.
- Inventors: Jeroen Dirk Breebaart
- Web page: https://patentgrep.com/patent/US20080304670A1

## CPC

- H04S 7/30: {Control circuits for electronic adaptation of the sound field}
- H04R 2499/11: Transducers incorporated or for use in hand-held devices, e.g. mobile phones, PDA's, camera's
- H04S 2400/01: Multi-channel, i.e. more than two input channels, sound reproduction with two speakers wherein the multi-channel information is substantially preserved
- H04S 2420/01: Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]
- H04S 2420/03: Application of parametric coding in stereophonic audio systems
- H04S: STEREOPHONIC SYSTEMS
- H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K)

## Abstract

A device (100) for processing audio data (101), wherein the device (100) comprises a summation unit (102) adapted to receive a number of audio input signals for generating a summation signal, a filter unit (103) adapted to filter said summation signal dependent on filter coefficient, (SF1, SF2) resulting in at least two audio output signals (OS1, OS2), a parameter conversion unit (104) adapted to receive, on the one hand, position information, which is representative of spatial positions of sound sources of said audio input signals, and, on the other hand, spectral power information which is representative of a spectral power of said audio input signals, wherein the parameter conversion unit is adapted to generate said filter coefficients (SF1, SF2) on the basis of the position information and the spectral power information, and wherein the parameter conversion unit (104) is additionally adapted to receive transfer function parameters and generate said filter coefficients in dependence on said transfer function parameters.

## Claims

### Claim 1

A device (100) for processing audio data (Xi),
wherein the device (100) comprises
a summation unit (102) adapted to receive a number of audio input signals for generating a summation signal,
a filter unit (103) adapted to filter said summation signal dependent on filter coefficients (SF1, SF2) resulting in at least two audio output signals (OS1, OS2), and
a parameter conversion unit (104) adapted to receive, on the one hand, position information, which is representative of spatial positions of sound sources of said audio input signals, and, on the other hand, spectral power information which is representative of a spectral power of said audio input signals, wherein the parameter conversion unit is adapted to generate said filter coefficients (SF1, SF2) on the basis of the position information and the spectral power information, and
wherein the parameter conversion unit (104) is additionally adapted to receive transfer function parameters and generate said filter coefficients in dependence on said transfer function parameters;
and the device being characterized by the parameter conversion unit (104) being arranged to
generate the filter coefficients (SF1, SF2) in response to an averaged set of spatial parameters determined by a weighting of spatial parameters of each sound source defending on an energy of each sound source in a frequency band.

### Claim 2 (depends on 1)

The device (100) as claimed in claim 1,
wherein the transfer function parameters are parameters representing Head-Related Transfer Functions (HRTFs) for each audio output signal, said transfer function parameters representing a power in frequency sub-bands and a real-valued phase angle or complex-valued phase angle per frequency sub-band between the Head-Related Transfer Functions of each output channel as a function of azimuth and elevation.

### Claim 3 (depends on 2)

The device (100) as claimed in claim 2,
wherein the complex-valued phase angle per frequency sub-band represents an average phase angle between the Head-Related Transfer Functions of each output channel.

### Claim 4 (depends on 1)

The device (100) as claimed in claim 1,
additionally comprising a scaling unit (201) adapted to scale the audio input signals based on gain factors.

### Claim 5 (depends on 4)

The device (100) as claimed in claim 4,
wherein the parameter conversion unit (104) is additionally adapted to receive distance information, which is representative of distances of sound sources of the audio input signals, and to generate the gain factors based on said distance information.

### Claim 6 (depends on 1)

The device (100) as claimed in claim 1,
wherein the filter unit (103) is based on a Fast Fourier Transform (FFT) or a real-valued or complex-valued filter bank.

### Claim 7 (depends on 6)

The device (100) as claimed in claim 6,
wherein the filter unit (103) additionally comprises a decorrelation unit adapted to apply a decorrelation signal to each of the at least two audio output signals.

### Claim 8 (depends on 6)

The device (100) as claimed in claim 6,
wherein the filter unit (103) is adapted to process filter coefficients that are provided in the form of complex-valued scale factors for frequency sub-bands for each output signal.

### Claim 9 (depends on 1)

The device (300) as claimed in claim 1,
additionally comprising storage means (301) for storing audio waveform data, and an interface unit (302) for providing the number of audio input signals based on the stored audio waveform data.

### Claim 10 (depends on 9)

The device (300) as claimed in claim 9,
wherein the storage means (301) are adapted to store the audio waveform data in a pulse code-modulated (PCM) format and/or in a compressed format.

### Claim 11 (depends on 9)

The device (300) as claimed in claim 9,
wherein the storage means (301) are adapted to store the spectral power information per time and/or frequency sub-band.

### Claim 12 (depends on 1)

The device (100) as claimed in claim 1,
wherein the position information comprises information in terms of elevation information and/or azimuth information and/or distance information.

### Claim 13 (depends on 9)

The device (100) as claimed in claim 9,
realized as one of the group consisting of a portable audio player, a portable video player, a head-mounted display, a mobile phone, a DVD player, a CD player, a hard disk-based media player, an internet radio device, a public entertainment device, an MP3 player, a PC-based media player, a telephone conference device, and a jet fighter.

### Claim 14

A method of processing audio data (101),
wherein the method comprises the steps of:
receiving a number of audio input signals for generating a summation signal,
filtering said summation signal dependent on filter coefficients resulting in at least two audio output signals,
receiving, on the one hand, position information, which is representative of spatial positions of sound sources of said audio input signals, and, on the other hand, spectral power information which is representative of a spectral power of said audio input signals,
generating said filter coefficients on the basis of the position information and the spectral power information, and
receiving transfer function parameters and generating said filter coefficients in dependence on said transfer function parameters;
the method being characterized by the filter coefficients (SF1, SF2) being generated in response to an averaged set of spatial parameters determined by a weighting of spatial parameters of each sound source depending on an energy of each sound source in a frequency band.

### Claim 15

A computer-readable medium, in which a computer program for processing audio data is stored, which computer program, when being executed by a processor, is adapted to control or carry out the method steps of
receiving a number of audio input signals for generating a summation signal,
filtering said summation signal dependent on filter coefficients resulting in at least two audio output signals,
receiving, on the one hand, position information, which is representative of spatial positions of sound sources of said audio input signals, and, on the other hand, spectral power information which is representative of a spectral power of said audio input signals,
generating said filter coefficients on the basis of the position information and the spectral power information, and
receiving transfer function parameters and generating said filter coefficients in dependence on said transfer function parameters;
and the computer-readable medium being characterized by the filter coefficients (SF1, SF2) being generated in response to an averaged set of spatial parameters determined by a weighting of spatial parameters of each sound source depending on an energy of each sound source in a frequency band.

### Claim 16

A program element for processing audio data, which program element, when being executed by a processor, is adapted to control or carry out the method steps of receiving a number of audio input signals for generating a summation signal,
filtering said summation signal dependent on filter coefficients resulting in at least two audio output signals,
receiving, on the one hand, position information, which is representative of spatial positions of sound sources of said audio input signals, and, on the other hand, spectral power information which is representative of a spectral power of said audio input signals,
generating said filter coefficients on the basis of the position information and the spectral power information, and
receiving transfer function parameters and generating said filter coefficients in dependence on said transfer function parameters,
and the program element being characterized by the filter coefficients (SF1, SF2) being generated in response to an averaged, set of spatial parameters determined by a weighting of spatial parameters of each sound source depending on an energy of each sound, source in a frequency band.
