# US 10,313,815 B2 · Apparatus and method for generating a plurality of parametric audio streams and apparatus and method for generating a plurality of loudspeaker signals

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,313,815 B2
- Document ID: US10313815B2
- Status: Granted
- Kind: B2
- Application number: 14/712,576
- Filed: 2015-05-14
- Published: 2015-09-03
- Granted: 2019-06-04
- Earliest claimed: 2012-11-15
- Assignees: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.; Technische Universitaet Ilmenau
- Applicants: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.; Technische Universitaet Ilmenau
- Inventors: Fabian Kuech; Giovanni Del Galdo; Achim Kuntz; Ville Pulkki; Archontis Politis
- Web page: https://patentgrep.com/patent/US10313815B2

## CPC

- H04S 5/005: {of the pseudo five- or more-channel type, e.g. virtual surround}
- G10L 19/008: Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing
- G10L 19/08: Determination or coding of the excitation function; Determination or coding of the long-term prediction parameters
- H04S 3/002: {Non-adaptive circuits, e.g. manually adjustable or static, for enhancing the sound image or the spatial distribution (control circuits for electronic adaptation of the sound field H04S7/30)}
- H04S 7/30: {Control circuits for electronic adaptation of the sound field}
- H04S 2400/01: Multi-channel, i.e. more than two input channels, sound reproduction with two speakers wherein the multi-channel information is substantially preserved
- H04S 2400/11: Positioning of individual sound objects, e.g. moving airplane, within a sound field (H04S2420/13 takes precedence)
- H04S 2400/15: Aspects of sound capture and related signal processing for recording or reproduction
- H04S 2420/03: Application of parametric coding in stereophonic audio systems
- H04S 2420/11: Application of ambisonics in stereophonic audio systems
- H04S: STEREOPHONIC SYSTEMS
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

An apparatus for generating a plurality of parametric audio streams from an input spatial audio signal obtained from a recording in a recording space has a segmentor and a generator. The segmentor is configured for providing at least two input segmental audio signals from the input spatial audio signal, wherein the at least two input segmental audio signals are associated with corresponding segments of the recording space. The generator is configured for generating a parametric audio stream for each of the at least two input segmental audio signals to obtain the plurality of parametric audio streams.

## Claims

### Claim 1

An apparatus for generating a plurality of parametric audio streams from an input spatial audio signal acquired from a recording in a recording space, wherein the apparatus comprises:
a segmentor for generating at least two input segmental audio signals from the input spatial audio signal; wherein the segmentor is configured to generate the at least two input segmental audio signals depending on corresponding segments of the recording space, wherein the segments of the recording space each represent a subset of directions within a two-dimensional plane or within a three-dimensional space, and wherein the segments are different from each other; and
a generator for generating a parametric audio stream for each of the at least two input segmental audio signals to acquire the plurality of parametric audio streams, so that the plurality of parametric audio streams each comprise a component of the at least two input segmental audio signals and a corresponding parametric spatial information, wherein the parametric spatial information of each of the parametric audio steams comprises direction-of-arrival parameter and/or a diffuseness parameter.

### Claim 2 (depends on 1)

The apparatus according to claim 1,
wherein the segments of the recording space each comprise an associated directional measure.

### Claim 3 (depends on 1)

The apparatus according to claim 1,
wherein the apparatus is configured for performing a sound field recording to acquire the input spatial audio signal;
wherein the segmentor is configured to divide a full angle range of interest into the segments of the recording space;
wherein the segments of the recording space each cover a reduced angle range compared to the full angle range of interest.

### Claim 4 (depends on 1)

The apparatus according to claim 1,
wherein the input spatial audio signal comprises an omnidirectional signal and a plurality of different directional signals.

### Claim 5 (depends on 4)

The apparatus according to claim 4,
wherein the segmentor is configured to generate the at least two input segmental audio signals from the omnidirectional signal and the plurality of the different directional signals using a mixing operation which depends on the segments of the recording space.

### Claim 6 (depends on 1)

The apparatus according to claim 1,
wherein the segmentor is configured to use a directivity pattern for each of the segments of the recording space;
wherein the directivity pattern indicates a directivity of the at least two input segmental audio signals.

### Claim 7 (depends on 6)

The apparatus according to claim 6,
wherein the directivity pattern is given by
qi(ϑ)=a+b cos(ε+Θi),
wherein a and h denote multipliers which are modified to acquire a desired directivity pattern;
wherein ϑ denotes an azimuthal angle and Θi indicates an advantageous direction of the i'th segment of the recording space.

### Claim 8 (depends on 1)

The apparatus according to claim 1,
wherein the generator is configured for performing a parametric spatial analysis for each of the at least two input segmental audio signals to acquire the corresponding parametric spatial information.

### Claim 9 (depends on 1)

The apparatus according to claim 1, further comprising:
a modifier for modifying the plurality of parametric audio streams in a parametric signal representation domain;
wherein the modifier is configured to modify at least one of the parametric audio streams using a corresponding modification control parameter.

### Claim 10

An apparatus for generating a plurality of loudspeaker signals from a plurality of parametric audio streams; wherein each of the plurality of parametric audio streams comprises a segmental audio component and a corresponding parametric spatial information; wherein the parametric spatial information of each of the parametric audio steams comprises a direction-of-arrival parameter and/or a diffuseness parameter; wherein the apparatus comprises:
a renderer for providing a plurality of input segmental loudspeaker signals from the plurality of parametric audio streams, so that the input segmental loudspeaker signals depend on corresponding segments of a recording space, wherein the segments of the recording space each represent a subset of directions within a two-dimensional plane or within a three-dimensional space, and wherein the segments are different from each other; wherein the renderer is configured for rendering each of the segmental audio components using the corresponding parametric spatial information to acquire the plurality of input segmental loudspeaker signals; and
a combiner for combining the input segmental loudspeaker signals to acquire the plurality of loudspeaker signals.

### Claim 11

A method for generating a plurality of parametric audio streams from an input spatial audio signal acquired from a recording in a recording space, wherein the method comprises:
generating t least two input segmental audio signals from the input spatial audio signal; wherein generating the at least two input segmental audio signals is conducted depending on corresponding segments of the recording space, wherein the segments of the recording space each represent a subset of directions within a two-dimensional plane or within a three-dimensional space, and wherein the segments are different from each other;
generating a parametric audio stream for each of the at least two input segmental audio signals to acquire the plurality of parametric audio streams, so that the plurality of parametric audio streams each comprise a component of the at least two input segmental audio signals and a corresponding parametric spatial information, wherein the parametric spatial information of each of the parametric audio steams comprises direction-of-arrival parameter and/or a diffuseness parameter.

### Claim 12 (depends on 11)

A non-transitory computer-readable medium comprising a computer program comprising a program code for performing the method according to claim 11 when the computer program is executed on a computer.

### Claim 13

A method for generating a plurality of loudspeaker signals from a plurality of parametric audio streams; wherein each of the plurality of parametric audio streams comprises a segmental audio component and a corresponding parametric spatial information; wherein the parametric spatial information of each of the parametric audio steams comprises a direction-of-arrival parameter and/or a diffuseness parameter; wherein the method comprises:
providing a plurality of input segmental loudspeaker signals from the plurality of parametric audio streams, so that the input segmental loudspeaker signals depend on corresponding segments of a recording space, wherein the segments of the recording space each represent a subset of directions within a two-dimensional plane or within a three-dimensional space, and wherein the segments are different from each other; wherein providing the plurality of input segmental loudspeaker signals is conducted by rendering each of the segmental audio components using the corresponding parametric spatial information to acquire the plurality of input segmental loudspeaker signals; and
combining the input segmental loudspeaker signals to acquire the plurality of loudspeaker signals.

### Claim 14 (depends on 13)

A non-transitory computer-readable medium comprising a computer program comprising a program code for performing the method according to claim 13 when the computer program is executed on a computer.
