# US 2022/0279302 A1 · Audio Object Renderer, Methods for determining loudspeaker gains and computer program using panned object loudspeaker gains and spread object loudspeaker gains

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0279302 A1
- Document ID: US20220279302A1
- Status: Published application
- Kind: A1
- Application number: 17/749,922
- Filed: 2022-05-20
- Published: 2022-09-01
- Earliest claimed: 2020-11-20
- Applicants: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
- Inventors: Aleksandr KARAPETYAN; Oliver WUEBBOLT; Christian BORSS; Philipp STADTER
- Web page: https://patentgrep.com/patent/US20220279302A1

## CPC

- H04S 7/30: {Control circuits for electronic adaptation of the sound field}
- H04R 3/12: for distributing signals to two or more loudspeakers {(specially adapted for hearing aids H04R25/407)}
- H04R 5/04: Circuit arrangements, {e.g. for selective connection of amplifier inputs/outputs to loudspeakers, for loudspeaker detection, or for adaptation of settings to personal preferences or hearing impairments (combinations of amplifiers H03F3/68; stereophonic systems H04S)}
- H04S 2400/11: Positioning of individual sound objects, e.g. moving airplane, within a sound field (H04S2420/13 takes precedence)
- H04S: STEREOPHONIC SYSTEMS
- H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K)

## Abstract

An audio object renderer for determining loudspeaker gains describing gains for an inclusion of one or more audio object signals into a plurality of loudspeaker signals on the basis of an object position information and an object feature information or a spread information is configured to obtain panned object loudspeaker gains using a point source panning of the audio object. The audio object renderer is configured to obtain spread object loudspeaker gains considering the object position information and the object feature information or spread information. The audio object renderer is configured to combine the panned object loudspeaker gains and the spread object loudspeaker gains in such a manner, that there is a contribution of the panned object loudspeaker gains, in order to obtain combined loudspeaker gains. Methods and computer programs are also described.

## Claims

### Claim 1

An audio object renderer for determining loudspeaker gains for an inclusion of one or more audio object signals into a plurality of loudspeaker signals on the basis of an object position information and an object feature information,
wherein the audio object renderer is configured to acquire panned object loudspeaker gains using a point source panning of the audio object, wherein the audio object is considered as a point source in the point source panning, and wherein the object feature information is neglected in the point source panning;
wherein the point source panning uses the object position information;
wherein the audio object renderer is configured to acquire object feature information loudspeaker gains, wherein the audio object is spread over an extended region, considering the object feature information;
wherein the audio object renderer is configured to combine the panned object loudspeaker gains and the object feature information loudspeaker gains in such a manner, that there is a contribution of the panned object loudspeaker gains, in order to acquire combined loudspeaker gains;
wherein the determination of the object feature information loudspeaker gains considers an extension of the audio object.

### Claim 2 (depends on 1)

An audio object renderer according to claim 1;
wherein the audio object renderer is configured to acquire object feature information loudspeaker gains additionally considering the object position information;

### Claim 3 (depends on 1)

An audio object renderer according to claim 1;
wherein said object feature information is audio object spread information;

### Claim 4 (depends on 2)

An audio object renderer according to claim 2;
wherein said object feature information is audio object spread information;

### Claim 5

An audio object renderer for determining loudspeaker gains for an inclusion of one or more audio object signals into a plurality of loudspeaker signals on the basis of an object position information and an object feature information,
wherein the audio object renderer is configured to acquire panned object loudspeaker gains using a point source panning of the audio object, wherein the audio object is considered as a point source in the point source panning, and wherein the object feature information is neglected in the point source panning;
wherein the point source panning uses the object position information;
wherein the audio object renderer is configured to acquire spread object loudspeaker gains, wherein the audio object is spread over an extended region, considering the object position information and the object feature information;
wherein the audio object renderer is configured to combine the panned object loudspeaker gains and the spread object loudspeaker gains in such a manner, that there is a contribution of the panned object loudspeaker gains, in order to acquire combined loudspeaker gains;
wherein the determination of the spread object loudspeaker gains considers an extension of the audio object.

### Claim 6

An audio object renderer for determining loudspeaker gains for an inclusion of one or more audio object signals into a plurality of loudspeaker signals on the basis of an object position information and a spread information,
wherein the audio object renderer is configured to acquire panned object loudspeaker gains using a point source panning of the audio object, wherein the audio object is considered as a point source in the point source panning, and wherein the spread information is neglected in the point source panning;
wherein the point source panning uses the object position information;
wherein the audio object renderer is configured to acquire spread object loudspeaker gains, wherein the audio object is spread over an extended region, considering the object position information and the spread information;
wherein the audio object renderer is configured to combine the panned object loudspeaker gains and the spread object loudspeaker gains in such a manner, that there is a contribution of the panned object loudspeaker gains, in order to acquire combined loudspeaker gains;
wherein the determination of the spread object loudspeaker gains considers an extension of the audio object.

### Claim 7 (depends on 1)

The audio object renderer according to claim 1,
wherein the audio object renderer is configured to evaluate one or more gain functions, which map differences between positions of supporting points and an object position onto one or more spread gain value contributions, and to determine the spread object loudspeaker gains on the basis of the one or more spread gain value contributions.

### Claim 8 (depends on 1)

The audio object renderer according to claim 1,
wherein the audio object renderer is configured to determine a weighting of the spread object loudspeaker gains in the combination with the panned object loudspeaker gains, which is a weighted combination, in dependence on a spread in a first direction and in dependence on a spread in a second direction.

### Claim 9 (depends on 1)

The audio object renderer according to claim 1,
wherein the audio object renderer is configured to determine a weighting (attenGain, gatten) of the spread object loudspeaker gains in the combination with the panned object loudspeaker gains, which is a weighted combination, in dependence on a product of a spread angle in a first direction and of a spread angle in a second direction.

### Claim 10 (depends on 1)

The audio object renderer according to claim 1,
wherein the audio object renderer is configured to add panned object loudspeaker gains, weighted with a fixed weight, and spread object loudspeaker gains, weighted with a variable weight which is dependent on a spread angle in a first direction and a spread angle in a second direction.

### Claim 11 (depends on 10)

The audio object renderer according to claim 10,
wherein the audio object renderer is configured to normalize a result of the addition of the panned object loudspeaker gains, weighted with a fixed weight, and of the spread object loudspeaker gains, weighted with a variable weight.

### Claim 12 (depends on 1)

The audio object renderer according to claim 1,
wherein the audio object renderer is configured to determine a weighting attenGain of the spread object loudspeaker gains in the combination with the panned object loudspeaker gains, which is a weighted combination, according to
attenGain=0.89f*min(c1,max(spreadazi,spreadele)/gres1)+0.11f*min(c2,min(spreadazi,spreadele)/gres2);
wherein c1 is a predetermined value;
wherein c2 is a predetermined value;
wherein gres1 is a predetermined value;
wherein gres2 is a predetermined value;
wherein spreadazi is a spreading angle of an audio object in an azimuth direction; and
wherein spreadele is a spreading angle of the audio object in an elevation direction; and
wherein min(.) is a minimum operator; and
wherein max(.) is a maximum operator.

### Claim 13 (depends on 1)

The audio object renderer according to claim 1,
wherein the audio object renderer is configured to increase a relative contribution of the spread object loudspeaker gains when compared to the panned object loudspeaker gains with increasing spread angles of the audio object.

### Claim 14 (depends on 1)

The audio object renderer according to claim 1,
wherein the audio object renderer is configured to acquire spread object loudspeaker gains considering the object position information and the spread information and using a representation of supporting point positions in polar coordinates; and
wherein the audio object renderer is configured to provide the loudspeaker gains on the basis of the spread object loudspeaker gains.

### Claim 15 (depends on 1)

The audio object renderer according to claim 1,
wherein the audio object renderer is configured
to evaluate one or more angle differences between an azimuth position of the audio object and of one or more supporting points, and/or
to evaluate one or more angle differences between an elevation position of audio object and elevation positions of one or more supporting points,
in order to acquire the spread loudspeaker gains.

### Claim 16 (depends on 1)

The audio object renderer according to claim 1,
wherein supporting point positions are arranged on a sphere within a tolerance of +/−10% or +/−20% of a radius of the sphere.

### Claim 17 (depends on 1)

The audio object renderer according to claim 1,
wherein supporting point positions comprise a uniform azimuth angle spacing along a circle comprising a constant elevation and a constant radius, and/or
wherein supporting point positions comprise a uniform elevation angle along a circle comprising a constant azimuth and a constant radius.

### Claim 18 (depends on 1)

Audio object renderer according to claim 1,
wherein the object renderer is configured to acquire the spread object loudspeaker gains such that an audio object is spread over a region which extends in a first hemisphere, in which the audio object is located, and which also extends in a second hemisphere, an azimuthal position of which is opposite to the first hemisphere.

### Claim 19 (depends on 18)

Audio object renderer according to claim 18,
Wherein the audio object renderer is configured to use an extended elevation range between −180 degree and +180 degree.

### Claim 20 (depends on 18)

Audio object renderer according to claim 18,
wherein the audio object renderer is configured to compute, for a given object position and for a given spread
a first set of azimuth gain values describing contributions to the spread gains for a plurality of azimuth values associated with supporting point positions or supporting point azimuth indices, which is associated with elevation values in an original elevation value range which indicates no crossing of a pole of the spherical coordinate system, and
a second set of azimuth gain values describing contributions to the spread gains for a plurality of azimuth values associated with supporting point positions or supporting point azimuth indices, which is associated with elevation values in an extended elevation value range which indicates a crossing of one of the poles of the spherical coordinate system, and
and to derive the spread gains using the first set of azimuth gain values and using the second set of azimuth gain values.

### Claim 21 (depends on 20)

Audio object renderer according to claim 20,
wherein the audio object renderer is configured to compute, for a given object position and for a given spread
a first set of elevation gain values describing contributions to the spread gains for a plurality of elevation values associated with supporting point positions or loudspeaker azimuth indices or supporting point elevation indices, which is associated with elevation values in an original elevation value range which indicates no crossing of a pole of the spherical coordinate system, and
a second set of elevation gain values describing contributions to the spread gains for a plurality of elevation values associated with supporting point positions or loudspeaker elevation indices or supporting point elevation indices, which is associated with elevation values in an extended elevation value range which indicates a crossing of one of the poles of the spherical coordinate system, and
to derive the spread gains using the first set of azimuth gain values, using the second set of azimuth gain values, using a first set of elevation gain values, and using the second set of elevation gain values.

### Claim 22 (depends on 18)

Audio object renderer according to claim 18,
wherein the audio object renderer is configured to combine values of the first set of azimuth gain values and of the first set of elevation gain values and to combine values of the second set of azimuth gain values and of the second set of elevation gain values.

### Claim 23 (depends on 18)

Audio object renderer according to claim 18,
Wherein the second set of azimuth gain values represents an evolution of gain values over an azimuth angle which is shifted by 180 degrees when compared to an evolution of gain values over the azimuth angle represented by the first set of azimuth gain values.

### Claim 24 (depends on 18)

Audio object renderer according to claim 18,
wherein the first set of azimuth gain values represents an evolution of gain values over a range of 360 degrees in view of an azimuth object position and an azimuth spread angle with an angle accuracy determined by a number of loudspeakers or by a number of supporting points, and/or
wherein the second set of azimuth gain values represents an evolution of gain values over a range of 360 degrees in view of an azimuth object position, rotated by 180 degrees, and an azimuth spread angle with an angle accuracy determined by a number of loudspeakers or by a number of supporting points.

### Claim 25 (depends on 18)

Audio object renderer according to claim 18,
wherein the first set of elevation gain values represents an evolution of gain values over an elevation range between −90 degree and +90 degree in view of an elevation object position, and an elevation spread angle, and/or
wherein the second set of elevation gain values represents an evolution of gain values over an elevation range between −180 degree to −90 degree and between +90 degree and +180 degree in view of an elevation object position, and an elevation spread angle.

### Claim 26 (depends on 1)

Audio object renderer according to claim 1,
Wherein the audio object renderer is configured to determine loudspeaker gains describing gains for an inclusion of one or more audio object signals into a plurality of loudspeaker signals on the basis of an object position information and a spread information,
wherein the object renderer is configured to acquire spread object loudspeaker gains considering the object position information and the spread information,
wherein the object renderer is configured to acquire spread gains using one or more polynomial functions comprising a degree which is smaller than or equal to three which map an angle difference between an object position and a supporting point position onto a spread gain value contribution, and
wherein the object renderer is configured to acquire the spread object loudspeaker gains using spread gains, which are based on the spread gain contributions.

### Claim 27 (depends on 26)

Audio object renderer according to claim 26,
wherein a width of the one or more polynomial functions is determined by the spread information.

### Claim 28 (depends on 26)

Audio object renderer according to claim 26,
wherein the object renderer is configured to acquire a spread gain value using a first polynomial function, which maps an azimuth angle difference between an object position and a supporting point position onto a first spread gain value contribution, and using a second polynomial function, which maps an elevation angle difference between an object position and a supporting point position onto a second spread gain value contribution.

### Claim 29 (depends on 28)

The audio object renderer according to claim 28,
wherein the audio object render is configured to combine the first spread gain contribution and the second spread gain contribution, to acquire a spread gain value.

### Claim 30 (depends on 26)

Audio object renderer according to claim 26,
wherein the object renderer is configured to compute, for a given object position and for a given spread
a set of azimuth gain values describing contributions to the spread gains for a plurality of azimuth values associated with supporting point positions or loudspeaker azimuth indices or supporting point azimuth indices, and/or
a set of elevation gain values describing contributions to the spread gains for a plurality of elevation values associated with supporting point positions or loudspeaker elevation indices or supporting point elevation indices,
and to derive the spread gains using the set of azimuth gain values.

### Claim 31 (depends on 30)

Audio object renderer according to claim 30,
wherein the audio object renderer is configured to combine an element of the set of azimuth gain values associated with a currently considered loudspeaker or a currently considered supporting point with an element of the set of elevation gain values associated with the currently considered loudspeaker or the currently considered supporting point, in order to acquire spread gain values, associated with a plurality of different loudspeakers or with a plurality of different supporting points.

### Claim 32 (depends on 26)

Audio object renderer according to claim 26,
wherein the audio object renderer is configured to compute, for a given object position and for a given spread
a first set of azimuth gain values describing contributions to the spread gains for a plurality of azimuth values associated with supporting point positions or loudspeaker azimuth indices or supporting point azimuth indices, which is associated with elevation values in an original elevation value range which indicates no crossing of a pole of the spherical coordinate system, and
a second set of azimuth gain values describing contributions to the spread gains for a plurality of azimuth values associated with supporting point positions or loudspeaker azimuth indices or supporting point azimuth indices, which is associated with elevation values in an extended elevation value range which indicates a crossing of a pole of the spherical coordinate system, and
and to derive the spread gains using the set of azimuth gain values and/or using a set of elevation gain values.

### Claim 33 (depends on 32)

Audio object renderer according to claim 32,
wherein the audio object renderer is configured to compute, for a given object position and for a given spread
a first set of elevation gain values describing contributions to the spread gains for a plurality of elevation values associated with supporting point positions or loudspeaker azimuth indices or supporting point elevation indices, which is associated with elevation values in an original elevation value range which indicates no crossing of a pole of the spherical coordinate system], and
a second set of elevation gain values describing contributions to the spread gains for a plurality of elevation values associated with supporting point positions or loudspeaker elevation indices or supporting point elevation indices, which is associated with elevation values in an extended elevation value range which indicates a crossing of a pole of the spherical coordinate system, and
to derive the spread gains using the set of azimuth gain values and using a set of elevation gain values.

### Claim 34 (depends on 26)

Audio object renderer according to claim 26,
wherein the audio object renderer is configured to pre-compute supporting point panning gains for panning audio signals associated to a plurality of supporting points onto a plurality of loudspeakers during an initialization using a panning, and
wherein the audio object renderer is configured to acquire object-to-supporting-point spread gains describing contributions of an audio object signal to a plurality of supporting point signals using the polynomial function comprising a degree which is smaller than or equal to three; and
wherein the audio object renderer is configured to combine the object-to-supporting-point spread gains and the supporting point panning gains, in order to acquire the spread object loudspeaker gains.

### Claim 35 (depends on 26)

Audio object renderer according to claim 26,
wherein the one or more polynomial functions comprising a degree which is smaller than or equal to three are parabolic functions which provide a return value p according to
p=max(0,c1*anglediff2+c2),
wherein c1 is a parameter determining a width of the parabolic function;
wherein c2 is a predetermined value;
wherein angeldiff is an angle difference for which the parabolic function is evaluated; and
wherein max(.,.) is a maximum value operator returning a maximum value of its operands.

### Claim 36 (depends on 1)

Audio object renderer according to claim 1,
wherein the audio object renderer is configured to provide the combined loudspeaker gains on the basis of both the point source panning of the audio object signal and a spreading of the audio object signal.

### Claim 37 (depends on 1)

Audio object renderer according to claim 1,
Wherein the determination of the object feature information loudspeaker gains spreads the audio object over a larger number of speakers than the determination of the panned object loudspeaker gains.

### Claim 38

A method for determining loudspeaker gains for an inclusion of one or more audio object signals into a plurality of loudspeaker signals on the basis of an object position information and an object feature information,
wherein the method comprises acquiring panned object loudspeaker gains using a point source panning of the audio object, wherein the audio object is considered as a point source in the point source panning, and wherein the object feature information is neglected in the point source panning;
wherein the point source panning uses the object position information;
wherein the method comprises acquiring object feature information loudspeaker gains, wherein the audio object is spread over an extended region, considering the object feature information
wherein the method comprises combining the panned object loudspeaker gains and the object feature information loudspeaker gains in such a manner, that there is a contribution of the panned object loudspeaker gains, in order to acquire combined loudspeaker gains,
wherein the determination of the object feature information loudspeaker gains considers an extension of the audio object.

### Claim 39

A method for determining loudspeaker gains for an inclusion of one or more audio object signals into a plurality of loudspeaker signals on the basis of an object position information and an object feature information,
wherein the method comprises acquiring panned object loudspeaker gains using a point source panning of the audio object,
wherein the audio object is considered as a point source in the point source panning, and
wherein the object feature information is neglected in the point source panning;
wherein the point source panning uses the object position information;
wherein the method comprises acquiring spread object loudspeaker gains, wherein the audio object is spread over an extended region, considering the object position information and the object feature information;
wherein the method comprises combining the panned object loudspeaker gains and the spread object loudspeaker gains in such a manner, that there is a contribution of the panned object loudspeaker gains, in order to acquire combined loudspeaker gains
wherein the determination of the spread object loudspeaker gains considers an extension of the audio object.

### Claim 40

A method for determining loudspeaker gains for an inclusion of one or more audio object signals into a plurality of loudspeaker signals on the basis of an object position information and a spread information,
wherein the method comprises acquiring panned object loudspeaker gains using a point source panning of the audio object, wherein the audio object is considered as a point source in the point source panning, and wherein the spread information is neglected in the point source panning;
wherein the point source panning uses the object position information;
wherein the method comprises acquiring spread object loudspeaker gains, wherein the audio object is spread over an extended region, considering the object position information and the spread information;
wherein the method comprises combining the panned object loudspeaker gains and the spread object loudspeaker gains in such a manner, that there is a contribution of the panned object loudspeaker gains, in order to acquire combined loudspeaker gains;
wherein the determination of the spread object loudspeaker gains considers an extension of the audio object.

### Claim 41 (depends on 38)

A method according to claim 38,
wherein the method comprises evaluating one or more gain functions, which map differences between positions of supporting points and an object position onto one or more spread gain value contributions, and determining the spread object loudspeaker gains on the basis of the one or more spread gain value contributions.

### Claim 42 (depends on 38)

A method according to claim 38,
wherein the method comprises acquiring spread object loudspeaker gains considering the object position information and the object feature information,
wherein the method comprises acquiring spread gains using one or more polynomial functions comprising a degree which is smaller than or equal to three which map an angle difference between an object position and a supporting point position onto a spread gain value contribution, and
wherein the method comprises acquiring the spread object loudspeaker gains using spread gains, which are based on the spread gain contributions, or using the spread gains as the spread object loudspeaker gains.

### Claim 43 (depends on 38)

A method according to claim 38
wherein the method determines loudspeaker gains describing gains for an inclusion of one or more audio object signals into a plurality of loudspeaker signals on the basis of an object position information and a spread information,
wherein the method comprises acquiring spread object loudspeaker gains considering the object position information and the spread information,
wherein the method comprises acquiring spread gains using one or more polynomial functions comprising a degree which is smaller than or equal to three which map an angle difference between an object position and a supporting point position onto a spread gain value contribution, and
wherein the method comprises acquiring the spread object loudspeaker gains using spread gains, which are based on the spread gain contributions, or using the spread gains as the spread object loudspeaker gains.

### Claim 44

A non-transitory digital storage medium having a computer program stored thereon to perform a method for determining loudspeaker gains for an inclusion of one or more audio object signals into a plurality of loudspeaker signals on the basis of an object position information and an object feature information,
wherein the method comprises acquiring panned object loudspeaker gains using a point source panning of the audio object, wherein the audio object is considered as a point source in the point source panning, and wherein the object feature information is neglected in the point source panning;
wherein the point source panning uses the object position information;
wherein the method comprises acquiring object feature information loudspeaker gains, wherein the audio object is spread over an extended region, considering the object feature information,
wherein the method comprises combining the panned object loudspeaker gains and the object feature information loudspeaker gains in such a manner, that there is a contribution of the panned object loudspeaker gains, in order to acquire combined loudspeaker gains,
wherein the determination of the object feature information loudspeaker gains considers an extension of the audio object,
when said computer program is run by a computer.

### Claim 45

An audio object renderer for determining loudspeaker gains for an inclusion of one or more audio object signals into a plurality of loudspeaker signals on the basis of an object position information and a spread information,
wherein the audio object renderer is configured to acquire panned object loudspeaker gains using a point source panning of the audio object, wherein the audio object is considered as a point source in the point source panning, wherein the spread information is neglected, and wherein a single loudspeaker is selected for a playback of an audio object or wherein an audio object is distributed to a plurality of loudspeakers which are closest to the audio object,
wherein the panned object loudspeaker gains are based on the object position information;
wherein the audio object renderer is configured to acquire spread object loudspeaker gains based on the object position information and the spread information, wherein the audio object is spread over an extended region;
wherein the audio object renderer is configured to combine the panned object loudspeaker gains and the spread object loudspeaker gains in such a manner, that there is a contribution of the panned object loudspeaker gains, namely that the contribution of the panned object loudspeaker gains in the combination is non-zero, in order to acquire combined loudspeaker gains;
wherein the determination of the spread object loudspeaker gains considers an extension of the audio object;
wherein the audio object renderer is configured to provide the combined loudspeaker gains on the basis of both the point source panning of the audio object signal and a spreading of the audio object signal; and
wherein the determination of the spread object loudspeaker gains spreads the audio object over a larger number of speakers than the determination of the panned object loudspeaker gains.
