US 10,873,826 B2Granted

Binaural rendering apparatus and method for playing back of multiple audio sources

AssigneePanasonic Intellectual Property Corporation of America

InventorsHiroyuki Ehara, Kai Wu, Sua Hong Neo

Life of this patent

Estimating the term…

Loading patent…

Abstract

A method of generating binaural headphone playback signals given multiple audio source signals with an associated metadata and binaural room impulse response (BRIR) database is provided, wherein the audio source signals can be channel-based, object-based, or a mixture of both signals. The method includes grouping the audio source signals according to positions of the audio sources, parameterizing BRIR to be used for rendering, and dividing each audio source signal to be rendered into a number of blocks and frames. The method also includes averaging the parameterized BRIR sequences, downmixing the divided audio source signals using the diffuse blocks of BRIRs, and performing late reverberation processing on the downmixed version of the previous blocks of the audio source signals.

Claims14

Dependent claims

grouping the audio source signals according to positions of the audio sources;
parameterizing BRIR to be used for rendering;
dividing each audio source signal to be rendered into a number of blocks and frames;
averaging the parameterized BRIR sequences;
downmixing the divided audio source signals using the diffuse blocks of BRIRs;
and
performing late reverberation processing on the downmixed version of the previous blocks of the audio source signals,
wherein, the late reverberation processing γ( ) of the previous blocks is a multiplication processing in the frequency domain of the average signal of K from the current to w blocks before (current-w) and the wth block of BRIR of hθave, the output of the late reverberation y(current-w) is denoted by Equation 1,
y
(
current
-
w
)
=
γ
⁡
(
1
K
⁢
∑
k
=
1
K
⁢
⁢
s
k
(
current
-
w
)
⁡
(
n
)
,
h
θ
ave
(
w
)
⁡
(
n
)
)
[
Equation
⁢
⁢
1
]
Current:
index of current block
W:
index of diffuse blocks
n:
sample index (n=0, 1, 2, . . . , n)
K:
audio source (k=1, 2, . . . , k)
Sk(current-w):
current block of the kth source signal
θave:
averaged location of all the K sources
hθave(w)(n):
average of the diffuse blocks.

68 more elements

An integrated circuit (IC) for generating binaural headphone playback signals given multiple audio source signals with an associated metadata and binaural room impulse response (BRIR) database, wherein the audio source signals can be channel-based, object-based, or a mixture of both signals, the method comprising:

one or more processors;
and
one or more memories,
the integrated circuit configured to execute operations, including
grouping the audio source signals according to positions of the audio sources;
parameterizing BRIR to be used for rendering;
dividing each audio source signal to be rendered into a number of blocks and frames;
averaging the parameterized BRIR sequences;
downmixing the divided audio source signals using the diffuse blocks of BRIRs;
and
performing late reverberation processing on the downmixed version of the previous blocks of the audio source signals,
wherein, the late reverberation processing γ( ) of the previous blocks is a multiplication processing in the frequency domain of the average signal of K from the current to w blocks before (current-w) and the wth block of BRIR of hθave, the output of the late reverberation y(current-w) is denoted by Equation 1,
y
(
current
-
w
)
=
γ
⁡
(
1
K
⁢
∑
k
=
1
K
⁢
⁢
s
k
(
current
-
w
)
⁡
(
n
)
,
h
θ
ave
(
w
)
⁡
(
n
)
)
[
Equation
⁢
⁢
1
]
Current:
index of current block
W:
index of diffuse blocks
n:
sample index (n=0, 1, 2, . . . , n)
K:
audio source (k=1, 2, . . . , k)
Sk(current-w):
current block of the kth source signal
θave:
averaged location of all the K sources
hθave(w)(n):
average of the diffuse blocks.

72 more elements

Dependencies are inferred from the claim text.

Facts

Application: 16/913,034Filed 26 Jun 2020 · continuation
Priority: JP 2016-21180328 Oct 2016
Published: US 2020/0128351 A115 Oct 2020
Granted: 22 Dec 2020
Term ends: Not estimatedThe source records don’t support an estimate.

Classification8 codes

H04S 7/304
Tracking of listener position or orientation: for headphones
G10L 19/008
Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals,…:…
H04S 1/005
Non-adaptive circuits, e.g. manually adjustable or static, for enhancing the sound image or the spatial distribution: for headphones
H04S 7/305
Control circuits for electronic adaptation of the sound field: electronic adaptation of stereophonic audio signals to reverberation of the…

Family

PCT/JP2017/036738Parent of this continuation · filed 11 Oct 2017
Application16/724,921Parent of this continuation · filed 23 Dec 2019
US 10,555,107 B2Parent of this continuation · filed 4 Feb 2020
US 2020/0329332 A1Pre-grant publication · published 15 Oct 2020
US 10,735,886 B2Parent of this continuation
Application16/341,861Parent of this continuation
US 2019/0246236 A1Published application
US 2020/0128351 A1Published application
US 10,873,826 B2This patent

From the US filing history. Foreign family members aren’t listed.

Timeline

Citations

Open elsewhere

Building an agent or pulling many patents? Use the API or MCP server instead of scraping pages. Get an API key