US 9,439,019 B2 · Sound signal processing method and apparatus

Abstract

A sound signal processing method and apparatus are provided that relate to the audio signal processing field. The method in the present invention includes acquiring, by a mobile terminal, sound signals from a three-dimensional sound field, where at least three microphones are disposed on the mobile terminal and one microphone is configured to receive a sound signal in at least one direction; acquiring, according to the acquired sound signals, a direction of a sound source relative to the mobile terminal; and obtaining spatial audio signals according to the direction of the sound source relative to the mobile terminal and the acquired sound signals, where the spatial audio signals are used for simulating the three-dimensional sound field. The present invention is applicable to a process of collecting and processing signals in a three-dimensional sound field surrounding a terminal.

A sound signal processing method, comprising:

acquiring, by a mobile terminal, sound signals from a three-dimensional sound field, wherein at least three microphones are disposed on the mobile terminal and one microphone is configured to receive a sound signal in at least one direction;
acquiring, according to the acquired sound signals, a direction of a sound source relative to the mobile terminal;
and
obtaining spatial audio signals according to the direction of the sound source relative to the mobile terminal and the acquired sound signals, wherein the spatial audio signals are used for simulating the three-dimensional sound field,
wherein acquiring, according to the acquired sound signals, the direction of the sound source relative to the mobile terminal comprises:
acquiring a time difference of arrival between a sound signal in one direction and a sound signal in another direction that are received by the microphones on the mobile terminal, wherein the microphones on the mobile terminal are configured to receive the sound signals in at least four directions;
and
obtaining, according to the acquired time difference of arrival and locations of the microphones on the mobile terminal, the direction of the sound source relative to the mobile terminal,
wherein acquiring the time difference of arrival between the sound signal in one direction and the sound signal in another direction that are received by the microphones on the mobile terminal comprises acquiring, according to
τ
^
m
=
argmax
p
⁢
r
y
1
⁢
y
m
⁡
(
p
)
,
a time difference {circumflex over (τ)}m of arrival between a sound signal received by an mth microphone and a sound signal received by a 1st microphone,
wherein p represents a quantity of delay sampling points, y1(n) represents the sound signal received by the 1st microphone, ym(n) represents the sound signal received by the mth microphone,
r
y
1
⁢
y
m
⁡
(
p
)
=
∫
-
∞
∞
⁢
Φ
⁡
(
f
)
⁢
S
y
1
⁢
y
m
⁡
(
f
)
⁢
ⅇ
j2π
⁢
⁢
f
⁢
⁢
ρ
⁢
⁢
ⅆ
f
,
Sy1ym(f) represents a correlated spectrum between y1(n) and ym(n), and Φ(f) represents a weight function of a frequency domain in which the sound signals received in all directions are located, and
wherein obtaining, according to the acquired time difference of arrival and locations of the microphones on the mobile terminal, the direction of the sound source relative to the mobile terminal comprises:
estimating, according to
θ
^
2
=
arcsin
⁡
(
τ
^
2
⁢
c
h
)
,
a direction {circumflex over (θ)}2 of a sound signal received by a 2nd microphone;
estimating, according to
θ
^
3
=
arccos
⁡
(
τ
^
3
⁢
c
d
2
+
h
2
)
-
α
,
a direction {circumflex over (θ)}3 of a sound signal received by a 3rd microphone;
estimating, according to
θ
^
4
=
arccos
⁡
(
τ
^
4
⁢
c
d
)
,
a direction {circumflex over (θ)}4 of a sound signal received by a 4th microphone;
and
acquiring, according to
θ
=
1
3
⁢
∑
m
=
2
4
⁢
⁢
θ
^
m
,
the direction θ of the sound source relative to the mobile terminal,
wherein the 1st microphone and the 4th microphone are located on a same side and the 1st microphone and the 2nd microphone are located on a same side, and
wherein c represents a sound speed, d represents a distance between a central point of the 1st microphone and a central point of the 4th microphone, d is equal to a distance between a central point of the 2nd microphone and a central point of the 3rd microphone, h represents a distance between the central point of the 1st microphone and the central point of the 2nd microphone, h is equal to a distance between the central point of the 3rd microphone and the central point of the 4th microphone, and α represents an included angle between a diagonal of the mobile terminal and a side of an angle at which the 1st microphone and the 4th microphone are located.

152 more elements

Sound signal processing method and apparatus

Life of this patent

Sound signal processing method and apparatus

Life of this patent

Abstract

Claims9