Back to results
US 10,706,870 B2Granted
Sound processing method, apparatus for sound processing, and non-transitory computer-readable storage medium
AssigneeFujitsu Limited
InventorNaoshi Matsuo
Life of this patent
Estimating the term…
Abstract
A sound processing method includes: executing a time frequency conversion process; executing a noise level evaluation process; executing a bandwidth controlling process; executing a sound source direction decision process; executing a gain setting process; executing a correction process; and executing a frequency time conversion process.
Claims15
A sound processing method performed by a computer, the method comprising:
- executing a time frequency conversion process that includes converting a first sound signal acquired from a first sound inputting apparatus and a second sound signal acquired from a second sound inputting apparatus disposed at a position different from that of the first sound inputting apparatus into a first frequency spectrum and a second frequency spectrum in a frequency domain for each of frames having a given time length, respectively;
- executing a noise level evaluation process that includes calculating, for each of the frames, one of power of noise and a signal to noise ratio based on one of the first frequency spectrum and the second frequency spectrum;
- executing a bandwidth controlling process that includes setting, for each of the frames, a width of a frequency band in response to the one of the power of noise and the signal to noise ratio;
- executing a sound source direction decision process that includes comparing, for each of the frames and for each of frequency bands having the width, first power of a frequency component, which is included in the frequency band of one of the first frequency spectrum and the second frequency spectrum, of sound coming from a first direction and second power of a frequency component, which is included in the frequency band of one of the first frequency spectrum and the second frequency spectrum, of sound coming from a second direction different from the first direction with each other;
- executing a gain setting process that includes setting a gain according to a result of the comparison for each of the frames and for each of the frequency bands;
- executing a correction process that includes calculating, for each of the frames and for each of the frequency bands, a frequency spectrum corrected by multiplying a frequency component included in the frequency band of one of the first frequency spectrum and the second frequency spectrum by the gain set for the frequency band;
- and
- executing a frequency time conversion process that includes generating a directional sound signal by frequency time converting the corrected frequency spectrum for each of the frames.
5 more elements
An apparatus for sound processing, the apparatus comprising:
- a memory;
- and
- processor circuitry coupled to the memory, the processor circuitry being configured to
- execute a time frequency conversion process that includes converting a first sound signal acquired from a first sound inputting apparatus and a second sound signal acquired from a second sound inputting apparatus disposed at a position different from that of the first sound inputting apparatus into a first frequency spectrum and a second frequency spectrum in a frequency domain for each of frames having a given time length, respectively;
- execute a noise level evaluation process that includes calculating, for each of the frames, one of power of noise and a signal to noise ratio based on one of the first frequency spectrum and the second frequency spectrum;
- execute a bandwidth controlling process that includes setting, for each of the frames, a width of a frequency band in response to the one of the power of noise and the signal to noise ratio;
- execute a sound source direction decision process that includes comparing, for each of the frames and for each of frequency bands having the width, first power of a frequency component, which is included in the frequency band of one of the first frequency spectrum and the second frequency spectrum, of sound coming from a first direction and second power of a frequency component, which is included in the frequency band of one of the first frequency spectrum and the second frequency spectrum, of sound coming from a second direction different from the first direction with each other;
- execute a gain setting process that includes setting a gain according to a result of the comparison for each of the frames and for each of the frequency bands;
- execute a correction process that includes calculating, for each of the frames and for each of the frequency bands, a frequency spectrum corrected by multiplying a frequency component included in the frequency band of one of the first frequency spectrum and the second frequency spectrum by the gain set for the frequency band;
- and
- execute a frequency time conversion process that includes generating a directional sound signal by frequency time converting the corrected frequency spectrum for each of the frames.
8 more elements
A non-transitory computer-readable storage medium for storing a sound processing program that causes a processor to execute a process, the process comprising:
- executing a time frequency conversion process that includes converting a first sound signal acquired from a first sound inputting apparatus and a second sound signal acquired from a second sound inputting apparatus disposed at a position different from that of the first sound inputting apparatus into a first frequency spectrum and a second frequency spectrum in a frequency domain for each of frames having a given time length, respectively;
- executing a noise level evaluation process that includes calculating, for each of the frames, one of power of noise and a signal to noise ratio based on one of the first frequency spectrum and the second frequency spectrum;
- executing a bandwidth controlling process that includes setting, for each of the frames, a width of a frequency band in response to the one of the power of noise and the signal to noise ratio;
- executing a sound source direction decision process that includes comparing, for each of the frames and for each of frequency bands having the width, first power of a frequency component, which is included in the frequency band of one of the first frequency spectrum and the second frequency spectrum, of sound coming from a first direction and second power of a frequency component, which is included in the frequency band of one of the first frequency spectrum and the second frequency spectrum, of sound coming from a second direction different from the first direction with each other;
- executing a gain setting process that includes setting a gain according to a result of the comparison for each of the frames and for each of the frequency bands;
- executing a correction process that includes calculating, for each of the frames and for each of the frequency bands, a frequency spectrum corrected by multiplying a frequency component included in the frequency band of one of the first frequency spectrum and the second frequency spectrum by the gain set for the frequency band;
- and
- executing a frequency time conversion process that includes generating a directional sound signal by frequency time converting the corrected frequency spectrum for each of the frames.
5 more elements
Dependencies are inferred from the claim text.