# US 2017/0289677 A1 · Sound pick-up apparatus and method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0289677 A1
- Document ID: US20170289677A1
- Status: Published application
- Kind: A1
- Application number: 15/376,747
- Filed: 2016-12-13
- Published: 2017-10-05
- Earliest claimed: 2016-03-29
- Assignees: Oki Electric Industry Co., Ltd.
- Applicants: Oki Electric Industry Co., Ltd.
- Inventors: Kazuhiro KATAGIRI
- Web page: https://patentgrep.com/patent/US20170289677A1

## CPC

- H04R 3/005: {for combining the signals of two or more microphones (specially adapted for hearing aids H04R25/407)}
- H04R 1/326: {for microphones (H04R1/34 and H04R1/40 take precedence)}
- H04R 1/406: {microphones}
- H04R 2201/401: 2D or 3D arrays of transducers
- H04R 2410/01: Noise reduction using microphones having different directional characteristics
- H04R 2430/01: Aspects of volume control, not necessarily automatic, in sound systems
- H04R 2430/21: Direction finding using differential microphone array [DMA]
- H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K)

## Abstract

To improve, when area sound pick-up is performed to collect sounds from a sound source in a target area, the sound quality of the collected sounds. The present invention relates to a sound pick-up apparatus that performs area sound pick-up. The sound pick-up apparatus calculates a sound volume level of a mixing signal to mix with a target area sound on the basis of power of estimated noise obtained by estimating background noise included in an input signal input from a microphone array, and power of a non-target area sound, adjusts a sound volume level of the input signal, and a sound volume level of the estimated noise to mix with the mixing signal on the basis of the sound volume level of the calculated mixing signal, and generates and outputs a mixed target area sound with which the input signal that is adjusted to have the calculated sound volume level and the estimated noise that is adjusted to have the calculated sound volume level are mixed.

## Claims

### Claim 1

A sound pick-up apparatus comprising:
a noise reduction unit configured to estimate background noise included in an input signal input from a microphone array, to acquire the estimated background noise as estimated noise, to use the acquired estimated noise to reduce a noise component of the input signal, and to acquire a noise-reduced signal;
a directionality formation unit configured to acquire, on the basis of the noise-reduced signal, a first non-target area sound having directionality formed in a direction other than a target area direction, and a target area direction sound having directionality formed in the target area direction;
a target area sound extraction unit configured to extract a second non-target area sound from the target area direction by using the target area direction sound, and to further use the second non-target area sound and the target area direction sound to acquire a target area sound from a sound source in the target area;
a mixing level calculation unit configured to calculate a sound volume level of a mixing signal to mix with the target area sound on the basis of power of the estimated noise, power of the first non-target area sound, and power of the second non-target area sound;
a mixing level adjustment unit configured to adjust a sound volume level of the input signal to mix with the mixing signal, and a sound volume level of the estimated noise to mix with the mixing signal on the basis of the sound volume level of the mixing signal which is calculated by the mixing level calculation unit; and
a signal mixing unit configured to generate and output a mixed target area sound in which the input signal that is adjusted to have the sound volume level calculated by the mixing level adjustment unit and the estimated noise that is adjusted to have the sound volume level calculated by the mixing level adjustment unit are mixed with the target area sound.

### Claim 2 (depends on 1)

The sound pick-up apparatus according to claim 1, wherein
the mixing level adjustment unit calculates a sound volume level of the mixing signal to mix with the target area sound on the basis of a total value of the power of the estimated noise, the power of the first non-target area sound, and the power of the second non-target area sound.

### Claim 3 (depends on 2)

The sound pick-up apparatus according to claim 2, wherein
the mixing level adjustment unit calculates a ratio of the input signal to mix with the target area sound in the mixing signal to the estimated noise on the basis of a ratio of a total of the power of the first non-target area sound and the power of the second non-target area sound to the power of the estimated noise, and adjusts the sound volume level of the input signal to mix with the mixing signal and the sound volume level of the estimated noise to mix with the mixing signal in accordance with the calculated ratio.

### Claim 4

A sound pick-up method comprising:
estimating, by a noise reduction unit, background noise included in an input signal input from a microphone array, acquiring the estimated background noise as estimated noise, using the acquired estimated noise to reduce a noise component of the input signal, and acquiring a noise-reduced signal
acquiring, by a directionality formation unit, on the basis of the noise-reduced signal, a first non-target area sound having directionality formed in a direction other than a target area direction, and a target area direction sound having directionality formed in the target area direction;
extracting, by a target area sound extraction unit, a second non-target area sound from the target area direction by using the target area direction sound, and further using the second non-target area sound and the target area direction sound to acquire a target area sound from a sound source in the target area;
calculating, by a mixing level calculation unit, a sound volume level of a mixing signal to mix with the target area sound on the basis of power of the estimated noise, power of the first non-target area sound, and power of the second non-target area sound;
adjusting, by a mixing level adjustment unit, a sound volume level of the input signal to mix with the mixing signal, and a sound volume level of the estimated noise to mix with the mixing signal on the basis of the sound volume level of the mixing signal which is calculated by the mixing level calculation unit; and
generating and outputting, by a signal mixing unit, a mixed target area sound in which the input signal that is adjusted to have the sound volume level calculated by the mixing level adjustment unit and the estimated noise that is adjusted to have the sound volume level calculated by the mixing level adjustment unit are mixed with the target area sound.