# US 2012/0249785 A1 · Signal processor and signal processing method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2012/0249785 A1
- Document ID: US20120249785A1
- Status: Published application
- Kind: A1
- Application number: 13/332,198
- Filed: 2011-12-20
- Published: 2012-10-04
- Earliest claimed: 2011-03-31
- Assignees: Kabushiki Kaisha Toshiba
- Inventors: Takashi SUDO; Takehiko ISAKA
- Web page: https://patentgrep.com/patent/US20120249785A1

## CPC

- H04N 7/183: {for receiving images from a single remote source}
- H04M 9/082: {using echo cancellers (echo cancellers per se H04B3/23)}
- H04R 1/403: {loud-speakers}
- H04R 1/406: {microphones}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08)
- H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K)

## Abstract

According to one embodiment, a signal processor includes: a plurality of loudspeakers configured to reproduce sound of a plurality of channels; a plurality of microphones configured to pick up sound of a plurality of channels; a detector configured to detect a user who is present in a direction of a space from which the microphones pick up the sound, and output directional characteristic information indicating a relative direction of the user to the loudspeakers; and a signal processor configured to switch contents of processing to reduce a disturbance signal included in a picked-up sound signal of the sound picked up by the microphones from the picked-up sound signal based on the relative direction indicated by the directional characteristic information.

## Claims

### Claim 1

An apparatus comprising:
a plurality of loudspeakers configured to reproduce sound of a plurality of channels;
a plurality of microphones configured to pick up sound of a plurality of channels;
a detector configured to detect a user who is present in a direction of a space from which the plurality of microphones pick up the sound, and output directional characteristic information indicating a relative direction of the user to the plurality of loudspeakers; and
a signal processor configured to switch contents of processing to reduce a disturbance signal included in a picked-up sound signal of the sound picked up by the plurality of microphones from the picked-up sound signal based on the relative direction indicated by the directional characteristic information.

### Claim 2 (depends on 1)

The apparatus of claim 1, wherein the detector is configured to detect a user based on image data obtained by an imaging module configured to capture an image of the user who is present in an output direction of the plurality of loudspeakers, and output the directional characteristic information indicating the relative direction of a location where the user is present in the imaged data.

### Claim 3 (depends on 1)

The apparatus of claim 1, wherein the detector is configured to produce a plurality of beam signals having directivity axes in different directions based on the picked-up sound signal of the reproduced sound picked up by the plurality of microphones, and identify a direction corresponding to the beam signal having a highest signal level of the plurality of beam signals as a direction where the user is present, and output the directional characteristic information indicating the direction where the user is present as the relative direction.

### Claim 4 (depends on 1)

The apparatus of claim 1, wherein
the signal processor comprises an array processor configured to perform array processing in which a sensitivity is different depending on a direction in which the reproduced sound is picked up, and
the array processor sets the sensitivity for the direction corresponding to the relative direction indicated by the directional characteristic information higher than the sensitivity for the other directions.

### Claim 5 (depends on 1)

The apparatus of claim 1, wherein
the signal processor comprises an echo component removal module configured to set the reproduced sound as a reference signal, and remove an echo component included in the picked-up sound signal of the reproduced sound picked up by the plurality of microphones based on a difference between the picked-up sound signal and the reference signal, and
the echo component removal module is configured to generate a monaural signal from the picked-up sound signals of the plurality of channels based on the relative direction indicated by the directional characteristic information.

### Claim 6 (depends on 5)

The apparatus of claim 5, further comprising a monaural signal generator configured to generate a monaural signal from the reproduced sound of the plurality of channels, wherein
the echo component removal module is configured to use the monaural signal generated by the monaural signal generator as the reference signal.

### Claim 7 (depends on 6)

The apparatus of claim 6, wherein the monaural signal generator is configured to change a weight coefficient in generating the monaural signal from the reproduced sound of a respective one of the plurality of channels based on the relative direction indicated by the directional characteristic information.

### Claim 8 (depends on 1)

The apparatus of claim 1, wherein
the signal processor further comprises a noise component suppressor configured to estimate a noise characteristic of a noise component included in the picked-up sound signal, and determine a gain according to the estimated noise characteristic to suppress the noise component, and
the noise component suppressor is configured to change an efficiency characteristic to estimate the noise characteristic based on the relative direction indicated by the directional characteristic information.

### Claim 9 (depends on 8)

The apparatus of claim 8, wherein the noise suppressor is configured to suppress the noise component if the relative direction indicated by the directional characteristic information is identical to a predetermined direction.

### Claim 10 (depends on 8)

The apparatus of claim 8, wherein the noise component suppressor is configured to identify a direction of a noise source which is present in an output direction of the plurality of loudspeakers based on the noise component included in the picked-up sound signal, and suppresses the noise component if the direction of the noise source is identical to the relative direction indicated by the directional characteristic information.

### Claim 11 (depends on 1)

The apparatus of claim 1, wherein
the signal processor further comprises an echo component suppressor configured to estimate an acoustic characteristic of an echo component included in the picked-up sound signal, and determine a gain according to the estimated acoustic characteristic to suppress the echo component, and
the echo component suppressor is configured to change an efficiency characteristic to estimate the acoustic characteristic based on the relative direction indicated by the directional characteristic information.

### Claim 12 (depends on 11)

The apparatus of claim 11, wherein the echo suppressor is configured to suppress the echo component if the relative direction indicated by the directional characteristic information is identical to a predetermined direction.

### Claim 13 (depends on 11)

The apparatus of claim 11, wherein the echo component suppressor is configured to generate a monaural signal from the picked-up sound signals of the plurality of channels based on the relative direction indicated by the directional characteristic information.

### Claim 14

A signal processing method performed by a signal processor comprising a plurality of loudspeakers reproducing sound of a plurality of channels and a plurality of microphones picking up sound of a plurality of channels, the method comprising:
detecting, by a detector, a user who is present in a direction of a space from which the plurality of microphones pickup the sound to output directional characteristic information indicating a relative direction of the user to the plurality of loudspeakers; and
switching, by a signal processor, contents of processing to reduce a disturbance signal included in a picked-up sound signal of the sound picked up by the plurality of microphones from the picked-up sound signal based on the relative direction indicated by the directional characteristic information.
