# US 10,321,254 B2 · Audio signal processing method and apparatus

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,321,254 B2
- Document ID: US10321254B2
- Status: Granted
- Kind: B2
- Application number: 16/105,945
- Filed: 2018-08-20
- Published: 2018-12-13
- Granted: 2019-06-11
- Earliest claimed: 2014-03-19
- Assignees: Wilus Institute of Standards and Technology Inc.
- Applicants: Wilus Institute of Standards and Technology Inc.
- Inventors: Hyunoh Oh; Taegyu Lee; Jinsam Kwak; Juhyung Son
- Web page: https://patentgrep.com/patent/US10321254B2

## CPC

- H04S 3/008: {in which the audio signals are in digital form, i.e. employing more than two discrete digital channels (data reduction aspects thereof based on psychoacoustics G10L19/02)}
- G10L 19/20: using sound class specific coding, hybrid encoders or object based coding
- H04S 2400/01: Multi-channel, i.e. more than two input channels, sound reproduction with two speakers wherein the multi-channel information is substantially preserved
- H04S 2400/03: Aspects of down-mixing multi-channel audio to configurations with lower numbers of playback channels, e.g. 7.1 -> 5.1 (H04S2400/01 takes precedence)
- H04S 2400/11: Positioning of individual sound objects, e.g. moving airplane, within a sound field (H04S2420/13 takes precedence)
- H04S 2420/01: Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]
- H04S 2420/07: Synergistic effects of band splitting and sub-band processing
- H04S: STEREOPHONIC SYSTEMS
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

The present invention relates to a method and an apparatus for processing an audio signal, and more particularly, to a method and an apparatus for processing an audio signal, which synthesize an object signal and a channel signal and effectively perform binaural rendering of the synthesized signal. To this end, provided are a method for processing an audio signal, which includes: receiving an input audio signal including a multi-channel signal; receiving truncated subband filter coefficients for filtering the input audio signal, the truncated subband filter coefficients being at least some of subband filter coefficients obtained from binaural room impulse response (BRIR) filter coefficients for binaural filtering of the input audio signal and the length of the truncated subband filter coefficients being determined based on filter order information obtained by at least partially using reverberation time information extracted from the corresponding subband filter coefficients; obtaining vector information indicating the BRIR filter coefficients corresponding to each channel of the input audio signal; and filtering each subband signal of the multi-channel signal by using the truncated subband filter coefficients corresponding to the relevant channel and subband based on the vector information and an apparatus for processing an audio signal by using the same.

## Claims

### Claim 1

A method for processing an audio signal, comprising:
receiving an audio signal of a first channel, wherein the first channel is classified into a first channel group, and the audio signal of the first channel includes a plurality of subband signals;
receiving an audio signal of a second channel, wherein the second channel is classified into a second channel group, and the audio signal of the second channel includes a plurality of subband signals;
filtering each subband signal of the first channel by using each set of subband filter coefficients generated from a first set of filter coefficients, wherein the first set of filter coefficients corresponds to a position related to the first channel in a virtual reproduction space;
filtering each subband signal of the second channel by using each set of subband filter coefficients generated from a second set of filter coefficients, wherein the second set of filter coefficients corresponds to a position related to the second channel in the virtual reproduction space; and
generating an output audio signal by mixing the filtered subband signals of the first channel and the filtered subband signals of the second channel;
wherein a length of the set of subband filter coefficients is determined based on a filter order for each subband and for each channel group, and the filter order is variable for each subband and for each channel group.

### Claim 2 (depends on 1)

The method of claim 1, wherein a filter order for a specific subband for the first channel group is higher than a filter order for the specific subband for the second channel group.

### Claim 3 (depends on 2)

The method of claim 2, wherein the first channel group is a front channel group including one or more front channels, and the second channel group is a rear channel group including one or more rear channels.

### Claim 4 (depends on 1)

The method of claim 1, wherein the set of subband filter coefficients is generated by truncating a corresponding set of binaural room impulse response (BRIR) subband filter coefficients, and
the set of BRIR subband filter coefficients is obtained from a set of BRIR filter coefficients in a time domain.

### Claim 5 (depends on 4)

The method of claim 4, wherein a length of the truncation is determined based on a filter order obtained by using characteristic information extracted from the corresponding set of BRIR subband filter coefficients.

### Claim 6 (depends on 5)

The method of claim 5, wherein the characteristic information includes reverberation time information of the corresponding set of BRIR subband filter coefficients.

### Claim 7 (depends on 4)

The method of claim 4, wherein the first set of filter coefficients is a set of BRIR filter coefficients corresponding to the position related to the first channel and the second set of filter coefficients is a set of BRIR filter coefficients corresponding to the position related to the second channel.

### Claim 8

An apparatus for processing an audio signal, the apparatus is configured to:
receive an audio signal of a first channel, wherein the first channel is classified into a first channel group, and the audio signal of the first channel includes a plurality of subband signals;
receive an audio signal of a second channel, wherein the second channel is classified into a second channel group, and the audio signal of the second channel includes a plurality of subband signals;
filter each subband signal of the first channel by using each set of subband filter coefficients generated from a first set of filter coefficients, wherein the first set of filter coefficients corresponds to a position related to the first channel in a virtual reproduction space;
filter each subband signal of the second channel by using each set of subband filter coefficients generated from a second set of filter coefficients, wherein the second set of filter coefficients corresponds to a position related to the second channel in the virtual reproduction space; and
generate an output audio signal by mixing the filtered subband signals of the first channel and the filtered subband signals of the second channel;
wherein a length of the set of subband filter coefficients is determined based on a filter order for each subband and for each channel group, and the filter order is variable for each subband and for each channel group.

### Claim 9 (depends on 8)

The apparatus of claim 8, wherein a filter order for a specific subband for the first channel group is higher than a filter order for the specific subband for the second channel group.

### Claim 10 (depends on 9)

The apparatus of claim 9, wherein the first channel group is a front channel group including one or more front channels, and the second channel group is a rear channel group including one or more rear channels.

### Claim 11 (depends on 8)

The apparatus of claim 8, wherein the set of subband filter coefficients is generated by truncating a corresponding set of binaural room impulse response (BRIR) subband filter coefficients, and
the set of BRIR subband filter coefficients is obtained from a set of BRIR filter coefficients in a time domain.

### Claim 12 (depends on 11)

The apparatus of claim 11, wherein a length of the truncation is determined based on a filter order obtained by using characteristic information extracted from the corresponding set of BRIR subband filter coefficients.

### Claim 13 (depends on 12)

The apparatus of claim 12, wherein the characteristic information includes reverberation time information of the corresponding set of BRIR subband filter coefficients.

### Claim 14 (depends on 11)

The apparatus of claim 11, wherein the first set of filter coefficients is a set of BRIR filter coefficients corresponding to the position related to the first channel and the second set of filter coefficients is a set of BRIR filter coefficients corresponding to the position related to the second channel.
