# US 2015/0104022 A1 · Audio Processing Method and Audio Processing Apparatus

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2015/0104022 A1
- Document ID: US20150104022A1
- Status: Published application
- Kind: A1
- Application number: 14/384,439
- Filed: 2013-03-21
- Published: 2015-04-16
- Earliest claimed: 2012-03-23
- Assignees: Dolby Laboratories Licensing Corporation
- Applicants: Dolby Laboratories Licensing Corporation
- Inventors: Huiqun Deng; Xuejing Sun
- Web page: https://patentgrep.com/patent/US20150104022A1

## CPC

- H04S 1/007: {in which the audio signals are in digital form (data reduction aspects thereof based on psychoacoustics G10L19/02)}
- G10L 21/0364: for improving intelligibility
- G10L 25/87: Detection of discrete points within a voice signal
- H04S 2400/01: Multi-channel, i.e. more than two input channels, sound reproduction with two speakers wherein the multi-channel information is substantially preserved
- H04S 2400/05: Generation or adaptation of centre channel in multi-channel audio systems
- H04S: STEREOPHONIC SYSTEMS
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

An audio processing method and apparatus are described. In one embodiment, at least one first sub-band of a first audio signal is suppressed to obtain a reduced first audio signal with reserved sub-bands; suppressing at least one second sub-band of the at least one second audio signal to obtain at least one reduced second audio signal with reserved sub-bands; and mixing the reduced first audio signal and at least one reduced second audio signal. Alternatively, a first spatial auditory property is assigned to a first audio signal so that the first audio signal may be perceived as originating from a first position. Alternatively, rhythmic similarity between at least two audio signals is detected, and time scaling is applied to an audio signal in response to relatively high rhythmic similarity between the audio signal and the other audio signal(s); and then at least two audio signals are mixed.

## Claims

### Claim 1

An audio processing method comprising:
suppressing at least one first sub-band of a first audio signal to obtain a reduced first audio signal with reserved sub-bands, so as to improve the intelligibility of the reduced first audio signal, at least one second audio signal, or both the reduced first audio signal and the at least one second audio signal;
suppressing at least one second sub-band of the at least one second audio signal to obtain at least one reduced second audio signal with reserved sub-bands; and
mixing the reduced first audio signal and the at least one reduced second audio signal.

### Claim 2 (depends on 1)

The audio processing method according to claim 1, wherein:
the reserved sub-bands of different audio signals do not overlap.

### Claim 3 (depends on 2)

The audio processing method according to claim 2, wherein the reserved sub-bands of each audio signal are distributed to cover both low and high frequency sub-bands of the audio signals.

### Claim 4 (depends on 2)

The audio processing method according to claim 2, wherein the reserved sub-bands of different audio signals are interleaved.

### Claim 5 (depends on 2)

The audio processing method according to claim 2, further comprising:
obtaining number of speakers/audio signals; and
allocating reserved sub-bands to each audio signal, the width and the number of reserved sub-bands for each audio signal being determined based on the number of speakers/audio signals;

### Claim 6 (depends on 5)

The audio processing method according to claim 5, further comprising:
acquiring capacity and/or traffic information of infrastructure carrying the audio signals; and
wherein, in the allocating step, allocating more and/or broader reserved sub-bands, or a full band to an audio signal, in response to relatively high capacity and/or relatively low traffic in infrastructure related to the audio signal.

### Claim 7 (depends on 5)

The audio processing method according to claim 5, further comprising:
acquiring importance information of the speakers/audio signals; and
wherein, in the allocating step, allocating more and/or broader reserved sub-bands, or a full band to a speaker/audio signal, in response to relatively high importance of the corresponding speaker/audio signal.

### Claim 8 (depends on 5)

The audio processing method according to claim 5, further comprising:
detecting speaker similarity between different audio signals; and
wherein, in the allocating step, allocating more and/or broader reserved sub-bands, or a full band to an audio signal, in response to relatively low speaker similarity between the audio signal and the other audio signal(s).

### Claim 9 (depends on 2)

The audio processing method according to claim 2, further comprising:
detecting rhythmic similarity between different audio signals; and
before the mixing step, applying time scaling to an audio signal in response to relatively high rhythmic similarity between the audio signal and the other audio signal(s).

### Claim 10 (depends on 9)

The audio processing method according to claim 9, wherein the rhythmic similarity between different audio signals is obtained by computing cross-correlation between the different audio signals.

### Claim 11 (depends on 9)

The audio processing method according to claim 9, wherein the rhythmic similarity between different audio signals is obtained by comparing beat/pitch accent timing in the different audio signals.

### Claim 12 (depends on 1)

The audio processing method according to claim 1, comprising:
assigning the first audio signal at least one spatial auditory property, so that the first audio signal may be perceived as originating from a position relative to a listener.

### Claim 13 (depends on 12)

The audio processing method according to claim 12, wherein the assigning step comprises applying spatial filtering on the first audio signal so that the frequency spectrum of the first audio signal bears certain elevation and/or azimuth cues.

### Claim 14 (depends on 12)

The audio processing method according to claim 12, wherein the spatial filtering is HRTF-based filtering.

### Claim 15

An audio processing method comprising:
detecting onset of speech in at least two audio signals;
delaying an audio signal in response to the onset of speech in the audio signal being the same as or close to that in another audio signal; and
mixing the at least two audio signals.

### Claim 16 (depends on 15)

The audio processing method according to claim 15, further comprising:
acquiring capacity and/or traffic information of infrastructure carrying the audio signals; and
wherein, not delaying an audio signal in response to relatively low capacity and/or relatively high traffic in infrastructure related to the audio signal.

### Claim 17

An audio processing apparatus comprising:
a spectral filter, configured to suppress at least one first sub-band of a first audio signal to obtain a reduced first audio signal with reserved sub-bands, and suppress at least one second sub-band of at least one second audio signal to obtain at least one reduced second audio signal with reserved sub-bands, so as to improve the intelligibility of the reduced first audio signal, the at least one reduced second audio signal, or both the reduced first audio signal and the at least one reduced second audio signal; and
a mixer, configured to mix the reduced first audio signal and the at least one reduced second audio signal.

### Claim 18 (depends on 17)

The audio processing apparatus according to claim 17, wherein:
the spectral filter is further configured so that the reserved sub-bands of different audio signals do not overlap each other.

### Claim 19 (depends on 18)

The audio processing apparatus according to claim 18, wherein the spectral filter is further configured so that the reserved sub-bands of each audio signal are distributed to cover both low and high frequency sub-bands of the audio signals.

### Claim 20 (depends on 19)

The audio processing apparatus according to claim 19, wherein the spectral filter is further configured so that the reserved sub-bands of different audio signals are interleaved.

### Claim 21 (depends on 18)

The audio processing apparatus according to claim 18, further comprising:
a speaker/audio signal number detector configured to obtain a number of speakers/audio signals; and
wherein the spectral filter comprises a reserved sub-bands allocator configured to allocate reserved sub-bands to each audio signal, the width and the number of reserved sub-bands for each audio signal being determined based on the number of speakers/audio signals.

### Claim 22

An audio processing apparatus comprising:
a speech onset detector configured to detect onset of speech in at least two audio signals;
a delayer configured to delay an audio signal in response to the onset of speech in the audio signal being the same as or close to that in another audio signal; and
a mixer configured to mix the at least two audio signals.

### Claim 23 (depends on 22)

The audio processing apparatus according to claim 22, further comprising:
an infrastructure capacity/traffic detector configured to acquire capacity and/or traffic information of infrastructure carrying the audio signals; and
wherein, the delayer is configured to be disabled with respect to an audio signal in response to relatively low capacity and/or relatively high traffic in infrastructure related to the audio signal.
