# US 2018/0324542 A1 · Device and method for processing audio signal

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0324542 A1
- Document ID: US20180324542A1
- Status: Published application
- Kind: A1
- Application number: 16/034,373
- Filed: 2018-07-13
- Published: 2018-11-08
- Earliest claimed: 2016-01-19
- Assignees: Gaudio Lab, Inc.
- Applicants: Gaudio Lab, Inc.
- Inventors: Jeonghun SEO; Taegyu LEE; Hyun Oh OH
- Web page: https://patentgrep.com/patent/US20180324542A1

## CPC

- H04S 7/303: {Tracking of listener position or orientation}
- H04R 5/02: Spatial or constructional arrangements of loudspeakers
- H04R 5/033: Headphones for stereophonic communication {(details thereof, e.g. relating to batteries, cables or control elements H04R1/10)}
- H04S 3/00: Systems employing more than two channels, e.g. quadraphonic (H04S5/00, H04S7/00 take precedence)
- H04S 3/008: {in which the audio signals are in digital form, i.e. employing more than two discrete digital channels (data reduction aspects thereof based on psychoacoustics G10L19/02)}
- H04R 2201/401: 2D or 3D arrays of transducers
- H04R 2430/20: Processing of the output signals of the acoustic transducers of an array for obtaining a desired directivity characteristic (H04R2203/12 takes precedence)
- H04S 2400/01: Multi-channel, i.e. more than two input channels, sound reproduction with two speakers wherein the multi-channel information is substantially preserved
- H04S 2400/03: Aspects of down-mixing multi-channel audio to configurations with lower numbers of playback channels, e.g. 7.1 -> 5.1 (H04S2400/01 takes precedence)
- H04S 2400/11: Positioning of individual sound objects, e.g. moving airplane, within a sound field (H04S2420/13 takes precedence)
- H04S 2420/01: Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]
- H04S 2420/03: Application of parametric coding in stereophonic audio systems
- H04S 2420/07: Synergistic effects of band splitting and sub-band processing
- H04S 2420/11: Application of ambisonics in stereophonic audio systems
- H04S: STEREOPHONIC SYSTEMS
- H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K)

## Abstract

The present invention relates to an apparatus and a method for processing an audio signal, and more particularly, to an apparatus and a method for efficiently rendering a higher order ambisonics signal. To this end, provided are an audio signal processing apparatus, including: a pre-processor configured to separate an input audio signal into a first component corresponding to at least one object signal and a second component corresponding to a residual signal and extract position vector information corresponding to the first component from the input audio signal; a first rendering unit configured to perform an object-based first rendering on the first component using the position vector information; and a second rendering unit configured to perform a channel-based second rendering on the second component and an audio signal processing method using the same.

## Claims

### Claim 1

An audio signal processing apparatus, the apparatus comprising:
a pre-processor configured to separate an input audio signal into a first component corresponding to at least one object signal and a second component corresponding to a residual signal and extract position vector information corresponding to the first component from the input audio signal;
a first rendering unit configured to perform an object-based first rendering on the first component using the position vector information; and
a second rendering unit configured to perform a channel-based second rendering on the second component.

### Claim 2 (depends on 1)

The apparatus of claim 1,
wherein the input audio signal comprises higher order ambisonics (HOA) coefficients,
wherein the pre-processor decomposes the HOA coefficients into a first matrix representing a plurality of audio signals and a second matrix representing position vector information of each of the plurality of audio signals, and
wherein the first rendering unit performs an object-based rendering using position vector information of the second matrix corresponding to the first component.

### Claim 3 (depends on 2)

The apparatus of claim 2, wherein the first component is extracted from a predetermined number of audio signals in a high level order among a plurality of audio signals represented by the first matrix.

### Claim 4 (depends on 2)

The apparatus of claim 2, wherein the first component is extracted from audio signals having a level equal to or higher than a predetermined threshold value among a plurality of audio signals represented by the first matrix.

### Claim 5 (depends on 2)

The apparatus of claim 2, wherein the first component is extracted from coefficients of a predetermined low order among the HOA coefficients.

### Claim 6 (depends on 2)

The apparatus of claim 2, wherein the pre-processor performs a matrix decomposition of the HOA coefficients using singular value decomposition (SVD).

### Claim 7 (depends on 1)

The apparatus of claim 1,
wherein the first rendering is an object-based binaural rendering, and
wherein the first rendering unit performs the first rendering using a head related transfer function (HRTF) based on position vector information corresponding to the first component.

### Claim 8 (depends on 1)

The apparatus of claim 1,
wherein the second rendering is a channel-based binaural rendering, and
wherein the second rendering unit maps the second component to at least one virtual channel and performs the second rendering using an HRTF based on the mapped virtual channel.

### Claim 9 (depends on 1)

The apparatus of claim 1, wherein the first rendering unit performs the first rendering by referring to spatial information of at least one object obtained from a video signal corresponding to the input audio signal.

### Claim 10 (depends on 9)

The apparatus of claim 9, wherein the first rendering unit modifies at least one parameter related to the first component based on the spatial information obtained from the video signal, and performs an object-based rendering on the first component using the modified parameter.

### Claim 11

An audio signal processing method, the method comprising:
separating an input audio signal into a first component corresponding to at least one object signal and a second component corresponding to a residual signal;
extracting position vector information corresponding to the first component from the input audio signal;
performing an object-based first rendering on the first component using the position vector information; and
performing a channel-based second rendering on the second component.

### Claim 12 (depends on 11)

The method of claim 11,
wherein the input audio signal comprises higher order ambisonics (HOA) coefficients, and
wherein the method further comprises:
decomposing the HOA coefficients into a first matrix representing a plurality of audio signals and a second matrix representing position vector information of each of the plurality of audio signals; and
performing an object-based rendering using position vector information of the second matrix corresponding to the first component.

### Claim 13 (depends on 12)

The method of claim 12, wherein the first component is extracted from a predetermined number of audio signals in a high level order among a plurality of audio signals represented by the first matrix.

### Claim 14 (depends on 12)

The method of claim 12, wherein the first component is extracted from audio signals having a level equal to or higher than a predetermined threshold value among a plurality of audio signals represented by the first matrix.

### Claim 15 (depends on 12)

The method of claim 12, wherein the first component is extracted from coefficients of a predetermined low order among the HOA coefficients.

### Claim 16 (depends on 12)

The method of claim 12, wherein the pre-processor performs a matrix decomposition of the HOA coefficients using singular value decomposition (SVD).

### Claim 17 (depends on 11)

The method of claim 11,
wherein the first rendering is an object-based binaural rendering, and
wherein the first rendering is performed using a head related transfer function (HRTF) based on position vector information corresponding to the first component.

### Claim 18 (depends on 11)

The method of claim 11,
wherein the second rendering is a channel-based binaural rendering, and
wherein the second rendering is performed by mapping the second component to at least one virtual channel and using an HRTF based on the mapped virtual channel.

### Claim 19 (depends on 11)

The method of claim 11, wherein the first rendering is performed by referring to spatial information of at least one object obtained from a video signal corresponding to the input audio signal.

### Claim 20 (depends on 19)

The method of claim 19, wherein performing the first rendering further comprises:
modifying at least one parameter related to the first component based on the spatial information obtained from the video signal; and
performing an object-based rendering on the first component using the modified parameter.
