# US 2014/0153752 A1 · Audio apparatus, method of processing audio signal, and a computer-readable recording medium storing program for performing the method > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2014/0153752 A1 - Document ID: US20140153752A1 - Status: Published application - Kind: A1 - Application number: 14/093,678 - Filed: 2013-12-02 - Published: 2014-06-05 - Earliest claimed: 2012-12-05 - Assignees: Samsung Electronics Co., Ltd. - Applicants: Samsung Electronics Co., Ltd - Inventors: Sang-bae CHON; Sun-min KIM; Jae-ha PARK; Hyun-min KIM; Jeong-su KIM - Web page: https://patentgrep.com/patent/US20140153752A1 ## CPC - H04S 7/303: {Tracking of listener position or orientation} - H04S 2400/11: Positioning of individual sound objects, e.g. moving airplane, within a sound field (H04S2420/13 takes precedence) - H04S: STEREOPHONIC SYSTEMS ## Abstract An audio apparatus and a method of processing an audio signal of the audio apparatus are provided. The method includes: receiving a main audio and an interactive audio; panning the interactive audio by using position information of a user, sound source position information of the interactive audio, and speaker position information; rendering the panned interactive audio according to a space characteristic of the main audio; and mixing and outputting the rendered interactive audio and the main audio to provide the user with a more lively interactive audio. ## Claims ### Claim 1 A method of processing an audio signal of an audio apparatus, the method comprising: receiving a main audio and an interactive audio; panning the interactive audio by using position information of a user, sound source position information of the interactive audio, and speaker position information; rendering the panned interactive audio according to a space characteristic of the main audio; and mixing and outputting the rendered interactive audio and the main audio. ### Claim 2 (depends on 1) The method of claim 1, wherein, if the audio apparatus is realized as a plurality of speakers to output a plurality of channels having different elevation elements, the interactive audio is panned as a 3-dimensional (3D) space having an elevation element. ### Claim 3 (depends on 2) The method of claim 2, wherein the panning of the interactive audio comprises: sensing the position information of the user; determining relative position information of a sound source of the interactive audio based on the user by using the sensed position information of the user and a position of the sound source of the interactive audio; analyzing a panning coefficient of the sound source based on the user by using the sensed position information of the user and the speaker position information; and panning the interactive audio as the 3D space having the elevation component based on the panning coefficient of the sound source according to the relative position information of the sound source of the interactive audio. ### Claim 4 (depends on 1) The method of claim 1, wherein the panning of the interactive audio comprises: if the audio apparatus is realized as a plurality of speakers to output a plurality of channels having the same elevation elements, the interactive audio is panned to have a virtual elevation component. ### Claim 5 (depends on 1) The method of claim 1, wherein, when receiving the main audio and the interactive audio, space information of the main audio is received together, and wherein, when rendering the panned interactive audio, the panned interactive audio is rendered by using the space information of the main audio. ### Claim 6 (depends on 5) The method of claim 5, wherein the space information of the main audio is an impulse response or a transfer function. ### Claim 7 (depends on 1) The method of claim 1, wherein, when rendering the panned interactive audio, the paned interactive audio is rendered according to a space characteristic of the main audio which is determined by analyzing the main audio. ### Claim 8 An audio apparatus comprising: an input device to receive a main audio and an interactive audio; a panning device to pan the interactive audio by using position information of a user, position information of a sound source of the interactive audio, and speaker position information; a renderer to render the panned interactive audio according to a space characteristic of the main audio; and an output device to mix and output the rendered interactive audio and the main audio. ### Claim 9 (depends on 8) The audio apparatus of claim 8, wherein, if the audio apparatus is realized as a plurality of speakers to output a plurality of channels having different elevation elements, the panning device pans the interactive audio as a 3D space having an elevation element. ### Claim 10 (depends on 9) The audio apparatus of claim 9, wherein the panning device comprises: a user position sensor to sense the position information of the user; a relative position information determiner to determine relative position information of the sound source of the interactive audio based on the user position by using the position information of the user sensed by the user position sensor and a position of the sound source of the interactive audio; a panning coefficient analyzer to analyze a panning coefficient of the sound source based on the user position by using the position information of the user and the speaker position information; and a 3D panning device to pan the interactive audio as the 3D space having the elevation component based on the panning coefficient of the sound source according to the relative position information of the sound source of the interactive audio. ### Claim 11 (depends on 9) The audio apparatus of claim 9, wherein, if the audio apparatus is realized as a plurality of speakers to output a plurality of channels having the same elevation elements, the panning device pans the interactive audio so that the interactive audio has a virtual elevation component. ### Claim 12 (depends on 9) The audio apparatus of claim 9, wherein the input device receives space information of the main audio, and wherein the renderer renders the panned interactive audio by using the space information of the input main audio. ### Claim 13 (depends on 12) The audio apparatus of claim 12, wherein the space information of the main audio is an impulse response or a transfer function. ### Claim 14 (depends on 9) The audio apparatus of claim 9, wherein the renderer comprises: a space characteristic determiner to analyze the main audio to determine the space characteristic of the main audio, and wherein the renderer renders the panned interactive audio according to the space characteristic of the main audio determined by the space characteristic determiner. ### Claim 15 (depends on 1) A non-transitory computer-readable recording medium storing a program for performing the method of claim 1. ### Claim 16 An audio apparatus comprising: a panning device to pan interactive audio in a three dimensional (3D) space using relative position information of a sound source and a panning coefficient table based on a user position; a renderer device to render the panned interactive audio by using space information of a main audio; and an output device to mix and output the rendered interactive audio and the main audio. ### Claim 17 (depends on 16) The audio apparatus of claim 16, further comprising: an input device to receive the main audio and the interactive audio, to transmit the main audio to the renderer device and the output device, and to transmit the interactive audio to the panning device. ### Claim 18 (depends on 16) The audio apparatus of claim 16, wherein the renderer device comprises: a storage device to receive and store the space information of the main audio; and a sound field renderer device to render the interactive audio by using the space information of the main audio stored in the storage device. ### Claim 19 (depends on 16) The audio apparatus of claim 16, wherein the renderer device comprises: a space characteristic determiner device to analyze a space characteristic of the main audio to determine the space information of the main audio, to generate an ambience index or an impulse response corresponding to the ambience index based on the determined space information of the main audio; and a sound field renderer device to reflect the space information of the main audio to render the panned interactive audio. ### Claim 20 A method of processing an audio signal comprising: panning an interactive audio in a three dimensional (3D) space using relative position information of a sound source and a panning coefficient table based on a user position; rendering the panned interactive audio by using space information of a main audio; and mixing and outputting the rendered interactive audio and the main audio.