# US 8,542,839 B2 · Audio processing apparatus and method of mobile device > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 8,542,839 B2 - Document ID: US8542839B2 - Status: Granted - Kind: B2 - Application number: 12/382,562 - Filed: 2009-03-18 - Published: 2010-04-29 - Granted: 2013-09-24 - Earliest claimed: 2008-10-23 - Assignees: Samsung Electronics Co., Ltd. - Applicants: Chang Yong Son; Do Hyung Kim; Sang Oak Woo; Kang Eun Lee - Inventors: Chang Yong Son; Do Hyung Kim; Sang Oak Woo; Kang Eun Lee - Web page: https://patentgrep.com/patent/US8542839B2 ## CPC - G10L 25/48: specially adapted for particular use - G10L 21/0264: characterised by the type of parameter measurement, e.g. correlation techniques, zero crossing techniques or predictive techniques - G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING ## Abstract An audio processing apparatus and method for a mobile device are provided. The audio processing apparatus and method may appropriately determine sound source localizations corresponding to a voice signal and an audio signal, and thereby may simultaneously provide a voice call service and a multimedia service. Also, the audio processing apparatus and method may guarantee quality of the voice call service even when simultaneously providing the voice call service and the multimedia service. ## Claims ### Claim 1 An audio processing apparatus for a mobile device, the audio processing apparatus comprising: a signal providing unit to provide a voice signal and at least one audio signal distinguishable from the voice signal, wherein the voice signal is a monaural signal and the at least one audio signal is a stereo signal and wherein the signal providing unit comprises a frame adjustment unit to adjust a frame size of the voice signal and the at least one audio signal to be substantially identical; and a sound source localization unit to determine sound source localizations corresponding to the voice signal and the at least one audio signal. ### Claim 2 (depends on 1) The audio processing apparatus of claim 1, further comprising: a synthesis unit to synthesize the voice signal and the at least one audio signal into at least one predetermined channel. ### Claim 3 (depends on 2) The audio processing apparatus of claim 2, wherein the synthesis unit synthesizes the voice signal and the at least one audio signal and generates a binaural sound to enable the sound source localizations to be recognized by a user. ### Claim 4 (depends on 2) The audio processing apparatus of claim 2, wherein the synthesis unit synthesizes the voice signal and the at least one audio signal using head related transfer functions corresponding to the determined sound source localizations. ### Claim 5 (depends on 4) The audio processing apparatus of claim 4, wherein the head related transfer functions are selected from a plurality of functions previously stored according to the determined sound source localizations. ### Claim 6 (depends on 1) The audio processing apparatus of claim 1, wherein the sound source localization unit determines up to a predetermined number of the sound source localizations. ### Claim 7 (depends on 1) The audio processing apparatus of claim 1, wherein the sound source localization unit determines the sound source localizations to enable a user to recognize the voice signal more readily than the at least one audio signal. ### Claim 8 (depends on 1) The audio processing apparatus of claim 1, wherein the sound source localization unit determines a sound source localization corresponding to the voice signal to be closer to a center of a user than a sound source localization corresponding to the at least one audio signal. ### Claim 9 (depends on 1) The audio processing apparatus of claim 1, further comprising: a distance/intensity adjustment unit to determine at least one of a distance from a user to the determined sound source localizations and an intensity of the voice signal or the at least one audio signal at the determined sound source localizations. ### Claim 10 (depends on 9) The audio processing apparatus of claim 9, wherein the distance/intensity adjustment unit determines the distance from the user to the determined sound source localizations, or determines the intensity of the voice signal or the at least one audio signal at the determined sound source localizations, to enable the user to recognize the voice signal more readily than the at least one audio signal. ### Claim 11 (depends on 9) The audio processing apparatus of claim 9, further comprising: a control information providing unit to provide control information according to an operation of the user, wherein the distance/intensity adjustment unit determines at least one of the distance from the user to the determined sound source localizations, and the intensity of the voice signal or the at least one audio signal at the determined sound source localizations, based on the control information. ### Claim 12 (depends on 1) The audio processing apparatus of claim 1, further comprising: a control information providing unit to provide control information, wherein the sound source localization unit determines the sound source localizations based on the provided control information. ### Claim 13 (depends on 12) The audio processing apparatus of claim 12, wherein the control information providing unit provides the control information according to an operation of the user. ### Claim 14 An audio processing apparatus for a mobile device, the audio processing apparatus comprising: a signal providing unit to provide a voice signal and at least one audio signal distinguishable from the voice signal, wherein the voice signal is a monaural signal and the at least one audio signal is a stereo signal and wherein the signal providing unit further comprises: a frame adjustment unit to adjust a frame size of the voice signal and the at least one audio signal to be substantially identical; and a rate adjustment unit to adjust the voice signal and the at least one audio signal to have a substantially identical sampling rate; and a sound source localization unit to determine sound source localizations corresponding to the voice signal and the at least one audio signal. ### Claim 15 (depends on 1) The audio processing apparatus of claim 1, wherein the signal providing unit comprises a time/frequency conversion unit to convert the voice signal in a time domain into the voice signal in a frequency domain. ### Claim 16 An audio processing method for a mobile device, the audio processing method comprising: providing a voice signal and at least one audio signal distinguishable from the voice signal, wherein the voice signal is a monaural signal and the at least one audio signal is a stereo signal adjusting a frame size of the voice signal and the at least one audio signal to be substantially identical; and determining sound source localizations corresponding to the voice signal and the at least one audio signal using the mobile device. ### Claim 17 (depends on 16) The audio processing method of claim 16, further comprising: synthesizing the voice signal and the at least one audio signal into at least one predetermined channel. ### Claim 18 (depends on 16) The audio processing method of claim 16, further comprising: determining at least one of a distance from a user to the determined sound source localizations, and an intensity of the voice signal or the at least one audio signal at the determined sound source localizations at the determined sound source localizations. ### Claim 19 A computer-readable recording medium storing computer readable code including a program for implementing an audio processing method for a mobile device, the audio processing method comprising: providing a voice signal and at least one audio signal distinguishable from the voice signal, wherein the voice signal is a monaural signal and the at least one audio signal is a stereo signal; adjusting a frame size of the voice signal and the at least one audio signal to be substantially identical; and determining sound source localizations corresponding to the voice signal and the at least one audio signal. ### Claim 20 (depends on 1) The audio processing apparatus of claim 1, wherein the sound source localization unit determines a sound source localization of the voice signal to be close to a center of the user and a sound source local localization of a left channel of the audio signal to be close to a left of the user and a sound source local localization of a right channel of the audio signal to be close to a right of the user. ### Claim 21 (depends on 1) The audio processing apparatus of claim 1, wherein the signal providing unit further comprises a rate adjustment unit to adjust a sampling rate of at least one of the voice signal and the at least one audio signal.