# US 2017/0251320 A1 · Apparatus and method of creating multilingual audio content based on stereo audio signal

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0251320 A1
- Document ID: US20170251320A1
- Status: Published application
- Kind: A1
- Application number: 15/400,755
- Filed: 2017-01-06
- Published: 2017-08-31
- Earliest claimed: 2016-02-29
- Assignees: Electronics and Telecommunications Research Institute
- Applicants: Electronics and Telecommunications Research Institute
- Inventors: Young Ho JEONG; Tae Jin LEE; Dae Young JANG; Jin Soo CHOI
- Web page: https://patentgrep.com/patent/US20170251320A1

## CPC

- G10L 21/0332: involving modification of waveforms
- G10L 19/008: Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing
- G10L 21/028: using properties of sound source
- H04S 2400/15: Aspects of sound capture and related signal processing for recording or reproduction
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- H04S: STEREOPHONIC SYSTEMS

## Abstract

Provided is an apparatus and method for creating multilingual audio content based on a stereo audio signal. The method of creating multilingual audio content including adjusting an energy value of each of a plurality of sound sources provided in multiple languages, setting an initial azimuth angle of each of the sound sources based on a number of the sound sources, mixing each of the sound sources to generate a stereo signal based on the set initial azimuth angle, separating the sound sources to play the mixed sound sources using a sound source separating algorithm, and storing the mixed sound sources based on a sound quality of each of the separated sound sources.

## Claims

### Claim 1

A method of creating multilingual audio content, the method comprising:
adjusting an energy value of each of a plurality of sound sources provided in multiple languages;
setting an initial azimuth angle of each of the sound sources based on a number of the sound sources;
mixing each of the sound sources to generate a stereo signal based on the set initial azimuth angle;
separating the sound sources to play the mixed sound sources using a sound source separating algorithm; and
storing the mixed sound sources based on a sound quality of each of the separated sound sources.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
evaluating the sound quality of each of the separated sound sources,
wherein the storing comprises storing the mixed sound sources based on the evaluated sound quality of each of the separated sound sources.

### Claim 3 (depends on 2)

The method of claim 2, wherein the evaluating comprises evaluating the sound quality of each of the sound sources based on at least one of source to artifact ratio (SAR) information, source to distortion ratio (SDR) information, and source to interference ratio (SIR) information of each of the separated sound sources.

### Claim 4 (depends on 3)

The method of claim 3, wherein the evaluating comprises adjusting a signal intensity and the initial azimuth angle of each of the sound sources when at least one of the SAR information, the SDR information, and the SIR information of each of the sound sources is less than a preset threshold value.

### Claim 5 (depends on 1)

The method of claim 1, wherein the adjusting comprises verifying the energy value of each of the sound sources and adjusting the energy value to be a maximum value among the verified energy values.

### Claim 6 (depends on 1)

The method of claim 1, wherein the mixing comprises:
calculating a signal intensity ratio of a left signal and a right signal of each of the sound sources based on the initial azimuth angle of each of the sound sources;
determining a left signal component and a right signal component of each of the sound sources to be mixed to generate a left stereo signal and a right stereo signal based on the calculated signal intensity ratio; and
generating the left stereo signal and the right stereo signal by mixing the determined left signal component and the right signal component of each of the sound sources.

### Claim 7 (depends on 1)

The method of claim 1, wherein the storing further comprises adding additional information on each of the mixed sound sources, and the additional information includes at least one of signal intensity information, azimuth angle information, and language information of each of the mixed sound sources.

### Claim 8

An apparatus for creating multilingual audio content, the apparatus comprising:
an adjuster configured to adjust an energy value of each of a plurality of sound sources provided in multiple languages;
a setter configured to set an initial azimuth angle of each of the sound sources based on a number of the sound sources;
a mixer configured to mix each of the sound sources to generate a stereo signal based on the set initial azimuth angle;
a separator configured to separate the sound sources to play the mixed sound sources using a sound source separating algorithm; and
a storage configured to store the mixed sound sources based on a sound quality of each of the separated sound sources.

### Claim 9 (depends on 8)

The apparatus of claim 8, further comprising:
an evaluator configured to evaluate the sound quality of each of the separated sound sources,
wherein the storage is configured to store the nixed sound sources based on the evaluated sound quality of each of the sound sources.

### Claim 10 (depends on 9)

The apparatus of claim 9, wherein the evaluator is configured to evaluate the sound sources based on at least one of source to artifact ratio (SAR) information, source to distortion ratio (SDR) information, and source to interference ratio (SIR) information of each of the separated sound sources.

### Claim 11 (depends on 10)

The apparatus of claim 10, wherein the evaluator is configured to define the SAR information, the SDR information, and the SIR information by analyzing a component of each of the separated sound sources.

### Claim 12

A method of playing multilingual audio content, the method comprising:
receiving multilingual audio content;
outputting a stereo signal included in the received multilingual audio content;
providing, for a user, language information of each of a plurality of sound sources among pieces of additional information on the sound sources included in the output stereo signal;
separating a sound source corresponding to the language information selected by the user from the sound sources included in the output stereo signal using a sound source separating algorithm.

### Claim 13 (depends on 12)

The method of claim 12, wherein the additional information includes at least one of signal intensity information, azimuth angle information, and language information of each of the sound sources included in the output stereo signal.
