Electronic apparatus generating a sound of a plurality of channels and controlling method thereof

An electronic apparatus comprising:

• a camera configured to capture an image;
• a display:
• an input interface comprising circuitry:
• a microphone configured to receive an input of a sound;
• a Time of Flight (ToF) sensor and
• a processor, comprising processing circuitry, configured to cause generation of sounds of a plurality of channels based on the input sound and to:
• identify an object and the location of the object from the image,
• classify the input sound based on an audio source, and allot the sound to the corresponding identified object,
• extract a base sound based on the input sound, assume a rear sound, and cluster the allotted sound based on the location of the identified object,
• control to adjust characteristics of the extracted base sound, the assumed rear sound, and the clustered sound using at least one of sound panning to a predetermined location, time delay, phase delay, strength adjustment, amplitude adjustment and spectral modification, the location of the identified object being sensed by the ToF sensor,
• allot the sounds wherein the characteristics were adjusted to respective channels according to the audio sources and generate a surround sound,
• based on failing to identify an object corresponding to the classified sound, control the display to display a predetermined indicator and the identified object on the classified sound, and
• match the classified sound on which the predetermined indicator is displayed to the identified object based on a user's command input through the input interface.

A controlling method of an electronic apparatus, the method comprising:

• capturing an image, and receiving an input of a sound;
• and
• generating sounds of a plurality of channels based on the input sound,
• wherein the generating the sounds of a plurality of channels comprises:
• identifying an object and the location of the object from the image by ToF sensor of the electronic apparatus;
• classifying the input sound based on an audio source, and allotting the classified sound to the corresponding identified object;
• copying the classified sound and generating sounds of at least two channels;
• adjusting characteristics of the generated sounds of at least two channels based on the audio source allotted to the identified object and the location of the identified object by method(s) using at least one of sound panning to a predetermined location, time delay, phase delay, strength adjustment, amplitude adjustment and spectral modification, the location of the identified object being sensed by the ToF sensor;
• and
• mixing the sounds of at least two channels wherein the characteristics were adjusted according to the audio source and generating a stereo sound of at least two channels,
• wherein the generating the sounds of a plurality of channels comprises:
• based on failing to identify an object corresponding to the classified sound, displaying a predetermined indicator and the identified object on the classified sound, and
• matching the sound on which the predetermined indicator is displayed to the identified object according to a user's command input.