Method and apparatus for recognizing target device, for augmented reality

An electronic device comprising:

• a camera;
• a display;
• a communication circuitry;
• and
• at least one processor comprising processing circuitry;
• and
• memory storing instructions that, when executed by the at least one processor, cause the electronic device to:
• control to transmit an image obtained through the camera to an external device through the communication circuitry;
• receive an augmented reality (AR) image based on the transmitted image from the external device;
• control to display the received AR image through the display;
• estimate a distance and direction to a target object on the AR image displayed through the display based on sensing information using at least one sensor;
• perform a tab selection among a plurality of channel impulse response tabs sampled at a predetermined interval based on a signal transmitted by the target object and the distance and direction estimated to the target object on the AR image;
• apply a first estimation algorithm to the selected tab to obtain, for each antenna subset of a plurality of antennas of the communication circuitry, an output by using at least the estimated distance and direction;
• and
• estimate an angle of arrival (AoA) at least by applying a second estimation algorithm to the outputs obtained by applying the first estimation algorithm to the antenna subsets.

A method of operating an electronic device, the method comprising:

• obtaining an image through a camera of the electronic device;
• transmitting at least a part of the obtained image to an external device;
• receiving an augmented reality (AR) image including at least one object related to at least one peripheral device that exist around the electronic device based on the transmitted image, from the external device;
• displaying the AR image including the at least one object via a display of the electronic device;
• recognizing a target object from among the at least one object;
• determining, based on signals transmitted by a plurality of peripheral devices on a data communication link, location information of the plurality of peripheral devices on the data communication link;
• determining location information of the target object in the AR image;
• and
• mapping, based on the determined location information of the target object in the AR image and the determined location information of the plurality of peripheral devices on the data communication link, a peripheral device among the plurality of peripheral devices found on the data communication link to a target device corresponding to the recognized target object in the AR image.

A non-transitory computer-readable recording medium storing a program which, when executed, causes an electronic device to perform operations comprising:

• obtaining an image through a camera of the electronic device,
• transmitting at least a part of the obtained image to an external device,
• receiving an augmented reality (AR) image including at least one object related to at least one peripheral device that exist around the electronic device based on the transmitted image, from the external device,
• displaying the AR image including the at least one object via a display of the electronic device,
• recognizing a target object from among the at least one object,
• determining, based on signals transmitted by a plurality of peripheral devices on a data communication link, location information of the plurality of peripheral devices on the data communication link;
• determining location information of the target object in the AR image;
• and
• mapping, based on the determined location information of the target object in the AR image and the determined location information of the plurality of peripheral devices on the data communication link, a peripheral device among the plurality of peripheral devices found on the data communication link to a target device corresponding to the recognized target object in the AR image.