Electronic device for providing augmented reality user interface and operating method thereof

An electronic device comprising:

• a display;
• a processor operatively coupled to the display;
• and
• a memory operatively coupled to the processor, wherein the memory is configured to store instructions which, when executed, cause the processor to control the electronic device to:
• during a first display mode, display, on a screen of the display, at least one virtual object at a first position on the screen by superimposing the at least one virtual object on a real object in a field of view (FOV), wherein during the first display mode, a position of the real object in the FOV changes based on changes of a Point Of View (POV) of a user and the first position of the at least one virtual object on the screen is fixed irrespective of changes in the POV of the user;
• during the display of the at least one virtual object in the first display mode, receive a first input for changing the display mode of the at least one virtual object from the first display mode to a second display mode;
• in response to receiving the first input to change to the second display mode, change a display mode to the second display mode;
• during the second display mode, change a position of the at least one virtual object from the first position to a second position of the screen determined based on changes of the POV of the user after the first input, wherein during the second display mode, the position of the real object in the FOV changes based on the changes of the POV of the user after the first input;
• receive a second input for storing information related to the at least one virtual object in a form of one virtual object mapped to a specific real space coordinate;
• store the information related to the at least one virtual object in a form of one virtual object mapped to the specific real space coordinate in response to receiving the second input;
• during the second display mode, receive a third input for selecting one virtual object from among the at least one virtual object displayed on the screen;
• and
• in response to receiving the third input, simultaneously display the at least one virtual object using the second display mode and a plurality of second virtual objects using the first display mode, wherein the plurality of second virtual objects include information corresponding to identified points of interest in the real space in the FOV and are displayed at positions on the screen corresponding to positions of the corresponding identified points of interest on the screen.

A method of operating an electronic device, the method comprising:

• during a first display mode, displaying, on a screen, at least one virtual object at a first position on the screen by superimposing the at least one virtual object on a real object in a field of view (FOV), wherein during the first display mode, a position of the real object in the FOV changes based on changes of a Point Of View (POV) of a user and the first position of the at least one virtual object on the screen is fixed irrespective of changes in the POV of the user;
• during the display of the at least one virtual object in the first display mode, receiving a first input for changing the display mode of the at least one virtual object from the first display mode to a second display mode;
• and
• in response to receiving the first input to change to the second display mode, changing a display mode to the second display mode;
• during the second display mode, changing a position of the at least one virtual object from the first position to a second position of the screen determined based on changes of the POV of the user after the first input, wherein during the second display mode, the position of the real object in the FOV changes based on the changes of the POV of the user after the first input;
• during the second display mode, receiving a second input for selecting one virtual object from among the at least one virtual object displayed on the screen;
• and
• in response to receiving the second input, simultaneously displaying the at least one virtual object using the first display mode and a plurality of second virtual objects using the second display mode, wherein the plurality of second virtual objects include information corresponding to identified points of interest in a real space in the FOV and are displayed at positions on the screen corresponding to positions of the corresponding identified points of interest on the screen.