Electronic device, head-mounted display device, wearable device, and method for operating the same

A method for operating an electronic device, the method comprising:

• establishing, through a communication circuit of the electronic device, a communication connection with a head-mounted display device and a wearable device;
• establishing, through the communication circuit, a communication connection between the electronic device and the wearable device;
• receiving, from the head-mounted display device through the communication circuit, a plurality of information including information about 3D coordinates of the head-mounted display device for a surrounding space of the head-mounted display device that further includes 3D coordinates of the wearable device and/or the hands of the user, information including a probability that positions of the hands of the user meet a designated condition, and information corresponding to a position of the head of the user or a direction of a gaze of the user;
• generating a signal for setting a mode of the wearable device based on the plurality of information;
• transmitting, through the communication circuit, to the wearable device the signal for mode setting of the wearable device, and
• based on receiving, through the communication circuit, a first signal from the wearable device operating in the set wearable device mode, transmitting, to the head-mounted display device, an image including at least one graphic object associated with the first signal, generated based on the plurality of information,
• wherein the wearable device is configured to operate selectively in one of an active mode or a controller mode,
• in the active mode, the wearable device, when operated by the user to change a function related to a native service of the wearable device, refrains from transmitting a signal to the electronic device, wherein the native service-related function includes at least one of a message checking service, a call reception service, or a watch display service, and
• in the controller mode, the wearable device, when operated by the user to change an aspect of immersive content provided via the head-mounted display device, refrains from performing a function related to a native service of the wearable device corresponding to the user input at the wearable device, wherein the aspect of the immersive content includes at least one of viewpoint, object position, or interaction properties within the immersive content.

A wearable electronic device comprising:

• at least one sensor;
• and
• a communication circuit;
• and
• at least one processor including processing circuitry;
• memory storing instructions, that when executed by the at least one processor individually or collectively, cause the wearable electronic device to:
• establish a communication connection with an electronic device located outside the wearable electronic device through the communication circuit, receive a signal for setting a mode of the wearable device from the electronic device that has established a communication connection with a head-mounted display device located outside the electronic device through the communication circuit, wherein the head-mounted display device is a separate device that is different from the wearable device and the set mode is one of a plurality of different modes of the wearable device including an active mode and a controller mode, wherein the signal for setting the mode of the wearable device is generated based on a plurality of information including information about 3D coordinates of the head-mounted display device for a surrounding space of the head-mounted display device that further includes 3D coordinates of the wearable device and/or the hands of the user, information including a probability that positions of the hands of the user meet a designated condition, and information corresponding to a position of the head of the user or a direction of a gaze of the user,
• identify an input using the at least one sensor,
• based on the mode of the wearable device being set to a first mode based on the received signal, provide content corresponding to the identified input,
• based on the mode of the wearable device being set to a second mode based on the received signal, transmit a first signal including information about the identified input, through the communication circuit to the electronic device, and
• transmit, to the electronic device, the first signal to trigger providing to the head-mounted display device an image including at least one graphic object associated with the first signal,
• wherein the wearable device is configured to operate selectively in one of an active mode or a controller mode,
• in the active mode, the wearable device, when operated by the user to change a function related to a native service of the wearable device, refrains from transmitting a signal to the electronic device, wherein the native service-related function includes at least one of a message checking service, a call reception service, or a watch display service, and
• in the controller mode, the wearable device, when operated by the user to change an aspect of immersive content provided via the head-mounted display device, refrains from performing a function related to a native service of the wearable device corresponding to the user input at the wearable device, wherein the aspect of the immersive content includes at least one of viewpoint, object position, or interaction properties within the immersive content.

A head mounted display (HMD) device wearable by a user comprising:

• a plurality of cameras;
• a communication circuit;
• and
• at least one processor operatively connected with the plurality of cameras and the communication circuit;
• wherein the at least one processor includes processing circuitry and is configured to:
• establish a communication connection with an electronic device located outside the head mounted display through the communication circuit,
• obtain a plurality of images using the cameras,
• obtain a plurality of information including information about 3D coordinates of the head-mounted display device for a surrounding space of the head-mounted display device that further includes 3D coordinates of the wearable device and/or the hands of the user, information including a probability that positions of the hands of the user meet a designated condition, and information corresponding to a position of the head of the user or a direction of a gaze of the user, based on at least some of the plurality of images,
• transmit the plurality of information to the electronic device through the communication circuit, and
• receive an image including at least one graphic object associated with a first signal generated by a wearable device worn by the user and different from the head-mounted display device and operating in a set mode of a plurality of different modes of the wearable device including an active mode and a controller mode, from the electronic device that has established a communication connection with the wearable device located outside the electronic device through the communication circuit, based on the transmission of the plurality of information,
• wherein the wearable device is configured to operate selectively in one of an active mode or a controller mode,
• in the active mode, the wearable device, when operated by the user to change a function related to a native service of the wearable device, refrains from transmitting a signal to the electronic device, wherein the native service-related function includes at least one of a message checking service, a call reception service, or a watch display service, and
• in the controller mode, the wearable device, when operated by the user to change an aspect of immersive content provided via the head-mounted display device, refrains from performing a function related to a native service of the wearable device corresponding to the user input at the wearable device, wherein the aspect of the immersive content includes at least one of viewpoint, object position, or interaction properties within the immersive content.