# US 11,907,415 B2 · Method, electronic device, and non-transitory computer readable storage medium for interacting with virtual reality environment > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,907,415 B2 - Document ID: US11907415B2 - Status: Granted - Kind: B2 - Application number: 18/151,480 - Filed: 2023-01-09 - Published: 2023-08-31 - Granted: 2024-02-20 - Earliest claimed: 2022-02-25 - Assignees: HTC Corporation - Applicants: HTC Corporation - Inventors: Ying-Jing Wang; Fang-Ju Lin; Yun-Jung Lee; Yu-Chien Huang; Kuan-Yi Lien - Web page: https://patentgrep.com/patent/US11907415B2 ## CPC - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)} - G06F 3/04812: Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects - G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object - G06F 3/04817: using icons (graphical or visual programming using iconic symbols G06F8/34) - G06F 3/0482: Interaction with lists of selectable items, e.g. menus - G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence) - G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour - G06F 3/0486: Drag-and-drop - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract A method, an electronic device, and a non-transitory computer readable storage medium for interacting with a virtual reality (VR) environment are provided. The method includes: displaying a first portal in a first virtual scene of the virtual reality environment, wherein the first portal is for a virtual scene switching, and the first portal comprises a frame; determining whether the frame is dragged toward a center of the first portal; and in response to determining the frame is dragged toward the center of the first portal, removing the first portal from the virtual reality environment. ## Claims ### Claim 1 A method for interacting with a virtual reality environment, comprising: displaying a first portal in a first virtual scene of the virtual reality environment, wherein the first portal is for a virtual scene switching, and the first portal comprises a frame; determining whether the frame is dragged toward a center of the first portal, comprising: in response to the frame being released from being dragged, determining a distance between the frame and the center; and in response to determining the distance being greater than or equal to a threshold, determining the frame is not dragged toward the center, wherein the frame is at an original position in the first virtual scene before being dragged; in response to determining the frame is dragged toward the center of the first portal, removing the first portal from the virtual reality environment; and in response to determining the frame is not dragged toward the center, restoring the frame from a current position back to the original position. ### Claim 2 (depends on 1) The method of claim 1, wherein the step of determining whether the frame is dragged toward the center of the first portal further comprising: in response to determining the distance being less than the threshold, determining the frame is dragged toward the center. ### Claim 3 (depends on 1) The method of claim 1, further comprising: determining a second distance between the frame and a coordinate corresponding to a user operation; and in response to determining the second distance being less than a second threshold, showing a hint icon in the first virtual scene. ### Claim 4 (depends on 3) The method of claim 3, further comprising: showing a cursor on the coordinate in the first virtual scene. ### Claim 5 (depends on 1) The method of claim 1, further comprising: in response to determining the frame is dragged, displaying a hint image on a preview area in the first portal. ### Claim 6 (depends on 1) The method of claim 1, further comprising: displaying a second portal in the first virtual scene, wherein the first virtual scene comprises a user-interactable object corresponding to the first portal; detecting a user operation corresponding to the user-interactable object; and removing the second portal from the first virtual scene and displaying the first portal in the first virtual scene according to the user operation. ### Claim 7 (depends on 1) The method of claim 1, further comprising: in response to receiving a command corresponding to the first portal, switching the virtual reality environment from the first virtual scene to a second virtual scene. ### Claim 8 (depends on 1) The method of claim 1, wherein the first portal is a graphical user interface. ### Claim 9 (depends on 1) The electronic device of claim 1, wherein the processor further configured to: in response to receiving a command corresponding to the first portal via the transceiver, switch the virtual reality environment from the first virtual scene to a second virtual scene. ### Claim 10 An electronic device for interacting with a virtual reality environment, comprising: a transceiver, outputting a first virtual scene of the virtual reality environment; and a processor coupled to the transceiver, wherein the processor is configured to: display a first portal in the first virtual scene, wherein the first portal is for a virtual scene switching, and the first portal comprises a frame; determine whether the frame is dragged toward a center of the first portal by: determining a distance between the frame and the center in response to the frame being released from being dragged; and determining the frame is not dragged toward the center in response to determining the distance being greater than or equal to a threshold, wherein the frame is at an original position in the first virtual scene before being dragged; in response to determining the frame is dragged toward the center of the first portal, remove the first portal from the virtual reality environment; and in response to determining the frame is not dragged toward the center, restore the frame from a current position back to the original position. ### Claim 11 (depends on 10) The electronic device of claim 10, wherein the processor further configured to: in response to determining the distance being less than the threshold, determine the frame is dragged toward the center. ### Claim 12 (depends on 10) The electronic device of claim 10, wherein the processor further configured to: determine a second distance between the frame and a coordinate corresponding to a user operation; and in response to determining the second distance being less than or equal to a second threshold, show a hint icon in the first virtual scene. ### Claim 13 (depends on 12) The electronic device of claim 12, wherein the processor further configured to: show a cursor on the coordinate in the first virtual scene. ### Claim 14 (depends on 10) The electronic device of claim 10, wherein the processor further configured to: in response to determine the frame is dragged, display a hint image on a preview area in the first portal. ### Claim 15 (depends on 10) The electronic device of claim 10, wherein the processor further configured to: display a second portal in the first virtual scene, wherein the first virtual scene comprises a user-interactable object corresponding to the first portal; detect a user operation on the user-interactable object; and remove the second portal from the first virtual scene and display the first portal in the first virtual scene according to the user operation. ### Claim 16 A non-transitory computer readable storage medium for interacting with a virtual reality environment, recording an executable computer program to be loaded by an electronic device to execute steps of: displaying a first portal in a first virtual scene of the virtual reality environment, wherein the first portal is for a virtual scene switching, and the first portal comprises a frame; determining whether the frame is dragged toward a center of the first portal, comprising: in response to the frame being released from being dragged, determining a distance between the frame and the center; and in response to determining the distance being greater than or equal to a threshold, determining the frame is not dragged toward the center, wherein the frame is at an original position in the first virtual scene before being dragged; in response to determining the frame is dragged toward the center of the first portal, removing the first portal from the virtual reality environment; and in response to determining the frame is not dragged toward the center, restoring the frame from a current position back to the original position.