# US 2025/0148731 A1 · Device control method and device > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2025/0148731 A1 - Document ID: US20250148731A1 - Status: Published application - Kind: A1 - Application number: 19/017,126 - Filed: 2025-01-10 - Published: 2025-05-08 - Earliest claimed: 2022-08-03 - Assignees: Huawei Technologies Co., Ltd. - Applicants: Huawei Technologies Co., Ltd. - Inventors: Jintao WANG; Qing WANG; Fengjuan LIU - Web page: https://patentgrep.com/patent/US20250148731A1 ## CPC - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)} - G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)} - G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts - G06T 2219/2004: Aligning objects, relative positioning of parts - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract A device control method is provided that includes: displaying comment information on a screen of a first device, where the comment information is used to visualize an operation interface of at least a part of functions of a second device, the first device is an augmented reality device or a virtual reality device, and the second device is a physical device; determining a third device, where the third device is a device in the physical world; and transmitting at least a part of data associated with the comment information to the third device. In this way, in a multi-device collaboration scenario, the first device visualizes operation interfaces of some functions of the second device, so that a user can control these operation interfaces, and after determining the third device, the user can hop the operation interfaces of the functions of the second device to the third device. ## Claims ### Claim 1 A device control method, wherein the method comprises: displaying comment information on a screen of a first device, wherein the comment information is used to visualize an operation interface of at least a part of functions of a second device, the first device is at least one of an augmented reality device or a virtual reality device, and the second device is a physical device; determining a third device, wherein the third device is a device in the physical world; and transmitting at least a part of data associated with the comment information to the third device. ### Claim 2 (depends on 1) The method according to claim 1, wherein before the transmitting at least a part of data associated with the comment information to the third device, the method further comprises: determining that a first operation is obtained that is an operation of selecting the comment information. ### Claim 3 (depends on 1) The method according to claim 1, wherein the method further comprises: in response to a movement operation for the comment information, controlling the comment information to move on the screen. ### Claim 4 (depends on 3) The method according to claim 3, wherein the controlling the comment information to move on the screen further comprises: determining that the movement operation is an operation of moving from the second device to the third device; and controlling the comment information to move on the screen from a current location of the comment information to a location corresponding to the third device on the screen. ### Claim 5 (depends on 1) The method according to claim 1, wherein the determining the third device comprises at least one of the following: a degree of coincidence between an area occupied by the comment information on the screen and a target area on the screen is greater than a preset value, wherein the target area is an area corresponding to a display area of the third device on the screen; a tap on the third device is obtained; or a cursor moves to the third device and stays on for a preset duration. ### Claim 6 (depends on 1) The method according to claim 1, wherein before the displaying comment information on the screen of the first device, the method further comprises: in response to an obtained first instruction, sending a first message to the second device, wherein the first message is used to obtain information related to the operation interface of at least the part of functions of the second device; and obtaining a second message sent by the second device, wherein the second message comprises the information related to the operation interface of at least the part of functions of the second device. ### Claim 7 A device, comprising: at least one memory; and at least one processor, that is operatively coupled to the memory, to: display comment information on a screen of a first device, wherein the comment information is used to visualize an operation interface of at least a part of functions of a second device, the first device is at least one of an augmented reality device or a virtual reality device, and the second device is a physical device; determine a third device, wherein the third device is a device in the physical world; and transmit at least a part of data associated with the comment information to the third device. ### Claim 8 (depends on 7) The device according to claim 7, wherein before the transmitting at least a part of data associated with the comment information to the third device, the processor is further to: determine that a first operation is obtained that is an operation of selecting the comment information. ### Claim 9 (depends on 7) The device according to claim 7, wherein the processor is further to: in response to a movement operation for the comment information, control the comment information to move on the screen. ### Claim 10 (depends on 9) The device according to claim 9, wherein the processor is further to: determine that the movement operation is an operation of moving from the second device to the third device; and control the comment information to move on the screen from a current location of the comment information to a location corresponding to the third device on the screen. ### Claim 11 (depends on 7) The device according to claim 7, wherein the determining the third device comprises at least one of the following: a degree of coincidence between an area occupied by the comment information on the screen and a target area on the screen is greater than a preset value, wherein the target area is an area corresponding to a display area of the third device on the screen; a tap on the third device is obtained; or a cursor moves to the third device and stays on for preset duration. ### Claim 12 (depends on 7) The device according to claim 7, wherein before the displaying comment information on the screen of the first device, the processor is further to: in response to an obtained first instruction, send a first message to the second device, wherein the first message is used to obtain information related to the operation interface of at least the part of functions of the second device; and obtain a second message sent by the second device, wherein the second message comprises the information related to the operation interface of at least the part of functions of the second device. ### Claim 13 A non-transitory computer-readable storage medium storing instructions that, when executed by a processor, cause the processor to: display comment information on a screen of a first device, wherein the comment information is used to visualize an operation interface of at least a part of functions of a second device, the first device is at least one of an augmented reality device or a virtual reality device, and the second device is a physical device; determine a third device, wherein the third device is a device in the physical world; and transmit at least a part of data associated with the comment information to the third device. ### Claim 14 (depends on 13) The non-transitory computer-readable storage medium according to claim 13, wherein before the transmitting at least a part of data associated with the comment information to the third device, the processor is further to: determine that a first operation is obtained that is an operation of selecting the comment information. ### Claim 15 (depends on 13) The non-transitory computer-readable storage medium according to claim 13, wherein the processor is further to: in response to a movement operation for the comment information, control the comment information to move on the screen. ### Claim 16 (depends on 15) The non-transitory computer-readable storage medium according to claim 15, wherein the processor is further to: determine that the movement operation is an operation of moving from the second device to the third device; and control the comment information to move on the screen from a current location of the comment information to a location corresponding to the third device on the screen. ### Claim 17 (depends on 13) The non-transitory computer-readable storage medium according to claim 13, wherein the determining the third device comprises any one of the following: a degree of coincidence between an area occupied by the comment information on the screen and a target area on the screen is greater than a preset value, wherein the target area is an area corresponding to a display area of the third device on the screen; a tap on the third device is obtained; or a cursor moves to the third device and stays on for preset duration. ### Claim 18 (depends on 13) The non-transitory computer-readable storage medium according to claim 13, wherein before the displaying comment information on the screen of the first device, the processor is further to: in response to an obtained first instruction, send a first message to the second device, wherein the first message is used to obtain information related to the operation interface of at least the part of functions of the second device; and obtain a second message sent by the second device, wherein the second message comprises the information related to the operation interface of at least the part of functions of the second device.