# US 11,908,088 B2 · Controlling virtual resources from within an augmented reality environment > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,908,088 B2 - Document ID: US11908088B2 - Status: Granted - Kind: B2 - Application number: 17/342,582 - Filed: 2021-06-09 - Published: 2022-12-15 - Granted: 2024-02-20 - Earliest claimed: 2021-06-09 - Assignees: Red Hat, Inc. - Applicants: Red Hat, Inc. - Inventors: Alexander Braverman Masis; Adam Christopher Scerra - Web page: https://patentgrep.com/patent/US11908088B2 ## CPC - G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)} - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G06F 9/451: Execution arrangements for user interfaces - G06Q 10/063: Operations research, analysis or management - H04L 67/131: Protocols for games, networked simulations or virtual reality - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) ## Abstract Virtual resources can be controlled from within an augmented reality environment. For example, a computing device can display, in an augmented reality environment, a representation of a physical object corresponding to a virtual resource. The computing device can receive an interaction with the representation of the physical object in the augmented reality environment. The computing device can output a command to cause a result in the virtual resource external to the augmented reality environment based on the interaction. ## Claims ### Claim 1 A system comprising: a processor; and a memory including instructions that are executable by the processor for causing the processor to: display, by an augmented reality system, a physical object representation in an augmented reality environment, the physical object representation corresponding to a virtualized computing resource that is hosted by a computing device external to the augmented reality environment; receive, by the augmented reality system, an interaction with the physical object representation in the augmented reality environment, a text command associated with the interaction being configured to be displayed at a user interface of the computing device, the user interface being a command terminal; and output, by the augmented reality system, a command to the computing device for causing a result in the virtualized computing resource external to the augmented reality environment based on the interaction, the result comprising a storage capacity adjustment, a powering on or off, or a creation or deletion of the virtualized computing resource. ### Claim 2 (depends on 1) The system of claim 1, wherein the memory further includes instructions that are executable by the processor for causing the processor to: display the augmented reality environment at a headset of the augmented reality system associated with the augmented reality environment, wherein the augmented reality environment comprises an overlay of the physical object representation over physical objects in a space external to the augmented reality environment; receive, from a controller of the augmented reality system associated with the augmented reality environment, the interaction from a user within the augmented reality environment; and determine the result based on a predefined mapping of interactions and results, wherein the predefined mapping includes the interaction. ### Claim 3 (depends on 1) The system of claim 1, wherein the memory further includes instructions that are executable by the processor for causing the processor to: display, in the augmented reality environment, a representation of a relationship between the physical object representation and another physical object representation. ### Claim 4 (depends on 1) The system of claim 1, wherein the virtualized computing resource comprises a virtual machine, a container, a virtual disk, a virtual server, or a virtual network. ### Claim 5 (depends on 1) The system of claim 1, wherein the memory further includes instructions that are executable by the processor for causing the processor to: automatically implement the result in the virtualized computing resource based on the command. ### Claim 6 (depends on 1) The system of claim 1, wherein the memory further includes instructions that are executable by the processor for causing the processor to: receive an input associated with the virtualized computing resource at the user interface external to the augmented reality environment; and display an outcome of the input at the virtualized computing resource in the augmented reality environment. ### Claim 7 (depends on 1) The system of claim 1, wherein the physical object representation that corresponds to the virtualized computing resource is predefined. ### Claim 8 A method comprising: displaying, by an augmented reality system, a physical object representation in an augmented reality environment, the physical object representation corresponding to a virtualized computing resource that is hosted by a computing device external to the augmented reality environment; receiving, by the augmented reality system, an interaction with the physical object representation in the augmented reality environment, a text command associated with the interaction being configured to be displayed at a user interface of the computing device, the user interface being a command terminal; and outputting, by the augmented reality system, a command to the computing device for causing a result in the virtualized computing resource external to the augmented reality environment based on the interaction, the result comprising a storage capacity adjustment, a powering on or off, or a creation or deletion of the virtualized computing resource. ### Claim 9 (depends on 8) The method of claim 8, further comprising: displaying the augmented reality environment at a headset of the augmented reality system associated with the augmented reality environment, wherein the augmented reality environment comprises an overlay of the physical object representation over physical objects in a space external to the augmented reality environment; receiving, from a controller of the augmented reality system associated with the augmented reality environment, the interaction from a user within the augmented reality environment; and determining the result based on a predefined mapping of interactions and results, wherein the predefined mapping includes the interaction. ### Claim 10 (depends on 8) The method of claim 8, further comprising: displaying, in the augmented reality environment, a representation of a relationship between the physical object representation and another physical object representation. ### Claim 11 (depends on 8) The method of claim 8, further comprising: automatically implementing the result in the virtualized computing resource based on the command. ### Claim 12 (depends on 8) The method of claim 8, further comprising: receiving an input associated with the virtualized computing resource at the user interface external to the augmented reality environment; and displaying an outcome of the input at the virtualized computing resource in the augmented reality environment. ### Claim 13 (depends on 8) The method of claim 8, wherein the physical object representation that corresponds to the virtualized computing resource is predefined. ### Claim 14 A non-transitory computer-readable medium comprising program code that is executable by a processor for causing the processor to: display, by an augmented reality system, a physical object representation in an augmented reality environment, the physical object representation corresponding to a virtualized computing resource that is hosted by a computing device external to the augmented reality environment; receive, by the augmented reality system, an interaction with the physical object representation in the augmented reality environment, a text command associated with the interaction being configured to be displayed at a user interface of the computing device, the user interface being a command terminal; and output, by the augmented reality system, a command to the computing device for causing a result in the virtualized computing resource external to the augmented reality environment based on the interaction, the result comprising a storage capacity adjustment, a powering on or off, or a creation or deletion of the virtualized computing resource. ### Claim 15 (depends on 14) The non-transitory computer-readable medium of claim 14, further comprising program code that is executable by the processor for causing the processor to: display the augmented reality environment at a headset of the augmented reality system associated with the augmented reality environment, wherein the augmented reality environment comprises an overlay of the physical object representation over physical objects in a space external to the augmented reality environment; receive, from a controller of the augmented reality system associated with the augmented reality environment, the interaction from a user within the augmented reality environment; and determine the result based on a predefined mapping of interactions and results, wherein the predefined mapping includes the interaction. ### Claim 16 (depends on 14) The non-transitory computer-readable medium of claim 14, further comprising program code that is executable by the processor for causing the processor to: display, in the augmented reality environment, a representation of a relationship between the physical object representation and another physical object representation. ### Claim 17 (depends on 14) The non-transitory computer-readable medium of claim 14, further comprising program code that is executable by the processor for causing the processor to: automatically implement the result in the virtualized computing resource based on the command. ### Claim 18 (depends on 14) The non-transitory computer-readable medium of claim 14 further comprising program code that is executable by the processor for causing the processor to: receive an input associated with the virtualized computing resource at the user interface external to the augmented reality environment; and display an outcome of the input at the virtualized computing resource in the augmented reality environment. ### Claim 19 (depends on 14) The non-transitory computer-readable medium of claim 14, wherein the physical object representation that corresponds to the virtualized computing resource is predefined.