# US 2020/0401436 A1 · System and method to operate 3d applications through positional virtualization technology > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2020/0401436 A1 - Document ID: US20200401436A1 - Status: Published application - Kind: A1 - Application number: 16/904,441 - Filed: 2020-06-17 - Published: 2020-12-24 - Earliest claimed: 2019-06-18 - Assignees: TMRW Foundation IP & Holding S. À R.L. - Applicants: TMRW Foundation IP & Holding S. À R.L. - Inventors: Cevat Yerli - Web page: https://patentgrep.com/patent/US20200401436A1 ## CPC - G06F 9/45558: {Hypervisor-specific management and integration aspects} - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G06F 9/5072: {Grid computing} - G06F 9/5077: {Logical partitioning of resources; Management or configuration of virtualized resources (specific details on emulation or internal functioning of virtual machines G06F9/455)} - A63F 2300/51: Server architecture - G06F 2009/45562: {Creating, deleting, cloning virtual machine instances} - G06F 2009/4557: {Distribution of virtual machine instances; Migration and load balancing} - G06F 2009/45583: {Memory management, e.g. access or allocation} - G06F 2009/45595: {Network integration; Enabling network access in virtual machine instances} - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR ## Abstract A system and method to operate applications through positional virtualization technology. The system comprises a server including at least one processor and memory storing a persistent virtual world system comprising a data structure in which at least one virtual replica of at least one corresponding real object is represented, and at least one application run and hosted on at least one virtual machine virtually positioned in a location of the persistent virtual world system. Provisioning of the virtual machines is managed by a virtual machine management system stored in the memory of the server. One or more user devices connected to the servers via a network are configured to access and execute the applications hosted on the virtual machines of the at least one server and to receive resources thereof based on application requirements. ## Claims ### Claim 1 A system to operate applications through virtualization technologies, the system comprising: one or more servers comprising at least one processor and memory, the one or more servers storing a persistent virtual world system comprising a data structure in which at least one virtual replica of at least one corresponding real object is represented, and at least one application run and hosted on at least one virtual machine virtually positioned in a location of the persistent virtual world system, the one or more servers comprising hardware infrastructure providing the at least one virtual machine with resources allocated based on requirements of the at least one application, wherein provisioning of the at least one virtual machine is managed by a virtual machine management system stored in the memory of the server based on a distance prioritization parameter. ### Claim 2 (depends on 1) The system of claim 1, wherein the virtual machine management system comprises a global virtual machine manager performing virtual machine resource requirement assessment and provisioning through a hypervisor interfacing with the at least one virtual machine. ### Claim 3 (depends on 2) The system of claim 2, wherein the global virtual machine manager is part of a 3D engine that enables the development, testing, and publishing of virtual-machine-hosted 3D applications in the virtual world linked to one or more locations in the real world. ### Claim 4 (depends on 2) The system of claim 2, wherein the virtual machine management system further comprises a local virtual machine manager connected to the global virtual machine manager and configured to provide the virtual machine manager with a resource assessment of the at least one virtual machine, the local virtual machine manager comprising a monitoring component measuring virtual machine resource utilization. ### Claim 5 (depends on 1) The system of claim 1, wherein the virtual machine management system further manages the provisioning to the at least one virtual machine based on application coordinates, 3D data structure of virtual replicas, contextual data, user-related data, contextual data, scene graphs, level of detail management, preparation for rendering stages, load balancing, or virtual machine migration, or a combination thereof. ### Claim 6 (depends on 5) The system of claim 5, wherein the 3D data structure comprises one or more octrees, quadtrees, BSP trees, sparse voxel octrees, 3D arrays, kD trees, point clouds, wire-frames, boundary representations (B-Rep), constructive solid geometry trees (CSG Trees), bintrees, or hexagonal structures, or a combination thereof. ### Claim 7 (depends on 5) The system of claim 5, wherein the contextual data further comprises a micro-context and macro-context, the micro-context comprising user-related data and user interaction radius data, and the macro-context is determined in a predefined area and comprises network equipment, real world objects, virtual objects, number of users, or resource management, or a combination thereof. ### Claim 8 (depends on 7) The system of claim 7, wherein the user-related data comprises user location data, user viewing position and orientation, user social data, user preferences, user service context, or level of agreement-related quality of service, or a combination thereof. ### Claim 9 (depends on 7) The system of claim 7, wherein the macro-context further comprises data related to the servers in a predetermined area, real world objects in the predetermined area, the number of users in the predetermined area, applications, ads, or other virtual objects in the predetermined area, or resource management for the predetermined area, or a combination thereof. ### Claim 10 (depends on 1) The system of claim 1, wherein the at least one application comprises a 3D application, and wherein the distance prioritization parameter takes into account a distance of user devices configured to access and execute the 3D application to the at least one virtual machine. ### Claim 11 (depends on 1) The system of claim 1, wherein the provisioning is performed in a cloud-to-edge infrastructure comprising client devices, cloud server, and fog servers. ### Claim 12 (depends on 1) The system of claim 1, wherein virtual objects comprising ads, interactive elements, and virtual replicas are hosted on respective virtual machines. ### Claim 13 A system to operate applications through virtualization technologies, the system comprising: one or more servers comprising at least one processor and memory, the one or more servers storing a persistent virtual world system comprising a data structure in which at least one virtual replica of at least one corresponding real object is represented, and at least one application hosted on at least one container virtually positioned in a location of the persistent virtual world system, the one or more servers comprising a hardware infrastructure providing the at least one container with resources allocated based on requirements of the at least one application, wherein provisioning of the at least one container is managed by a container management system based on at least a distance prioritization parameter; and one or more user devices connected to the servers via a network, the user devices being configured to access and execute the applications hosted on the containers of the at least one server and to receive resources thereof based on application requirements. ### Claim 14 A method to operate applications through virtualization technologies, the method comprising: providing, in memory of a server system comprising one or more servers, a persistent virtual world system comprising a data structure in which at least one virtual replica of at least one corresponding real object is represented; providing in the memory of the server system a virtual machine management system and at least one application run and hosted on a virtual machine virtually positioned in a location of the persistent virtual world system, the at least one application being interacted with by one or more user devices connected to the server system via a network; providing the virtual machine with resources from the server system allocated based on requirements of the at least one application; and managing the provisioning of the virtual machine by the virtual machine management system based at least in part on a distance prioritization parameter taking into account a distance of the one or more user devices to the virtual machine. ### Claim 15 (depends on 14) The method of claim 14, wherein the virtual machine management system comprises a global virtual machine manager performing virtual machine resource requirement assessment and provisioning through a hypervisor interfacing with the virtual machine. ### Claim 16 (depends on 14) The method of claim 14, wherein the virtual machine management system comprises a local virtual machine manager connected to a global virtual machine manager and configured to provide virtual machine manager with a resource assessment of the virtual machine, the local virtual machine manager comprising a monitoring component measuring virtual machine resource utilization, a feedback controller configured to determine required resource allocations for the virtual machine, and an arbitrator obtaining resource allocation requests from the feedback controller and sets the resource shares for the virtual machine. ### Claim 17 (depends on 14) The method of claim 14, wherein managing the provisioning of the virtual machine is further based on a data relevance filter of the global virtual machine manager taking into account application coordinates, 3D data structure of virtual replicas, contextual data, user-related data, contextual data, scene graphs, level of detail management, preparation for rendering stages, load balancing, or virtual machine migration, or a combination thereof. ### Claim 18 (depends on 14) The method of claim 14, wherein managing the provisioning of the virtual machine by a virtual machine management system comprises: performing a resource requirement assessment by a global virtual machine manager; and allocating the resources to the virtual machine by the global virtual machine manager. ### Claim 19 (depends on 14) The method of claim 14, wherein the global virtual machine manager is part of a 3D engine that enables the development, testing, and publishing of VM-hosted 3D applications in the virtual world linked to a location in the real world. ### Claim 20 One or more non-transitory computer-readable media having stored thereon instructions configured to, when executed by one or more computers, cause the one or more computers to: provide a persistent virtual world system comprising a data structure in which at least one virtual replica of at least one corresponding real object is represented; provide at least one 3D application run and hosted on one or more virtual machines virtually positioned in a location of the persistent virtual world system, the at least one 3D application configured to be interacted with by one or more user devices; provide the one or more virtual machines with resources from at least one server allocated based on requirements of the at least one 3D application; and manage provisioning of the one or more virtual machines by a virtual machine management system, wherein the management is based on a distance prioritization parameter taking into account a distance of the one or more user devices to the at least one virtual machine.