# US 11,307,968 B2 · System and method for developing, testing and deploying digital reality applications into the real world via a virtual world > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,307,968 B2 - Document ID: US11307968B2 - Status: Granted - Kind: B2 - Application number: 16/421,155 - Filed: 2019-05-23 - Published: 2019-11-28 - Granted: 2022-04-19 - Earliest claimed: 2018-05-24 - Assignees: THE CALANY Holding S. À R.L. - Applicants: The Calany Holding S. à R.L. - Inventors: Cevat Yerli - Web page: https://patentgrep.com/patent/US11307968B2 ## CPC - G06F 11/3698: Environments for analysis, debugging or testing of software - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G06F 11/3668: Testing of software - G06F 11/3672: {Test management} - G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)} - H04L 67/131: Protocols for games, networked simulations or virtual reality - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) ## Abstract A system and method for developing, testing, and deploying digital reality applications into the real world via a persistent virtual world system. The system includes a server that stores and computes a persistent virtual world system comprising at least one virtual replica of a corresponding real object, an application development environment module, and an application management environment module. A user device connected to the server via a network accesses one or more of the persistent virtual world system, the application development environment module, and application management environment module. Users view and interact with the digital reality applications in a merged reality comprised of a real world layer comprising real objects, a virtual world layer configured on top of the real world layer and comprising the purely virtual objects and virtual replicas of respective real objects, and one or more digital reality application layers comprising the deployed digital reality applications. ## Claims ### Claim 1 A system for facilitating development, testing, and deployment of digital reality applications, the system comprising: at least one server comprising memory and at least one processor, the memory storing one or more digital reality applications and a persistent virtual world system comprising at least one virtual replica of a corresponding real object, wherein virtual 3D world coordinates and virtual properties of the at least one virtual replica are based on 3D world coordinates and properties of the corresponding real object; wherein the persistent virtual world system is configured to allow one or more users to view and interact with the one or more digital reality applications in a merged reality comprising a real world layer, a virtual world layer configured on top of the real world layer, and one or more digital reality application layers configured on top of the virtual world layer; and wherein the one or more digital reality applications include one or more positional digital reality applications on a predetermined 3D world location or one or more areal digital reality application services on a predetermined geographical area configured to provision an application service to a user within or in proximity to the predetermined geographical area. ### Claim 2 (depends on 1) The system of claim 1, wherein the memory further stores an application development environment module configured to enable access to the persistent virtual world system for developing the one or more digital reality applications, and an application management environment module configured to enable access to the persistent virtual world system for receiving, managing and deploying one or more developed digital reality applications. ### Claim 3 (depends on 2) The system of claim 2, wherein the application development environment module further comprises a testing sub-module configured to test the one or more digital reality applications in a development space, in a virtual world final positional or areal location in virtual reality through the persistent virtual world system, and in the real world final positional or areal location in augmented reality through the persistent virtual world system, and wherein the application management environment module further comprises an application management testing sub-module configured to test the one or more digital reality applications developed and test deployed via the application development environment module. ### Claim 4 (depends on 2) The system of claim 2, wherein the application development environment module further comprises a settings sub-module configured to specify positional or areal location and space, time, and target user parameter settings of the one or more digital reality applications or one or more digital application layers with respect to the persistent virtual world system. ### Claim 5 (depends on 4) The system of claim 4, wherein the settings sub-module is further configured to enable an adaptive characteristics configuration of the one or more digital reality applications. ### Claim 6 (depends on 4) The system of claim 4, wherein the settings sub-module is further configured to attach the one or more positional digital reality applications to the at least one virtual replica existing in the persistent virtual world system or to one or more empty locations of the persistent virtual world system not linked to a specific virtual replica, or to attach the one or more areal digital reality application services to one or more geographic areas of the persistent virtual world system not linked to a specific virtual replica. ### Claim 7 (depends on 1) The system of claim 1, wherein the system is configured for processing and provisioning of the one or more digital reality applications based on proximity of at least one user device to the one or more digital reality applications, and wherein the provisioning and processing are server-based, client-based, or combinations thereof. ### Claim 8 (depends on 7) The system of claim 7, wherein the server is configured to compute and composite media content of a plurality of digital reality applications in a field of view or wide view of the one or more users and transmit the computed and composited media content to the at least one user device where the at least one user device is in proximity to the plurality of digital reality applications. ### Claim 9 (depends on 1) The system of claim 1, wherein the one or more digital reality applications are configured to filter and process a plurality of elements of the virtual world layer that are relevant to the one or more digital reality applications. ### Claim 10 A method for facilitating development, testing, and deployment of digital reality applications, the method comprising: providing, by at least one server comprising memory and at least one processor, one or more digital reality applications and a persistent virtual world system comprising at least one virtual replica of a corresponding real object, wherein virtual 3D world coordinates and virtual properties of the at least one virtual replica are based on 3D world coordinates and properties of the corresponding real object; and receiving, by the at least one server, input from at least one user device accessing the persistent virtual world system, wherein the at least one user device is connected to the at least one server via a network, and wherein the persistent virtual world system allows one or more users to view and interact with the one or more digital reality applications in a merged reality comprising a real world layer, a virtual world layer configured on top of the real world layer, and one or more digital reality application layers configured on top of the virtual world layer; and wherein the one or more digital reality applications include one or more positional digital reality applications on a predetermined 3D world location or one or more areal digital reality application services on a predetermined geographical area configured to provision an application service to a user within or in proximity to the predetermined geographical area. ### Claim 11 (depends on 10) The method of claim 10, wherein the input is related to development of the one or more digital reality applications, and wherein the development comprises setting up application configuration, testing the one or more digital reality applications in a development space, and carrying out further testing in augmented and virtual reality final locations. ### Claim 12 (depends on 10) The method of claim 10, wherein the input is related to development of the one or more digital reality applications, and wherein the development is performed in an application development environment module stored in the memory, and wherein management of the one or more digital reality applications is performed in an application management environment module. ### Claim 13 (depends on 12) The method of claim 12, wherein the application development environment module comprises a testing sub-module configured to test the one or more digital reality applications in a development space, in a virtual world final positional or areal location in virtual reality through the persistent virtual world system, and in the real world final positional or areal location in augmented reality through the persistent virtual world system, and wherein the application management environment module further comprises an application management testing sub-module configured to test the one or more digital reality applications developed and test deployed via the application development environment module. ### Claim 14 (depends on 12) The method of claim 12, wherein the application development environment module comprises a settings sub-module configured to specify positional or areal location and space, time, and target user parameter settings of the one or more digital reality applications or one or more digital application layers with respect to the persistent virtual world system. ### Claim 15 (depends on 10) The method of claim 10, wherein the settings sub-module is configured to attach the one or more positional digital reality applications to the at least one virtual replica existing in the persistent virtual world system or to one or more empty locations of the persistent virtual world system not linked to a specific virtual replica, or to attach the one or more areal digital reality application services to one or more geographic areas of the persistent virtual world system not linked to a specific virtual replica. ### Claim 16 (depends on 10) The method of claim 10 further comprising processing and provisioning the one or more digital reality applications, wherein the processing and provisioning are based on proximity of the at least one user device to the one or more digital reality applications, and wherein the provisioning and processing are server-based, client-based, or combinations thereof. ### Claim 17 (depends on 16) The method of claim 16 further comprising, where the at least one user device is in proximity to a plurality of positional digital reality applications or areal digital reality application services: computing and compositing media content of the plurality of positional digital reality applications or areal digital reality application services in a field of view or wide view of the one or more users; and transmitting the computed and composited media content to the at least one user device. ### Claim 18 (depends on 10) The method of claim 10 wherein the at least one server implements software tools to facilitate the following actions: sharing the one or more digital reality applications with an application administrator; testing, by the application administrator, the one or more digital reality applications for compliance; approving or rejecting the one or more digital reality applications; sending, if required, application adjustment requests to the application developer; adjusting by the application developer, if required, the one or more digital reality application; and deploying by the application administrator, the one or more digital reality applications into an online application library from the application management environment module. ### Claim 19 One or more non-transitory computer readable-media having stored thereon instructions configured to cause a server computer system comprising memory and at least one processor to perform a method for facilitating development, testing, and deployment of digital reality applications, comprising the steps of: providing one or more digital reality applications and a persistent virtual world system comprising at least one virtual replica of a corresponding real object, wherein virtual 3D world coordinates and virtual properties of the at least one virtual replica are based on 3D world coordinates and properties of the corresponding real object; and receiving input from at least one user device accessing the persistent virtual world system, wherein the at least one user device is connected to the at least one server via a network, and wherein the persistent virtual world system allows one or more users to view and interact with the one or more digital reality applications in a merged reality comprising a real world layer, a virtual world layer configured on top of the real world layer, and one or more digital reality application layers configured on top of the virtual world layer; and wherein the one or more digital reality applications include one or more positional digital reality applications on a predetermined 3D world location or one or more areal digital reality application services on a predetermined geographical area configured to provision an application service to a user within or in proximity to the predetermined geographical area. ### Claim 20 (depends on 19) The one or more non-transitory computer readable-media of claim 19, wherein the input is related to development of the one or more digital reality applications, wherein the development is performed in an application development environment module, wherein management of the one or more digital reality applications is performed in an application management environment module, wherein the application development environment module comprises a settings sub-module, and wherein the settings sub-module is configured to attach the one or more positional digital reality applications to the at least one virtual replica existing in the persistent virtual world system or to one or more empty locations of the persistent virtual world system not linked to a specific virtual replica, or to attach the one or more areal digital reality application services to one or more geographic areas of the persistent virtual world system not linked to a specific virtual replica.