# US 2020/0401284 A1 · Virtual creation of real-world projects

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0401284 A1
- Document ID: US20200401284A1
- Status: Published application
- Kind: A1
- Application number: 16/904,112
- Filed: 2020-06-17
- Published: 2020-12-24
- Earliest claimed: 2019-06-18
- Assignees: TMRW Foundation IP & Holding S. À R.L.
- Applicants: TMRW Foundation IP & Holding S. À R.L.
- Inventors: Cevat Yerli
- Web page: https://patentgrep.com/patent/US20200401284A1

## CPC

- G06F 3/0484: for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06Q 10/0631: Resource planning, allocation, distributing or scheduling for enterprises or organisations
- G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts
- G06T 2219/024: Multi-user, collaborative environment
- G06T 2219/2004: Aligning objects, relative positioning of parts
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A system and method for providing a virtual collaborative creation of real-world projects. The system comprises a server configured to store and process input data, the server comprising a memory and a processor, wherein the memory further comprises a database with structured data storing virtual replicas of real-world elements forming a virtual world system, and wherein the processor is configured to execute data and instructions stored in the memory. A plurality of devices connect the server via a network, each device comprising sensing mechanisms configured to capture multi-source data from real-world elements that serve to enrich and synchronize the virtual replicas with corresponding real-world elements. Collaborative platforms stored in the memory and accessed via user devices enable the creation, tender offering, and administrative reviewing and approval or rejection of real-world projects. Methods thereof are also described.

## Claims

### Claim 1

A system for virtual collaborative creation of real-world projects, the system comprising:
a server system comprising one or more server computers including a memory and a processor, wherein the server system comprises a database with structured data storing virtual replicas of real-world elements forming a persistent virtual world system, wherein the virtual replicas are developed via a replica editor stored in the server system, the server system further storing collaborative platforms comprising a collaborative creation platform, a collaborative tender platform, a collaborative administration platform, and a project database configured to store project data; and
a plurality of connected devices connected to the server system via a network, each connected device comprising communication circuitry and one or more sensors, wherein the plurality of connected devices is configured to capture multi-source data from real-world elements that serve to enrich the virtual replicas and synchronize the virtual replicas with the corresponding real-world elements; and
wherein the collaborative creation platform enables creation of virtual projects in the persistent virtual world system representing proposed real-world projects, wherein the virtual projects include one or more of the virtual replicas of the real-world elements, wherein the collaborative tender platform enables providing tenders for selected projects, and wherein the collaborative administration platform enables review of the projects.

### Claim 2 (depends on 1)

The system of claim 1, wherein the replica editor comprises modeling tools that enable generating virtual replicas with data and instructions based on CAD or CAE models of the real-world elements, the modeling tools enabling inputting building information models.

### Claim 3 (depends on 2)

The system of claim 2, wherein the modeling tools further enable a car or drone-based image-scanning pipeline to be input through photo, video, depth measurements, simultaneous location and mapping (SLAM) scanning, or radar-imaging techniques, or combinations thereof in order to model the virtual replicas.

### Claim 4 (depends on 1)

The system of claim 1, wherein the collaborative creation platform enables selecting predefined assets or creating new assets via a user interface in merged reality or virtual reality and adding the predefined assets or the new assets to at least one of the virtual projects.

### Claim 5 (depends on 4)

The system of claim 4, wherein the corresponding virtual replicas of the predefined assets or the new assets are configured to be modified by via the user interface.

### Claim 6 (depends on 4)

The system of claim 4, wherein the corresponding virtual replicas of the predefined assets or the new assets are configured to be placed in desired locations in the one or more virtual projects, wherein the desired locations correspond to real-world locations.

### Claim 7 (depends on 1)

The system of claim 1, wherein the collaborative platforms enable implementation of recommender systems for providing ranking and filtering of projects to users through collaborative filtering or simulated filtering.

### Claim 8 (depends on 7)

The system of claim 7, wherein the simulated filtering includes running goal-based simulations to obtain simulation results and comparing the simulation results with one or more aspects of the projects.

### Claim 9 (depends on 8)

The system of claim 8, wherein the goal-based simulations are based at least in part on the captured multi-source data from the real-world elements.

### Claim 10

A method for virtual collaborative creation of real-world projects, the method comprising:
by a server system comprising one or more server computers:
providing a persistent virtual world system including a replica editor and virtual replicas of real-world elements that are created using the replica editor;
synchronizing the virtual replicas with the real-world elements using multi-source data captured by sensors of connected devices in communication with the server system;
providing a collaborative creation platform stored in the server system, which enables creation of one or more virtual projects in the persistent virtual world system representing one or more real-world project proposals and enables voting on the one or more real-world project proposals;
providing a collaborative tender platform stored in the server system, which enables providing one or more tenders to the one or more real-world project proposals; and
providing a collaborative administrative platform in the server system, which enables reviewing, approving or rejecting, and allocating budgets for the one or more real-world project proposals.

### Claim 11 (depends on 10)

The method of claim 10, wherein the replica editor comprises modeling tools that enable generating virtual replicas with data and instructions based on CAD models of the real-world elements, the modeling tools enabling inputting building information models.

### Claim 12 (depends on 11)

The method of claim 11, wherein the modeling tools further enable a car or drone-based image-scanning pipeline to be input through photo, video, depth measurements, simultaneous location and mapping (SLAM) scanning, or radar-imaging techniques, or combinations thereof, in order to model the virtual replicas.

### Claim 13 (depends on 10)

The method of claim 10, wherein the collaborative creation platform enables selecting predefined assets or creating new assets via a user interface in merged reality or virtual reality and adding the predefined assets or the new assets to at least one of the virtual projects.

### Claim 14 (depends on 10)

The method of claim 10, wherein the collaborative platforms enable implementation of recommender systems for providing ranking and filtering of projects to users through collaborative filtering or simulated filtering.

### Claim 15 (depends on 14)

The method of claim 14, wherein the simulated filtering includes running goal-based simulations to obtain simulation results and comparing the simulation results with one or more aspects of the projects.

### Claim 16 (depends on 15)

The method of claim 15, wherein the goal-based simulations are based at least in part on the multi-source data captured from the real-world elements.

### Claim 17

A computer-readable medium having stored thereon instructions configured to cause a server system to perform steps comprising:
providing a persistent virtual world system including a replica editor and virtual replicas of real-world elements that are created using the replica editor;
synchronizing the virtual replicas with the real-world elements using multi-source data captured by sensors of connected devices in communication with the server system; and
providing a collaborative creation platform stored in the server system, which enables creation of one or more virtual projects in the persistent virtual world system representing one or more real-world project proposals.

### Claim 18 (depends on 17)

The computer-readable medium of claim 17, wherein the replica editor comprises modeling tools that enable generating virtual replicas with data and instructions based on CAD models of the real-world elements, the modeling tools enabling inputting building information models.

### Claim 19 (depends on 17)

The computer-readable medium of claim 17, wherein the collaborative creation platform enables selecting predefined assets or creating new assets via a user interface in merged reality or virtual reality and adding the predefined assets or the new assets to at least one of the virtual projects.

### Claim 20 (depends on 19)

The computer-readable medium of claim 19, wherein the corresponding virtual replicas of the predefined assets and the new assets are configured to be placed in desired locations in the one or more virtual projects, wherein the desired locations correspond to real-world locations.
