# US 11,907,885 B1 · System and method for computational simulation and augmented/virtual reality in a construction environment > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,907,885 B1 - Document ID: US11907885B1 - Status: Granted - Kind: B1 - Application number: 17/894,418 - Filed: 2022-08-24 - Granted: 2024-02-20 - Earliest claimed: 2022-03-29 - Assignees: Slate Technologies Inc. - Applicants: Slate Technologies Inc. - Inventors: Senthil Manickavasgam Kumar - Web page: https://patentgrep.com/patent/US11907885B1 ## CPC - G06Q 10/067: Enterprise or organisation modelling - G06F 30/20: Design optimisation, verification or simulation (optimisation, verification or simulation of circuit designs G06F30/30) - G06F 40/30: Semantic analysis - G06N 20/20: Ensemble learning - G06Q 10/04: Forecasting or optimisation specially adapted for administrative or management purposes, e.g. linear programming or "cutting stock problem" (market predictions or forecasting for commercial activities G06Q30/0202) - G06Q 10/06: Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling - G06Q 10/06315: {Needs-based resource requirements planning or analysis} - G06Q 10/0674: {using process simulation} - G06Q 10/103: {Workflow collaboration or project management} - G06Q 50/08: Construction - G06N 3/045: Combinations of networks - G06N 3/0475: Generative networks - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS ## Abstract A method for simulating a scenario in a computing environment is described. The method includes determining a user intent of a user from an input received from the user for executing at least one intended task by the user, generating a feature set based on analyzing the user intent, and processing, based on the user intent, at least one data feed received from a database to select at least one plan of action for executing the at least one intended task. At least one plan of action is simulated in a graphical user interface as virtual or augmented reality based on the feature set to enable at least one of responding additionally received input from the user and the at least one intended task is performed according to the user intent. ## Claims ### Claim 1 A method for simulating a scenario in a computing environment, the method comprising: training, by a server device, a machine learning model using training data including data relating to previous user inputs received from a user and information about the user; applying, by the server device, the trained machine learning model to a current user input received from the user to determine a user intent of the user for executing at least one intended task by the user, wherein the user intent is classified as at least one of: a temporal intent, a spatial intent, a fiscal intent, and a societal intent; generating, by the server device, a feature set based on the user intent; processing, by the server device and based on the user intent, at least one data feed received from a database to select at least one plan of action for executing the at least one intended task, wherein the processing the at least one data feed comprises processing, based on the user intent, one or more data feeds by a model ensemble implementing an ensemble learning for the one or more data feeds; and simulating, by the server device and in a graphical user interface, the at least one plan of action as virtual or augmented reality based on the feature set to enable at least one of responding an additionally received input from the user and performing the at least one intended task according to the user intent. ### Claim 2 (depends on 1) The method of claim 1, wherein the current user input is received from the user as at least one of: a text, an image, a video, and an audio format, and wherein the at least one intended task is determined from the current user input based on subjecting the current user input to at least one of: a natural language processing technique, an audio processing technique, and an image processing technique. ### Claim 3 (depends on 1) The method of claim 1, wherein the user intent corresponds to a plurality of preferences of the user pertaining to execution of the at least one intended task. ### Claim 4 (depends on 1) The method of claim 1, wherein the feature set corresponds to a multi-dimensional design vector comprising at least one of: a position coordinate system, cost, sustainability, safety, facility management, a construction principle, and an industry standard. ### Claim 5 (depends on 1) The method of claim 1, wherein in case of the user intent being the temporal intent to expedite an ongoing construction process in real-world, the processing the at least one data feed comprises: processing a data feed related to a real-time cost of a plurality of raw material suppliers; evaluating each of the plurality of raw material suppliers; and selecting relevant suppliers out of the plurality of raw material suppliers based on the evaluation. ### Claim 6 (depends on 1) The method of claim 1, further comprising providing, by the server device, recommendations of a plurality of activities to be implemented according to the user intent for performance of the at least one intended task. ### Claim 7 (depends on 1) The method of claim 1, wherein the simulating further comprises simulating the at least one plan of action for the at least one intended task in accordance with at least one objective related to the at least one intended task, and wherein the at least one objective is determined from the current user input based on a natural language parser and a work tokenizer. ### Claim 8 (depends on 7) The method of claim 7, wherein the simulating the at least one plan of action comprises simulating a plurality of construction requirements of a project as the augmented reality, and wherein the augmented reality comprises an actual image of a site augmented by at least one content item representing the plurality of construction requirements associated with at least one portion of the actual image. ### Claim 9 A system for simulating a scenario in a computing environment, the system comprising: a controller of a server device configured to: train a machine learning model using training data including data relating to previous user inputs received from a user and information about the user; apply the trained machine learning model to a current user input received from the user to determine a user intent of the user for executing at least one intended task by the user, wherein the user intent is classified as at least one of: a temporal intent, a spatial intent, a fiscal intent, and a societal intent; and generate a feature set based on the user intent; a model ensemble of the server device configured to process, based on the user intent, at least one data feed received from a database to select at least one plan of action for executing the at least one intended task, wherein the model ensemble for processing the at least one data feed is configured to process, based on the user intent, one or more data feeds by implementing an ensemble learning for the one or more data feeds; and a notifier of the server device configured to simulate, in a graphical user interface, the at least one plan of action as virtual or augmented reality based on the feature set to enable at least one of responding an additionally received input from the user and performing the at least one intended task according to the user intent. ### Claim 10 (depends on 9) The system of claim 9, wherein the current user input is received from the user as at least one of: a text, an image, a video, and an audio format, and wherein the at least one intended task is determined from the current user input based on subjecting the current user input to at least one of: a natural language processing technique, an audio processing technique, and an image processing technique. ### Claim 11 (depends on 9) The system of claim 9, wherein the user intent corresponds to a plurality of preferences of the user pertaining to execution of the at least one intended task. ### Claim 12 (depends on 9) The system of claim 9, wherein the feature set corresponds to a multi-dimensional design vector comprising at least one of: a position coordinate system, cost, sustainability, safety, facility management, a construction principle, and an industry standard. ### Claim 13 (depends on 9) The system of claim 9, wherein the controller is further configured to provide recommendations of a plurality of activities to be implemented according to the user intent for performance of the at least one intended task. ### Claim 14 (depends on 9) The system of claim 9, wherein the notifier is configured to simulate the at least one plan of action for the at least one intended task in accordance with at least one objective related to the at least one intended task, and wherein the at least one objective is determined from the current user input based on a natural language parser and a work tokenizer. ### Claim 15 (depends on 14) The system of claim 14, wherein the notifier configured to simulate the at least one plan of action is configured to simulate a plurality of construction requirements of a project as the augmented reality, and wherein the augmented reality comprises an actual image of a site augmented by at least one content item representing the plurality of construction requirements associated with at least one portion of the actual image. ### Claim 16 A non-transitory computer-readable storage medium, having stored thereon a computer-executable program which, when executed by at least one processor of a server device, causes the at least one processor to: train a machine learning model using training data including data relating to previous user inputs received from a user and information about the user; apply the trained machine learning model to a current user input received from the user to determine a user intent of the user for executing at least one intended task by the user, wherein the user intent is classified as at least one of: a temporal intent, a spatial intent, a fiscal intent, and a societal intent; generate a feature set based on the user intent; process, based on the user intent, at least one data feed received from a database of the user to select at least one plan of action for executing the at least one intended task, wherein the at least one processor for processing the at least one data feed is configured to process, based on the user intent, one or more data feeds by implementing an ensemble learning for the one or more data feeds; and simulate, in a graphical user interface, the at least one plan of action as virtual or augmented reality based on the feature set to enable at least one of responding an additionally received input from the user and perform the at least one intended task according to the user intent.