Back to results
US 11,379,287 B2Granted
System and method for error detection and correction in virtual reality and augmented reality environments
AssigneeFactualVR, Inc.
InventorEduardo Neeter
Life of this patent
Estimating the term…
Abstract
Embodiments of the present disclosure are related to training one or more of machine learning algorithms in a virtual reality environment for error detection and correction and/or for employing one or more trained machine learning models in an augmented reality environment to detect and/or correct user errors associated the performance of one or more tasks.
Claims19
A method for error detection in an augmented reality environment or a virtual reality environment, the method comprising:
- defining a data structure corresponding to a set of tasks;
- generating a virtual reality scene model to simulate a real-world, physical location;
- rendering the virtual reality scene model on a virtual reality device to immerse a user of the virtual reality device in the virtual reality scene model;
- capturing actions of the user simulating a performance of the set of tasks;
- training one or more machine learning algorithms to detect differences between the actions of the user and the set of tasks to generate one or more trained machine learning models;
- deploying the one or more trained machine learning models in an augmented reality environment or a virtual reality environment;
- capturing actions of the user or a different user in a real-world, physical location, the user or the different user utilizing an augmented reality device;
- executing the one or more trained machine learning models to determine whether the actions of the user or the different user are deviating from the set of tasks;
- and
- generating a feedback signal to correct the user or the different user in the augmented reality environment based on the one or more trained machine learning models determining at least one of the actions is deviating from a corresponding task in the set of tasks.
7 more elements
A system for error detection in an augmented reality environment or a virtual reality environment, the system comprising:
- a virtual reality device;
- one or more non-transitory computer-readable media storing a data structure corresponding to a set of tasks and instructions for training one or more machine learning algorithms;
- and
- a processing device executing the instructions to:
- generate a virtual reality scene model to simulate a real-world, physical location;
- render the virtual reality scene model on the virtual reality device to immerse a user of the virtual reality device in the virtual reality scene model;
- capture actions of the user simulating a performance of the set of tasks;
- train the one or more machine learning algorithms to detect differences between the actions of the user and the set of tasks to generate one or more trained machine learning models;
- and
- deploy the one or more trained machine learning models in an augmented reality environment or a virtual reality environment;
- and
- wherein the processing device or a different processing device is programmed to:
- capture actions of the user or a different user in a real-world, physical location, the user or the different user utilizing an augmented reality device;
- execute the one or more trained machine learning models to determine whether the actions of the user or the different user are deviating from the set of tasks;
- and
- generate a feedback signal to correct the user or the different user in the augmented reality environment based on the one or more trained machine learning models determining at least one of the actions is deviating from a corresponding task in the set of tasks.
13 more elements
A non-transitory computer-readable medium comprising instructions, wherein execution of the instructions by a processing device causes the processing device to:
- define a data structure corresponding to a set of tasks;
- generate a virtual reality scene model to simulate a real-world, physical location;
- render the virtual reality scene model on the virtual reality device to immerse a user of the virtual reality device in the virtual reality scene model;
- capture actions of the user simulating a performance of the set of tasks;
- train the one or more machine learning algorithms to detect differences between the actions of the user and the set of tasks to generate one or more trained machine learning models;
- and
- deploy the one or more trained machine learning models in an augmented reality environment or a virtual reality environment;
- capture actions of the user or a different user in a real-world, physical location, the user or the different user utilizing an augmented reality device;
- execute the one or more trained machine learning models to determine whether the actions of the user or the different user are deviating from the set of tasks;
- and
- generate a feedback signal to correct the user or the different user in the augmented reality environment based on the one or more trained machine learning models determining at least one of the actions is deviating from a corresponding task in the set of tasks.
8 more elements
Dependencies are inferred from the claim text.