Mixed-reality visor for in-situ vehicular operations training
OwnerWael Zohniinventor
Life of this patent
Estimating the term…
Abstract
A Mixed-Reality visor (MR-visor) system and method utilizing environmental sensor feedback for replicating restricted external visibility during operation of manned vehicles, such as marine or aircraft. Adaptive hardware and software enable the user to reliably limit, modify and/or block views outside window(s) areas of the vehicle while maintaining visibility of the cabin interior and instrument control panel(s) without need for complex mechanical hardware alignment and setup. In the case of aircraft pilot training, the MR-visor can be worn by a pilot to replicate Instrument Meteorological Conditions (IMC) and other challenging scenarios.
Claims58
A system for modifying a view perceived by a user who is substantially contained within an enclosure, the system comprising:
- a view-blocking wearable user visor-headset having a display surface and see-through camera;
- a distinguishing system configured to detect regions corresponding to an exterior region of the enclosure from an interior region contained within the enclosure and output a region signal, the distinguishing system is configured to generate a three-dimensional point cloud model of a substantial portion of the interior region of the enclosure;
- computer memory storage and data transfer capability of the three-dimensional point cloud model;
- a vision system configured to overlay imagery graphics upon the display surface of the view-blocking wearable user visor-headset based on the region signal;
- first position and motion detection sensors affixable to a portion of the enclosure;
- second position and motion detection sensors integrated with the view-blocking wearable user visor-headset;
- and
- hardware configured for data communication between the first position and motion detection sensors, the second position and motion detection sensors, and at least one processing unit that is configured to generate and utilize differential data between the first and the second position and motion detection sensors to reduce vision mapping compute requirements.
A system for modifying a user's view of a region of interest from within an enclosure in which the user is present, the system comprising:
- a user wearable device having a transparent display screen substantially covering a user's field of view;
- a first processing unit configured to detect regions of interest and output a region signal;
- second processing units configured to detect and transmit object three-dimensional orientation provided by first position and motion sensors affixed in place and second position and motion sensors integrated with the user wearable device;
- a vision system configured to receive the region signal and display an image upon at least one selected region of interest;
- at least one electromagnetic energy emitter and at least one electromagnetic energy receiver operably coupled to the vision system, the at least one electromagnetic energy emitter and the at least one electromagnetic energy receiver utilize infra-red electromagnetic energy;
- and
- a computer vision enabled three-dimensional point-cloud rendering subsystem configured to identify targeted regions of interest, the computer vision enabled three-dimensional point-cloud rendering subsystem comprising:
- at least one camera with a focal length positioned to provide binocular three-dimensional views of a surrounding environment;
- and
- a computer-based system integrating at least one of a three-dimensional point cloud model of internal features of the enclosure in which the user is present, an inertial measurement unit (IMU), and light-detection-and-ranging (LIDAR) depth sensing filter for determining limits of the enclosure and providing environmental references for point cloud model overlay, sizing, and position.
A system for modifying a view perceived by a user who is substantially contained within an enclosure, the system comprising:
- a view-blocking wearable user visor-headset having a display surface and see-through camera;
- a distinguishing system configured to detect regions corresponding to an exterior region of the enclosure from an interior region contained within the enclosure and output a region signal;
- a vision system configured to overlay imagery graphics upon the display surface of the view-blocking wearable user visor-headset based on the region signal;
- and
- a computer vision enabled three-dimensional point-cloud rendering subsystem configured to identify targeted regions of interest, the computer vision enabled three-dimensional point-cloud rendering subsystem comprising:
- at least one camera with a focal length positioned to provide binocular three-dimensional views of a surrounding environment;
- and
- a computer-based system integrating at least one of a three-dimensional point cloud model of internal features of the enclosure in which the user is present, an inertial measurement unit (IMU), and light-detection-and-ranging (LIDAR) depth sensing filter for determining limits of the enclosure and providing environmental references for point cloud model overlay, sizing, and position.
Dependencies are inferred from the claim text.