Heavy Equipment Simulation System and Methods of Operating Same
AssigneeCSE Software Inc.
InventorAndrew R. Pittman
Life of this patent
Estimating the term…
Abstract
A heavy equipment simulation system for simulating an operation of a heavy equipment vehicle in a virtual environment is described herein. The heavy equipment simulation system includes a support frame, an operator input control assembly coupled to the support frame for receiving input from a user, a motion actuation system coupled to the support frame for adjusting an orientation of the support frame with respect to a ground surface, a display device assembly configure to display the virtual environment including the simulated heavy equipment vehicle, a virtual reality (VR) headset unit adapted to be worn by the user, and a control system.
Claims16
A simulation system for simulating an operation of a vehicle in a virtual environment, comprising:
- a support frame;
- an operator input control assembly coupled to the support frame for receiving input from a user, the operator input control assembly including:
- a vehicle control assembly for use in operating a simulated vehicle in the virtual environment, the vehicle control assembly configured to generate first input signals based on the user's interaction with the vehicle control assembly;
- a display device assembly configured to display the virtual environment including the simulated vehicle;
- a virtual reality (VR) headset unit adapted to be worn by the user, the VR headset unit including a VR head mounted display configured to display the virtual environment including the simulated vehicle, and position sensors configured to detect an orientation of the VR headset unit and generate second input signals based on the detected orientation of the VR headset unit;
- and
- a control system including a processor coupled to a memory device, the processor programmed to:
- generate the virtual environment including the simulated vehicle;
- operate the simulated vehicle within the virtual environment based on the first input signals received from the vehicle control assembly;
- operate the motion actuation system to adjust the orientation of the support frame with respect to the ground surface based on movements of the simulated vehicle within the virtual environment;
- render the virtual environment including the simulated vehicle on the VR head mounted display;
- and
- render the virtual environment including the simulated vehicle on the display device assembly, wherein the processor is programmed to operate in a VR display mode by:
- establishing a VR camera viewpoint location within a cab of the simulated vehicle within the virtual environment;
- rendering a VR camera viewpoint of the virtual environment on the VR head mounted display based on the VR camera viewpoint location;
- monitoring an orientation of the VR headset unit based on the second input signals received from the VR headset unit;
- and
- adjusting an orientation of the rendered VR camera viewpoint based on changes in the orientation of the VR headset unit,
- wherein the processor is programmed to operate in a non-VR display mode by:
- establishing a non-VR camera viewpoint location within the cab of the simulated vehicle within the virtual environment;
- and
- rendering a non-VR camera viewpoint of the virtual environment on the display device assembly based on the non-VR camera viewpoint location, wherein the processor is further programmed to not render the VR camera viewpoint on the VR head mounted display when operating in the non-VR camera mode and to operate in the VR mode or the non-VR mode based on the detected orientation of the VR headset unit.
A method of operating a simulation system, the simulation system including a support frame, a vehicle control assembly for use in operating a simulated vehicle in the virtual environment and configured to generate first input signals based on the user's interaction with the vehicle control assembly, a motion actuation system coupled to the support frame for adjusting an orientation of the support frame with respect to a ground surface, a display device assembly configured to display the virtual environment including the simulated vehicle, a VR headset unit adapted to be worn by the user and including a VR head mounted display and position sensors configured to detect an orientation of the VR headset unit and generate second input signals based on the detected orientation of the VR headset unit, and a control system including a processor coupled to a memory device, the method comprising the processor performing the steps of:
- generating the virtual environment including the simulated vehicle;
- operating the simulated vehicle within the virtual environment based on the first input signals received from the vehicle control assembly;
- operating the motion actuation system to adjust the orientation of the support frame with respect to the ground surface based on movements of the simulated vehicle within the virtual environment;
- rendering the virtual environment including the simulated vehicle on the VR head mounted display;
- and
- rendering the virtual environment including the simulated vehicle on the display device assembly, to processor performing the steps of operating in a VR display mode by:
- establishing a VR camera viewpoint location within a cab of the simulated vehicle within the virtual environment;
- rendering a VR camera viewpoint of the virtual environment on the VR head mounted display based on the VR camera viewpoint location;
- monitoring an orientation of the VR headset unit based on the second input signals received from the VR headset unit;
- and
- adjusting an orientation of the rendered VR camera viewpoint based on changes in the orientation of the VR headset unit,
- the processor performing the step of operating in a non-VR display mode by:
- establishing a non-VR camera viewpoint location within the cab of the simulated vehicle within the virtual environment;
- rendering a non-VR camera viewpoint of the virtual environment on the display device assembly based on the non-VR camera viewpoint location;
- and
- disabling rendering on the VR head mounted display when operating in the non-VR camera mode, wherein the processor is further programmed to not render the VR camera viewpoint on the VR head mounted display when operating in the non-VR camera mode and to operate in the VR mode or the non-VR mode based on the detected orientation of the VR headset unit.
Dependencies are inferred from the claim text.