Remote operations of a vehicles
AssigneeNVIDIA Corporation
InventorsJen-Hsun Huang, Prajakta Gudadhe, Justin Ebert, Dane Johnston
Life of this patent
Estimating the term…
Abstract
In various examples, at least partial control of a vehicle may be transferred to a control system remote from the vehicle. Sensor data may be received from a sensor(s) of the vehicle and the sensor data may be encoded to generate encoded sensor data. The encoded sensor data may be transmitted to the control system for display on a virtual reality headset of the control system. Control data may be received by the vehicle and from the control system that may be representative of a control input(s) from the control system, and actuation by an actuation component(s) of the vehicle may be caused based on the control input.
Claims20
A method comprising:
- receiving, at a remote control system, sensor data representative of one or more fields of view of one or more sensors of an aerial vehicle as the aerial vehicle operates in an environment;
- causing generation, at the remote control system, of an immersive virtual environment based at least in part on the sensor data, the immersive virtual environment including a virtual representation of the aerial vehicle within a virtual representation of at least a portion of the environment;
- receiving, at the remote control system, control inputs from a remote operator interacting with the immersive virtual environment, the control inputs representing at least one suggested motion for the aerial vehicle;
- sending, from the remote control system to the aerial vehicle, data representing the at least one suggested motion;
- determining, at the aerial vehicle and based at least in part on the data representing the at least one suggested motion, a trajectory in a three-dimensional space of the environment;
- and
- causing the aerial vehicle to move along the trajectory.
A system comprising:
- one or more processors comprising processing circuitry to perform operations comprising:
- receiving, at a remote control system, sensor data representative of one or more fields of view of one or more sensors of an aerial vehicle as the aerial vehicle operates in an environment;
- causing presentation, at the remote control system, of a virtual environment based at least in part on the sensor data, the virtual environment including a virtual representation of the aerial vehicle within a virtual representation of at least a portion of the environment;
- receiving, at the remote control system, control inputs from a remote operator interacting with the virtual environment, the control inputs representing at least one semi-autonomous control command for the aerial vehicle;
- sending, from the remote control system to the aerial vehicle, data representing the at least one semi-autonomous control command;
- and
- controlling, at the aerial vehicle, a drive stack that determines one or more controls based at least in part on the at least one semi-autonomous control command and causes the aerial vehicle to move in the environment based at least in part on the one or more controls.
One or more processors comprising processing circuitry to perform operations comprising:
- receiving sensor data representative of one or more fields of view of one or more sensors of an aerial vehicle as the aerial vehicle operates in an environment;
- receiving sensor data representative of one or more fields of view of one or more sensors of an aerial vehicle as the aerial vehicle operates in an environment;
- receiving control inputs from a remote operator interacting with the immersive virtual environment, the control inputs representing at least one suggested motion for the aerial vehicle;
- and
- sending, to the aerial vehicle, data representing the at least one suggested motion for use by the aerial vehicle in determining a trajectory in a three-dimensional space of the environment and moving along the trajectory.
Dependencies are inferred from the claim text.