Enhancements to beyond-visual-line-of-sight (BVLOS) operation of remote-controlled apparatuses

A ground control station (GCS) system for beyond-visual-line-of-sight operation of a drone vehicle, the GCS system comprising:

• at least one processor;
• and
• at least one memory storing instructions that, when executed by the at least one processor, cause the GCS system to:
• subsequent to indicating a display field-of-view (FOV) associated with an extended reality (XR) display device associated with the drone vehicle, configure a drone vehicle to capture a video stream with a reduced field-of-view (FOV) that is less than the display FOV, according to a constraint associated with a 5G telecommunication network coupling the GCS system with the drone vehicle;
• receive, via the 5G telecommunication network, local sensor data collected at the drone vehicle, the local sensor data including:
• (i) the video stream with the reduced FOV that is collected by one or more onboard camera devices of the drone vehicle, and (ii) sensor data for geolocations of the drone vehicle at which the video stream is collected;
• map a real-world location of the drone vehicle to a virtual location within an extended reality (XR) environment using the geolocation of the drone vehicle and an identification of corresponding objects captured in the video stream and represented in the XR environment,
• wherein the XR environment is a virtual reconstruction of a real-world geographic area in which the drone vehicle is located;
• obtain, via an XR engine that provides the XR environment, XR visual data that corresponds to a perspective from the virtual location within the XR environment and to a supplemental FOV not included in the reduced FOV for the video stream captured by the drone vehicle,
• wherein the XR visual data includes at least one virtual object that does not exist in the real-world geographic area;
• generate drone perspective visual data that combines the video stream having the reduced FOV with the XR visual data having the supplemental FOV;
• and
• provide the drone perspective visual data for display via an extended reality (XR) display device in communication with the GCS system.