Techniques For Remotely Modifying Video Data Quality To Optimize Streaming In Surgical Extended Reality

A connectivity system for use with a surgical system, the surgical system comprises a surgical device that includes a video source to generate video data including surgical content, a head-mounted device (HMD) with an HMD controller and an HMD display positionable in front of a user's eyes, the connectivity system comprising:

• a housing located remote from the HMD;
• a controller disposed within the housing and being configured to:
• receive the video data from the video source;
• wirelessly transmit the video data to the HMD controller for presentation, on the HMD display, of a virtual window containing the video data;
• wirelessly receive spatial information from the HMD controller, the spatial information related to one or both of:
• the virtual window relative to a field-of-view of the HMD display;
• and a gaze of the user relative to the virtual window;
• dynamically modify at least one quality parameter of the video data based on the spatial information to generate modified video data;
• and
• wirelessly transmit the modified video data to the HMD controller for presentation on the HMD display.

A head-mounted device (HMD) for use with a surgical system, the surgical system comprises a surgical device that includes a video source to generate video data including surgical content, and a connectivity system in communication with the video source, the HMD comprising:

• a structure to be worn on the head of a user;
• an HMD display supported by the structure and positionable in front of a user's eyes;
• and
• an HMD controller being configured to:
• wirelessly communicate with the connectivity system to receive the video data;
• present, on the HMD display, a virtual window containing the video data;
• acquire spatial information related to one or both of:
• the virtual window relative to a field-of-view of the HMD display;
• and a gaze of the user relative to the virtual window;
• wirelessly transmit the spatial information to the connectivity system;
• wirelessly receive modified video data from the connectivity system, the modified video data having been altered by connectivity system through dynamic modification of at least one quality parameter of the video data based on the spatial information;
• and
• present the modified video data on the HMD display.