Extended reality systems for visualizing and controlling operating room equipment

A method by a camera tracking system, the method comprising:

• receiving patient reference tracking information indicating pose of a patient reference array tracked by a patient tracking camera relative to a patient reference frame;
• determining a local extended reality (XR) headset view pose transform between a local XR headset reference frame of a local XR headset and the patient reference frame using the patient reference tracking information;
• receiving remote reference tracking information indicating pose of a remote reference array tracked by a remote reference tracking camera;
• determining a remote XR headset view pose transform between a remote XR headset reference frame of a remote XR headset and the remote reference array using the remote reference tracking information;
• transforming a three-dimensional (3D) computer image from a local pose determined using the local XR headset view pose transform to a remote pose determined using the remote XR headset view pose transform which outputs a transformed 3D computer image;
• and
• providing the transformed 3D computer image to the remote XR headset for display with the remote pose relative to the remote XR headset reference frame.