Methods and devices for video rendering for video see-through (vst) augmented reality (ar)

A video see-through (VST) augmented reality (AR) device comprising:

• a plurality of cameras;
• and
• at least one processing device operably coupled to the cameras, the at least one processing device configured to:
• for each of the plurality of cameras:
• capture an image using the camera and associate the captured image with a camera pose,
• determine (i) a first contribution of the captured image for a first virtual view for display on a first display of the AR device and (ii) a second contribution of the captured image for a second virtual view for display on a second display of the AR device;
• and
• determine (i) a first confidence map for the first virtual view based on the camera pose and a position of the camera in relation to a first virtual camera and (ii) a second confidence map for the second virtual view based on the camera pose and the position of the camera in relation to a second virtual camera;
• and
• generate (i) the first virtual view by combining the first contribution using the first confidence map for each of the plurality of cameras and (ii) the second virtual view by combining the second contribution using the second confidence map for each of the plurality of cameras.

A non-transitory machine readable medium containing instructions that when executed cause at least one processor to:

• for each of a plurality of cameras of a video see-through (VST) augmented reality (AR) device:
• capture an image and associate the captured image with a camera pose,
• determine (i) a first contribution of the captured image for a first virtual view for display on a first display of the AR device and (ii) a second contribution of the captured image for a second virtual view for display on a second display of the AR device;
• and
• determine (i) a first confidence map for the first virtual view based on the camera pose and a position of the camera in relation to a first virtual camera and (ii) a second confidence map for the second virtual view based on the camera pose and the position of the camera in relation to a second virtual camera;
• and
• generate (i) the first virtual view by combining the first contribution using the first confidence map for each of the plurality of cameras and (ii) the second virtual view by combining the second contribution using the second confidence map for each of the plurality of cameras.