Presentation of enhanced communication between remote participants using augmented and virtual reality

A non-transitory computer readable storage medium having instructions stored thereon for presenting a conference session established by a conferencing system to facilitate a meeting between remote participants that each use Augmented Reality (AR) or Virtual Reality (VR) to participate in the meeting, the instructions, when executed by a head mounted display (HMD) worn by a first participant of the remote participants, direct the HMD to:

• during the conference session, compile view information used to determine a first view seen by the first participant located at a meeting location, wherein the first view includes what the first participant sees of the meeting location through transparent lenses of the HMD;
• receive, via a communication interface of the HMD, a conference video stream comprising at least video captured of a second participant, of the remote participants, remote to the meeting location;
• and
• present the video captured of the second participant on the transparent lenses such that the second participant appears at a first position of the meeting location in the first view to the first participant to appear as though the second participant is physically at the meeting location with the first participant.