Wide baseline stereo for low-latency rendering

A virtual image generation system for use by an end user having an inter-ocular distance, comprising:

• memory storing a three-dimensional scene;
• a control subsystem configured for rendering a left synthetic image and a right synthetic image of the three-dimensional scene respectively from a first left focal center and a first right focal center relative to a first head pose of the end user, the first left and first right focal centers being spaced from each other a distance greater than the inter-ocular distance of the end user, the control subsystem further configured for warping the left synthetic image and the right synthetic image respectively to a second left focal center and a second right focal center relative to a second head pose different from the first head pose, the second left and right focal centers spaced from each other a distance equal to the inter-ocular distance of the end user, the control subsystem further configured for constructing a frame from the left and right warped synthetic images;
• and
• a display system configured for displaying the frame to the end user.