Mixed reality system with multi-source virtual content compositing and method of generating virtual content using same

A system for warping virtual content, comprising:

• a warping unit to receive first and second virtual content generated based on first and second poses of a display device;
• and
• a com positing unit operatively coupled to the warping unit,
• wherein the system processes the first and second virtual content in a single pass in a single pipeline including
• the warping unit selecting a first pixel of the first virtual content to correspond to an output pixel location,
• the warping unit warping the first pixel of the first virtual content based on the third pose of the display device to generate a first warped pixel,
• the warping unit selecting a second pixel of the second virtual content to correspond to the output pixel location,
• the warping unit warping the second pixel of the second virtual content based on the third pose of the display device to generate a second warped pixel, and
• the corn positing unit comparing a first depth of the first warped pixel and a second depth of the second warped pixel to identify a display pixel at the output pixel location.

A computer program product embodied in a non-transitory computer readable medium, the computer readable medium having stored thereon a sequence of instructions which, when executed by a processor causes the processor to execute a method for warping virtual content, the method comprising:

• a compositor processing first and second virtual content in a single pass in a single pipeline,
• wherein the first and second virtual content are based on respective first and second poses, and
• wherein processing the first and second virtual content includes
• the compositor selecting a first pixel of the first virtual content to correspond to an output pixel location,
• the compositor warping the first pixel of the first virtual content based on a third pose of the display system to generate a first warped pixel,
• the compositor selecting a second pixel of the second virtual content to correspond to the output pixel location,
• the compositor warping the second pixel of the second virtual content based on the third pose of the display system to generate a second warped pixel, and
• the compositor comparing a first depth of the first warped pixel and a second depth of the second warped pixel to identify a display pixel at the output pixel location.