Fixed photon-to-photon programmable display pipeline

A system comprising:

• one or more processors and program instructions that, when executed on the one or more processors, cause the one or more processors to perform operations comprising:
• obtaining image data comprising frames of images sequentially captured by an image capture device on the electronic device in a physical environment;
• producing blended frames by sequentially processing segments of the frames via a programmable element, each of the segments comprising less than an entire frame of the frames, the programable element comprising a non-fixed instruction set, wherein the processing comprises performing one or more visual effects on the segments and blending the segments with rendered content, wherein the segments are modified with the one or more visual effects and blended with the rendered content in stages that are performed according to timing constraints associated with display of individual blended frames;
• and
• displaying the blended frames.

A non-transitory computer-readable storage medium storing program instructions executable via one or more processors to perform the operations comprising:

• obtaining image data comprising frames of images sequentially captured by an image capture device on the electronic device in a physical environment;
• producing blended frames by sequentially processing segments of the frames via a programmable element, each of the segments comprising less than an entire frame of the frames, the programable element comprising a non-fixed instruction set, wherein the processing comprises performing one or more visual effects on the segments and blending the segments with rendered content, wherein the segments are modified with the one or more visual effects and blended with the rendered content in stages that are performed according to timing constraints associated with display of individual blended frames;
• and
• displaying the blended frames.