Late warping to minimize latency of moving objects

A computing apparatus comprising:

• a processor;
• and
• a memory storing instructions that, when executed by the processor, configure the apparatus to perform operations comprising:
• rendering a first layer of virtual content based on a first pose of a visual tracking device and a first location of a first object depicted in a first image generated by an optical sensor of the visual tracking device;
• rendering a second layer of virtual content based on the first pose of the visual tracking device and a first location of a second object depicted in the first image;
• accessing a second pose of the visual tracking device;
• determining a second location of the first object in a second image that corresponds to the second pose;
• determining a second location of the second object in the second image;
• applying a first time warp transformation to the first layer based on a combination of the second pose and the second location of the first object;
• applying a second time warp transformation to the second layer based on a combination of the second pose and the second location of the second object;
• and
• generating transformed virtual content by combining the first layer and the second layer in a single rendered frame.

A non-transitory computer-readable storage medium, the computer-readable storage medium including instructions that when executed by a computer, cause the computer to perform operations comprising:

• rendering a first layer of virtual content based on a first pose of a visual tracking device and a first location of a first object depicted in a first image generated by an optical sensor of the visual tracking device;
• rendering a second layer of virtual content based on the first pose of the visual tracking device and a first location of a second object depicted in the first image;
• accessing a second pose of the visual tracking device;
• determining a second location of the first object in a second image that corresponds to the second pose;
• determining a second location of the second object in the second image;
• applying a first time warp transformation to the first layer based on a combination of the second pose and the second location of the first object;
• applying a second time warp transformation to the second layer based on a combination of the second pose and the second location of the second object;
• and
• generating transformed virtual content by combining the first layer and the second layer in a single rendered frame.