In-flight adaptive foveated rendering

An apparatus, comprising:

• a memory;
• and
• at least one processing unit coupled to the memory and configured to:
• receive information indicative of a fovea region;
• and
• render a frame using bin-based rendering, wherein to render the frame using bin-based rendering the at least one processing unit is configured to:
• divide the frame into a plurality of bins;
• identify, based on the information indicative of the fovea region, one or more bins of the plurality of bins as high priority bins;
• identify, based on the information indicative of the fovea region, one or more bins of the plurality of bins as low priority bins;
• and
• render the one or more high priority bins before rendering the one or more low priority bins;
• prior to rendering a low priority bin of the one or more low priority bins, determine a rendering time allotment for the frame;
• determine that the rendering time allotment for the frame will be exceeded based on an amount of time needed to render the one or more high priority bins and the one or more low priority bins;
• skip rendering of at least one of the one or more low priority bins based on the determination that the rendering time allotment for the frame will be exceeded;
• and
• display one or more previously rendered bins from a previously rendered frame in place of the skipped at least one of the one or more low priority bins.

A non-transitory computer-readable medium having code stored thereon that, when executed, causes a processing unit to:

• receive information indicative of a fovea region;
• and
• render a frame using bin-based rendering, wherein to render the frame using bin-based rendering, the processing unit is configured to:
• divide the frame into a plurality bins;
• identify, based on the information indicative of the fovea region, one or more bins of the plurality of bins as high priority bins;
• identify, based on the information indicative of the fovea region, one or more bins of the plurality of bins as low priority bins;
• render the one or more high priority bins before rendering the one or more low priority bins
• prior to rendering a low priority bin of the one or more low priority bins, determine a rendering time allotment for the frame;
• determine that the rendering time allotment for the frame will be exceeded based on an amount of time needed to render the one or more high priority bins and the one or more low priority bins;
• skip rendering of at least one of the one or more low priority bins based on the determination that the rendering time allotment for the frame will be exceeded;
• and
• display one or more previously rendered bins from a previously rendered frame in place of the skipped at least one of the one or more low priority bin.

A method comprising:

• receiving, by a processing unit, information indicative of a fovea region;
• dividing, by the processing unit, a frame into a plurality of bins;
• identifying, by the processing unit based on the information indicative of the fovea region, one or more high priority bins and one or more low priority bins of the plurality of bins;
• determining a rendering order based on the identifications of each bin of the plurality of bins;
• rendering, by the processing unit, graphical content for the frame using the plurality of bins and the rendering order
• prior to rendering a low priority bin of the one or more low priority bins, determining a rendering time allotment for the frame;
• and
• determining that the rendering time allotment for the frame will be exceeded based on an amount of time used to render the one or more high priority bins and the one or more low priority bins, wherein determining the rendering time allotment for the frame further comprises comparing a time allotment for each of the one or more low priority bins with a trigger timestamp, such that a determination that the time allotment for one of the one or more low priority bins exceeds the trigger timestamp results in an immediately following low priority bin to be rendered at the first quality.