Warping for spatial light modulating displays using eye tracking

A system comprising:

• one or more processors configured to execute instructions to:
• obtain a first image frame having a set of color fields, wherein the first image frame corresponds to a first view perspective associated with a first position of pupils of a viewer;
• determine a second position of the pupils of the viewer;
• generate, based on the first image frame, a second image frame corresponding to a second view perspective associated with the second position of the pupils of the viewer, the generating comprising:
• calculate an eye velocity as a function of the first position of the pupils, the second position of the pupils and a time elapsed for the pupils of the viewer to get from the first position to the second position,
• calculate a shift value based on the eye velocity, and
• shift one or more color fields of the set of color fields by the shift value;
• and
• transmit the second image frame to a near-eye display device;
• and
• a display device configured to:
• display the second image frame, wherein all six color fields of the second image frame are displayed on a same spot relative to the second position of the pupils of the viewer.

A non-transitory computer-readable medium having stored thereon a sequence of instructions which, when executed by one or more processors, causes the processors to execute a method for transforming an image frame based on a position of pupils of a viewer, the method comprising:

• obtaining a first image frame having a set of color fields, wherein the first image frame corresponds to a first view perspective associated with a first position of the pupils of the viewer;
• determining a second position of the pupils of the viewer;
• generating, based on the first image frame, a second image frame corresponding to a second view perspective associated with the second position of the pupils of the viewer, the generating comprising:
• calculating an eye velocity as a function of the first position of the pupils, the second position of the pupils and a time elapsed for the pupils of the viewer to get from the first position to the second position,
• calculating a shift value based on the eye velocity, and
• shifting one or more color fields of the set of color fields by the shift value;
• and
• transmitting the second image frame to a near-eye display device to be displayed on the near-eye display device, wherein all six color fields of the second image frame are displayed on a same spot relative to the second position of the pupils of the viewer.