Image stabilization for color-sequential displays

In a wearable head-mounted display (HMD), a computer-implemented method comprising:

• while displaying temporally sequential color sub-frames of a video display image on a color-sequential display (CSD) of the HMD, determining motion of an eye of a user of the HMD with respect to the CSD;
• based on the determined motion, computing an expected change in position of the eye with respect to the CSD over a time interval from a first temporally sequential color sub-frame to a second temporally sequential color sub-frame that follows the first temporally sequential color sub-frame;
• and
• based on the computed expected change in position, compensating for the determined motion of the eye by adjusting a display position on the CSD of the second temporally sequential color sub-frame with respect to a display position on the CSD of the first temporally sequential color sub-frame,
• wherein computing the expected change in position of the eye with respect to the CSD over the time interval from the first temporally sequential color sub-frame to the second temporally sequential color sub-frame based on the determined motion comprises:
• determining a location of a first point in a plane of the CSD corresponding to a first eye-gaze direction of the eye at a time of display of the first temporally sequential color sub-frame;
• and
• based on the determined location of the first point and the determined motion, making a prediction of a location of a second point in the plane of the CSD corresponding to a predicted eye-gaze of the eye at a time of display of the second temporally sequential color sub-frame, the prediction being made prior to the time of display of the second temporally sequential color sub-frame.

In a system including a color-sequential display (CSD), a computer-implemented method comprising:

• while displaying temporally sequential color sub-frames of a display image on the CSD, determining motion of an eye with respect to the CSD;
• based on the determined motion, computing an expected change in position of the eye with respect to the CSD from one temporally sequential color sub-frame to a next temporally sequential color sub-frame;
• and
• based on the computed expected change in position, adjusting a display position on the CSD of the next temporally sequential color sub-frame with respect to a display position on the CSD of the one temporally sequential color sub-frame,
• wherein computing the expected change in position of the eye with respect to the CSD from the one temporally sequential color sub-frame to the next temporally sequential color sub-frame comprises:
• determining a predicted change in angular orientation of an eye-gaze direction of the eye with respect to a plane of the CSD as a function of the determined motion over the time interval from the one temporally sequential color sub-frame to the next temporally sequential color sub-frame.

A wearable head-mounted display (HMD) comprising:

• means for determining motion of an eye of a user of the HMD with respect to a color-sequential display (CSD) of the HMD, while displaying temporally sequential color sub-frames of a video display image on the CSD;
• means for computing an expected change in position of the eye with respect to the CSD over a time interval from a first temporally sequential color sub-frame to a second temporally sequential color sub-frame that follows the first temporally sequential color sub-frame, wherein the computing is based on the determined motion;
• and
• means for using the computed expected change in position to compensate for the determined motion of the eye by adjusting a display position on the CSD of the second temporally sequential color sub-frame with respect to a display position on the CSD of the first temporally sequential color sub-frame,
• wherein the expected change in position corresponds to a change from (i) a first eye-gaze direction of the eye in a plane of the CSD at a time of the first temporally sequential color sub-frame to (ii) a second eye-gaze direction of the eye in the plane of the CSD at a time of the second temporally sequential color sub-frame,
• and wherein adjusting the display position on the CSD of the second temporally sequential color sub-frame based on the computed expected change in position comprises displaying the second temporally sequential sub-frame at a relative position with respect to the second eye-gaze direction that is substantially the same as a relative position of the first temporally sequential sub-frame with respect to the first eye-gaze direction.

A non-transitory computer-readable medium having instructions stored thereon that, upon execution by one or more processors of a wearable head-mounted display (HMD), cause the wearable HMD to carry out operations comprising:

• while displaying temporally sequential color sub-frames of a video display image on a color-sequential display (CSD) of the HMD, determining motion of an eye of a user of the HMD with respect to the CSD;
• based on the determined motion, computing an expected change in position of the eye with respect to the CSD over a time interval from a first temporally sequential color sub-frame to a second temporally sequential color sub-frame that follows the first temporally sequential color sub-frame;
• and
• based on the computed expected change in position, compensating for the determined motion of the eye by adjusting a display position on the CSD of the second temporally sequential color sub-frame with respect to a display position on the CSD of the first temporally sequential color sub-frame,
• wherein computing the expected change in position of the eye with respect to the CSD over the time interval from the first temporally sequential color sub-frame to the second temporally sequential color sub-frame based on the determined motion comprises:
• determining a location of a first point in a plane of the CSD corresponding to a first eye-gaze direction of the eye at a time of display of the first temporally sequential color sub-frame;
• and
• based on the determined location of the first point and the determined motion, making a prediction of a location of a second point in the plane of the CSD corresponding to a predicted eye-gaze of the eye at a time of display of the second temporally sequential color sub-frame, the prediction being made prior to the time of display of the second temporally sequential color sub-frame.

A non-transitory computer-readable medium having instructions stored thereon that, upon execution by one or more processors of a system, cause the system to carry out operations comprising:

• while displaying temporally sequential color sub-frames of a display image on a color-sequential display (CSD) of the system, determining motion of an eye with respect to the CSD;
• based on the determined motion, computing an expected change in position of the eye with respect to the CSD from one temporally sequential color sub-frame to a next temporally sequential color sub-frame;
• and
• based on the computed expected change in position, adjusting a display position on the CSD of the next temporally sequential color sub-frame with respect to a display position on the CSD of the one temporally sequential color sub-frame,
• wherein computing the expected change in position of the eye with respect to the CSD from the one temporally sequential color sub-frame to the next temporally sequential color sub-frame comprises:
• determining a predicted change in angular orientation of an eye-gaze direction of the eye with respect to a plane of the CSD as a function of the determined motion over the time interval from the one temporally sequential color sub-frame to the next temporally sequential color sub-frame.