Dead reckoning and latency improvement in 3D game streaming scenario

A method for playing a streaming video game on a computer device, comprising:

• transmitting video game control commands to a streaming server;
• receiving, from the streaming server, a video stream encoding video images generated in response to the video game control commands;
• determining an image transformation based on at least a history of the video images and motion vectors for the video stream;
• applying the image transformation to at least a portion of one or more images corresponding to one or more previous frames to generate a substitute video image including at least a portion of a transformed previously displayed image prior to a designated time when a subsequent frame for the video stream is scheduled to arrive;
• determining that a video image of the video stream to display in the subsequent frame has not been completely received at the designated time;
• and
• displaying the substitute video image in the subsequent frame including at least the portion of the transformed previously displayed image instead of the video image of the video stream in response to the determination that the video image to display in the subsequent frame was not completely received at the designated time.

A computer-readable medium, comprising code executable by one or more processors for playing a streaming video game on a computing device, the code comprising code for:

• transmitting video game control commands to a streaming server;
• receiving, from the streaming server, a video stream encoding video images generated in response to the video game control commands;
• determining an image reprojection based on one or more images of the video stream corresponding to one or more previous frames and motion vectors selecting based on a camera transformation matrix for the one or more previous frames;
• applying the image reprojection to at least a portion of the one or more images of the video stream corresponding to one or more previous frames to generate a substitute video image including at least a portion of a reprojected image prior to a designated time when a subsequent frame for the video stream is scheduled to arrive;
• determining that a video image of the video stream to display in the subsequent frame has not been completely received at the designated time;
• and
• displaying the substitute video image in the subsequent frame including at least the portion of the reprojected image instead of the video image of the video stream in response to the determination that the video image to display in the subsequent frame was not completely received at the designated time.