Highly interactive online multiplayer video games

A non-transitory computer-readable storage medium storing instructions, which when executed by a processing device, cause the processing device to perform a method for latency compensation during play of a video game over a network, the video game being played in real-time at least by a first player using a first game device and a second player using a second game device, wherein both the first player and the second player are human players, the method comprising:

• receiving, by a first estimator, data values characterizing delayed states of the second game device and the second player via the network;
• estimating, by the first estimator based on the received data values, a latency-compensated state of a second game object using a simulation model of the second game object and a behavior model of the second player, wherein the second game object is controlled by the second player using the second game device, wherein the behavior model provides a representation of how the second player interacts with the video game relative to the first player;
• and
• displaying the second game object on a display of the first game device based on the latency-compensated state of the second game object to enable the first player to interact with the video game with compensated latency.

A game device that performs latency compensation during play of a video game over a network, the video game being played in real-time at least by a first player using the game device and a second player using a second game device, wherein both the first player and the second player are human players, the game device comprising:

• memory;
• a display;
• and
• one or more processors coupled to the memory and the display, the one or more processors adapted to execute operations of a first estimator to perform the following:
• receive data values characterizing delayed states of the second game device and the second player via the network;
• estimate, based on the received data values, a latency-compensated state of a second game object using a simulation model of the second game object and a behavior model of the second player, wherein the second game object is controlled by the second player using the second game device, wherein the behavior model provides a representation of how the second player interacts with the video game relative to the first player;
• and
• display the second game object on the display based on the latency-compensated state of the second game object to enable the first player to interact with the video game with compensated latency.