Ultra-low latency remote application access

An ultra-low latency server system comprising:

• a processor;
• a first network connection;
• and
• a remote browser of a remote service capable of execution on the processor, wherein the remote service causes the processor to:
• receive a rendered image of an application executing on the processor, the rendered image comprising a plurality of frames;
• generate a video stream from the rendered image using video compression and encoding techniques that use data from one or more frames to compress information in later frames, whereby latency is introduced into the system, the video compression and encoding techniques having a configuration setting that facilitate adjusting the encoding technique;
• transmit the video stream over the first network connection to the remote browser, wherein the remote service is an ultra-low latency remote service;
• wherein the ultra-low latency server system is configured to establish the first network connection by receiving a connection request from a client device comprising the remote browser having a JavaScript engine, and transmitting connection instructions to the remote browser, wherein the connection instructions comprise a hyper-text markup language (HTML) page and executable JavaScript;
• wherein embedding the executable JavaScript in the HTML page permits the remote browser on any client device to execute the application of the processor without creating, supporting, and downloading native applications that would be specific to each hardware and software platform of any client device;
• wherein the video compression and encoding techniques are tuned to minimize buffering by using a minimum number of the plurality of frames during a compression process to reduce the latency in the system;
• wherein the connection instructions further comprise executable code that, when executed, captures at least a portion of cursor information within the remote browser, receives the cursor information from the remote browser;
• and transmits the cursor information to the application;
• whereby, in use, a user of the remote browser experiences real-time or near real-time control of the application executing on the processor of the ultra-low latency server system.

A method performed on at least one processor of an ultra-low latency server system, said method comprising:

• receiving a rendered image of an application, the rendered image comprising a plurality of frames;
• generating a video stream from the rendered image using video compression and encoding techniques that use data from one or more frames to compress information in later frames, whereby latency is introduced into the system, the video compression and encoding techniques having configuration settings that may permit adjusting the video compression and encoding techniques;
• transmitting the video stream over a first network connection to a remote browser;
• wherein the ultra-low latency server system is configured to establish the first network connection by receiving a connection request from a client device comprising the remote browser having a JavaScript engine, and transmitting connection instructions to the remote browser, wherein said connection instructions comprise a hyper-text markup language (HTML) page and executable JavaScript, wherein embedding the executable JavaScript in the HTML page permits the remote browser on any client device to execute the application without creating, supporting, and downloading native applications that would be specific to each hardware and software platform of any client device;
• wherein in the video compression and encoding techniques are tuned to minimize buffering by using a minimum number of the plurality of frames during a compression process to reduce the latency in the system,
• wherein connection instructions further comprising executable code, said executable code that, when executed, captures at least a portion of said cursor information within said remote browser, receiving cursor information from said remote browser;
• and
• transmitting said cursor information to said application

A non-transitory computer readable medium, comprising instructions that, when executed by a processor, cause the processor of an ultra-low latency server system to perform operations, comprising:

• receiving a rendered image of an application executing on the processor, the rendered image comprising a plurality of frames;
• generating a video stream from the rendered image using video compression and encoding techniques that use data from one or more frames to compress information in later frames, whereby latency is introduced into the system, the video compression and encoding techniques having a configuration setting that facilitate adjusting the encoding technique;
• transmitting the video stream over a first network connection to a remote browser;
• wherein the ultra-low latency server system is configured to establish the first network connection by receiving a connection request from a client device comprising the remote browser having a JavaScript engine, and transmitting connection instructions to the remote browser, wherein the connection instructions comprise a hyper-text markup language (HTML) page and executable JavaScript;
• wherein embedding the executable JavaScript in the HTML page permits the remote browser on any client device to execute the application of the processor without creating, supporting, and downloading native applications that would be specific to each hardware and software platform of any client device;
• wherein the video compression and encoding techniques are tuned to minimize buffering by using a minimum number of the plurality of frames during a compression process to reduce the latency in the system;
• wherein the connection instructions further comprise executable code that, when executed, captures at least a portion of cursor information within the remote browser, receives the cursor information from the remote browser;
• and transmits the cursor information to the application;
• whereby, in use, a user of the remote browser experiences real-time or near real-time control of the application executing on the processor of the ultra-low latency server system.