Systems and methods to limit lag between a client and a server for remote computing
AssigneeNVIDIA Corporation
InventorFranck DIARD
Life of this patent
Estimating the term…
Abstract
Novel solutions are described herein for providing a consistent quality of service, latency-wise, for remote processing by managing the process queues in a processing server and temporarily pausing frame production and delivery to limit the lag experienced by a user in a client device. The claimed embodiments limit the latency (lag) experienced by a user by preventing the production rate of rendered frames at the server from significantly outperforming the decoding and display of the received frames in the client device and avoiding the resultant lag.
Claims22
A method comprising:
- reading, from a network input socket of a server device, a plurality of data packets from a remote client device via a network connection communicatively coupling the network input socket of the server device with the remote client device;
- rendering a plurality of images based on the plurality of data packets;
- encoding the plurality of images into a plurality of compressed video files;
- sending the plurality of compressed video files to the remote client device through the network connection;
- monitoring a second network input socket for a reception of a token from the remote client device for each of the plurality of compressed video files received by the remote client device;
- determining that a token in response to a compressed video file has not been received;
- and
- managing the reading whenever a number of compressed video files have been sent without receiving a token from the remote client device exceeds a threshold number.
A system, comprising:
- a client device;
- a display device coupled to the client device and operable to display a plurality of images from the client device;
- a user input device, coupled to the client device and operable to submit user input to the client device;
- a server, remotely positioned from client device;
- a network connection communicatively coupling the server to the client device;
- a processor, comprised in the server and operable to execute:
- a first processing thread configured to receive a plurality of data packets from the client device;
- a second processing thread configured to send a plurality of rendered images based on the plurality of data packets to the client device;
- a third processing thread configured receive a corresponding acknowledgement from the client device and to manage the first and second processing threads such that the first processing thread is prevented from receiving additional data packets from the plurality of data packets so long as a number of plurality of rendered images sent to the client device without receiving a corresponding acknowledgement packet exceeds a threshold value.
A computer readable medium containing program instructions embodied therein for causing a computing system to implement frame lag control, the program instructions comprising.
- instructions to read, from a network input socket of a server device, a plurality of data packets from a remote client device via a network connection communicatively coupling the network input socket of the server device with the remote client device;
- instructions to render a plurality of images based on the plurality of data packets;
- instructions to encode the plurality of images into a plurality of compressed video files;
- instructions to send the plurality of compressed video files to the remote client device through the network connection;
- instructions to monitor a second network input socket for a reception of a token from the remote client device for each of the plurality of compressed video files received by the remote client device;
- instructions to determine when a token in response to a compressed video file has not been received;
- and
- instructions to manage the reading whenever a number of compressed video files have been sent without receiving a token from the remote client device exceeds a threshold number.
A method comprising:
- receiving, in a client device, a compressed video file;
- decoding the compressed video file into a decoded video file;
- converting the decoded video file into a color space;
- generating a bitmap for the color space;
- displaying the bitmap in a display device communicatively coupled to the client device;
- and
- sending a token to a remote server, the token being sent through a network socket communicatively coupling the remote server with the client device.
Dependencies are inferred from the claim text.