US 10,589,171 B1 · User interface rendering and post processing during video game streaming

Abstract

Systems and methods for conservation of bandwidth and improved user experience via enhanced streaming of video games. An example method includes receiving a request to remotely play a video game, the video game being executed by the system and streamed to a user device for presentation. The video game is executed, and rendered image frames are generated. Geometry data associated with the rendered image frames is generated, with the geometry data representing locations of geometric elements that form geometry utilized, by the video game, to generate the rendered image frames. The rendered image frames are encoded into a gameplay stream. A first stream comprising the encoded gameplay stream and a second stream comprising the geometry data are provided to the user device. The user device is configured to perform post-processing effects on the rendered image frames encoded in the gameplay stream prior to display on the user device.

Claims20

Dependent claims

A computer-implemented method for increasing visual fidelity of streamed information, the method comprising:

under control of one or more hardware computing devices configured with specific computer-executable instructions, the specific computer-executable instructions stored in an electronic hardware memory,
receiving, from a remote user device over a network, a request to play a video game on the remote user device;
executing the video game, wherein the video game is executed by the one or more hardware computing devices and provided to the user device for display;
receiving, from the user device, user input configured to control operation of one or more virtual entities within the video game;
generating rendered image frames during execution of the video game based at least in part on the user input received from the user device;
encoding the rendered image frames into a gameplay stream, wherein first elements included in each rendered image frame are encoded at a first quality and wherein second elements included in the rendered image frame are encoded at a second quality;
and
providing, to the user device over the network, the encoded gameplay stream for presentation, wherein the encoded gameplay stream is configured to be output as a series of rendered image frames on the user device.

5 more elements

Non-transitory computer storage media storing instructions that when executed by a system of one or more computers, cause the one or more computers to perform operations comprising:

receiving, from a remote user device over a network, a request to play a video game on the remote user device;
executing the video game, wherein the video game is executed by the system and provided to the user device for display;
receiving, from the user device, user input configured to control operation of one or more virtual entities within the video game;
generating rendered image frames during execution of the video game based at least in part on the user input received from the user device;
encoding the rendered image frames into a gameplay stream, wherein first elements included in each rendered image frame are encoded at a first quality and wherein second elements included in the rendered image frame are encoded at a second quality;
and
providing, to the user device over the network, the encoded gameplay stream for presentation, wherein the encoded gameplay stream is configured to be output as a series of rendered image frames on the user device.

4 more elements

A system comprising one or more computers and computer storage media storing instructions that when executed by the one or more computers, cause the one or more computers to perform operations comprising:

receiving, from a remote user device over a network, a request to play a video game on the remote user device;
executing the video game, wherein the video game is executed by the system and provided to the user device for display;
receiving, from the user device, user input configured to control operation of one or more virtual entities within the video game;
generating rendered image frames during execution of the video game based at least in part on the user input received from the user device;
encoding the rendered image frames into a gameplay stream, wherein first elements included in each rendered image frame are encoded at a first quality and wherein second elements included in the rendered image frame are encoded at a second quality;
and
providing, to the user device over the network, the encoded gameplay stream for presentation, wherein the encoded gameplay stream is configured to be output as a series of rendered image frames on the user device.

4 more elements

Dependencies are inferred from the claim text.

User interface rendering and post processing during video game streaming

Life of this patent

User interface rendering and post processing during video game streaming

Life of this patent

Abstract

Claims20