# US 11,027,198 B2 · Systems and methods of serving game video for remote play

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,027,198 B2
- Document ID: US11027198B2
- Status: Granted
- Kind: B2
- Application number: 16/399,966
- Filed: 2019-04-30
- Published: 2019-08-22
- Granted: 2021-06-08
- Earliest claimed: 2007-12-15
- Assignees: Sony Interactive Entertainment Inc.
- Applicants: Sony Interactive Entertainment LLC
- Inventors: David Perry; Rui Filipe Andrade Pereira
- Web page: https://patentgrep.com/patent/US11027198B2

## CPC

- A63F 13/355: Performing operations on behalf of clients with restricted processing capabilities, e.g. servers transform changing game scene into an encoded video stream for transmitting to a mobile phone or a thin client
- A63F 13/30: Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
- A63F 13/358: Adapting the game course according to the network or server load, e.g. for reducing latency due to different connection speeds between clients
- A63F 13/70: Game security or game management aspects
- A63F 13/77: involving data related to game devices or game servers, e.g. configuration data, software version or amount of memory
- A63F 2300/534: for network load management, e.g. bandwidth optimization, latency reduction
- A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR

## Abstract

Methods and systems are provided for executing video games by a gaming computer and enabling remote play. In example, a method includes receiving a command from a first player via a first client and a computing network. The method updates a game state of a video game based on the command received from the first player and receiving a first point of view of the first player via the computing network. The method communicates at least part of the game state to a first image generator executed by the gaming computer and sends via the computing network to the first client a first image based on the game state and the first point of view using the first image generator. The first image is configured for rendering by the first client. The first image is a video image of a plurality of video images presented to the first client, which is accessing the gaming computer for remote play.

## Claims

### Claim 1

A method executed on gaming system, comprising:
receiving a connection request from a remote client to access a player interface of the game system, the connection request being received via a computing network;
receiving a command for a video game from the remote client via the player interface executed by the gaming system, the command being received via the computing network;
executing the game based at least in part on the received command; and
sending compressed images from the gaming system via the computing network to the remote client, wherein the compressed images include partially rendered images that require additional rendering by the remote client;
the compressed images configured to be decompressed by the remote client; and
the remote client is configured to perform additional rendering for display of the decompressed images at the remote client;
wherein said partially rendered images require further textures to be added by the remote client during said additional rendering.

### Claim 2 (depends on 1)

The method of claim 1, wherein said further textures to be added are associated to a game environment of the video game.

### Claim 3 (depends on 2)

The method of claim 2, wherein identifying said further textures to be added is based on a point of view of a player playing the video game and images viewable from said point of view.

### Claim 4 (depends on 1)

The method of claim 1, wherein identifying said further textures to be added is based on characteristics of objects in a scene of the video game.

### Claim 5 (depends on 1)

The method of claim 1, wherein requiring further textures to be added by the remote client during said additional rendering increases efficiency of compression of said compressed images at said gaming system.

### Claim 6 (depends on 1)

The method of claim 1, wherein said textures are added to surfaces of a scene viewable when playing the video game.

### Claim 7 (depends on 6)

The method of claim 6, wherein said surfaces include character surfaces and object surfaces in the scene.

### Claim 8 (depends on 6)

The method of claim 6, wherein said textures include data related to one or more of a color, or a pixel pattern, or an image, or a transparency, or combinations of two or more thereof.

### Claim 9 (depends on 8)

The method of claim 8, wherein said textures are associated with two and/or three dimensional objects in the scene viewable when playing the video game.

### Claim 10 (depends on 1)

The method of claim 1, wherein the compressed images are compressed video frames.

### Claim 11 (depends on 10)

The method of claim 10, wherein the compressed images are generated using an encoder that encodes images using one of Adobe Flash® standard, or .wav, or .mpg, or H.264, or H.263, or On2, or VP6, or VC-1, or WMA, or Huffyuv, or Lagarith, or MPG-x., or Xvid., or FFmpeg, or x264, or VP6-8, or realvideo, or mp3.

### Claim 12 (depends on 11)

The method of claim 11, wherein the remote client uses a decoder that corresponds to an encoder used for the compressing of images.

### Claim 13 (depends on 1)

The method of claim 1, wherein the partial rendering is carried out at least in part by a graphics processing unit (GPU) of the gaming system.

### Claim 14 (depends on 1)

The method of claim 1, wherein an amount of said partial rendering is based in part on a determined capability of the remote client.

### Claim 15 (depends on 1)

The method of claim 1, wherein the partial rendering is carried out at least in part by a graphics processing unit (GPU) of the gaming system.
