# US 2025/0144515 A1 · Resolution-based scaling of real-time interactive graphics

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0144515 A1
- Document ID: US20250144515A1
- Status: Published application
- Kind: A1
- Application number: 19/014,908
- Filed: 2025-01-09
- Published: 2025-05-08
- Earliest claimed: 2018-04-02
- Assignees: Google Inc.
- Applicants: Google LLC
- Inventors: Dov Zimring; Paul Leventis; Benjamin Frenkel; Matthew Rodgers; Clinton Smullen; Robert McCool
- Web page: https://patentgrep.com/patent/US20250144515A1

## CPC

- A63F 13/355: Performing operations on behalf of clients with restricted processing capabilities, e.g. servers transform changing game scene into an encoded video stream for transmitting to a mobile phone or a thin client
- A63F 13/358: Adapting the game course according to the network or server load, e.g. for reducing latency due to different connection speeds between clients
- A63F 13/323: between game devices with different hardware characteristics, e.g. hand-held game devices connectable to game consoles or arcade machines
- A63F 13/335: using Internet
- A63F 13/40: Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment
- G06F 9/45558: {Hypervisor-specific management and integration aspects}
- A63F 2300/534: for network load management, e.g. bandwidth optimization, latency reduction
- A63F 2300/535: for monitoring, e.g. of user parameters, terminal parameters, application parameters, network parameters
- A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

An electronic server receives a request from a client device to establish a real-time interactive session, determines a device capability of an output device associated with the client device, determines a connection capability of the network connection, determines one or more target quality parameters for the real-time interactive session based on the device capability and the connection capability, selects a first virtual machine of the plurality of virtual machines based on the one or more target quality parameters, establishes the real-time interactive session with the client device, and provides to the real-time interactive session, in accordance with the resource profile of the first virtual machine, resources for processing inputs from the client device and generating outputs in accordance with the processed inputs within the real-time interactive session.

## Claims

### Claim at position 1

1-15. (canceled)

### Claim 16

A method, comprising:
receiving a first command from a first device;
determining a first expected response latency associated with the first command;
generating a first number of intermediate frames based on a frame rate and based on a comparison of a determined network latency with the first expected response latency;
generating a first response frame reflecting an initial result of the first command; and
transmitting, at the frame rate, the first number of intermediate frames and the first response frame such that the first response frame is estimated to be received by the first device at a time corresponding to the first expected response latency.

### Claim 17 (depends on 16)

The method of claim 16, further comprising:
determining the frame rate according to a network characteristic of an online session associated with the first device; and
maintaining the frame rate upon determining a subsequent network latency different from the determined network latency.

### Claim 18 (depends on 16)

The method of claim 16, further comprising:
updating a subsequent application state in accordance with the first command, wherein the subsequent application state is initially reflected in the first response frame.

### Claim 19 (depends on 16)

The method of claim 16, wherein the method is performed at a server, wherein the first device is a first client device to which the server transmits the first number of intermediate frames and the first response frame, and wherein the method further comprises:
determining a projected arrival time of a response frame at the first client device based on the determined network latency;
determining a target arrival time of a response frame at the first client device based on the expected response latency;
comparing the projected arrival time with the target arrival time to obtain a delta time; and
determining the first number of intermediate frames based on multiplying the delta time by the frame rate.

### Claim 20 (depends on 19)

The method of claim 19, further comprising determining the network latency based at least in part on (i) a round trip communication latency between the first client device and the server, and/or (ii) a round trip communication latency between the server and a media device associated with the first client device.

### Claim 21 (depends on 19)

The method of claim 19, further comprising determining the network latency, wherein determining the network latency comprises determining (i) a one-way communication latency between the first client device and the server, and/or (ii) a one-way communication latency between the server and a media device associated with the first client device.

### Claim 22 (depends on 19)

The method of claim 19, further comprising:
receiving a second command from the first client device, a type of the second command being different from the type of the first command;
determining a second expected response latency associated with the type of the second command, wherein the second expected response latency is different from the first expected response latency;
determining an updated network latency;
generating a second number of intermediate frames based on the frame rate and on a comparison of the updated network latency with the second expected response latency;
generating a second response frame reflecting an initial result of the second command; and
transmitting, at the frame rate, the second number of intermediate frames followed by the second response frame such that the second response frame is received by the first client device at a time corresponding to the second expected response latency.

### Claim 23 (depends on 16)

The method of claim 16, further comprising:
determining a first introduced latency based on a comparison of the determined network latency with the first expected response latency; and
determining the first number of intermediate frames, wherein determining the first number of intermediate frames comprises multiplying the first introduced latency by the frame rate.

### Claim 24 (depends on 16)

The method of claim 16, further comprising determining a processing latency associated with performing the first command, wherein generating the first number of intermediate frames is further based on the processing latency.

### Claim 25 (depends on 16)

The method of claim 16, wherein the method is performed by a server for each of multiple client devices that are each associated with a respective response latency and that each provide a respective command having a respective expected response latency, and wherein the method comprises determining a respective number of intermediate frames to transmit to each client device of the multiple client devices.

### Claim 26

A computing system, comprising:
one or more processors; and
memory storing one or more programs for execution by the one or more processors, the one or more programs comprising instructions that, when executed by the one or more processors, manipulate the one or more processors to:
receive a first command from a first device;
determine a first expected response latency associated with the first command;
generate a first number of intermediate frames based on a frame rate and on a comparison of a determined network latency with the first expected response latency;
generate a first response frame reflecting an initial result of the first command; and
transmit, at the frame rate, the first number of intermediate frames and the first response frame such that the first response frame is estimated to be received by the first device at a time corresponding to the first expected response latency.

### Claim 27 (depends on 26)

The computing system of claim 26, wherein the instructions further manipulate the one or more processors to:
determine a first introduced latency based on a comparison of the determined network latency with the first expected response latency; and
determine the first number of intermediate frames, wherein to determine the first number of intermediate frames comprises multiplying the introduced latency by the frame rate.

### Claim 28 (depends on 26)

The computing system of claim 26, wherein the instructions further manipulate the one or more processors to determine a processing latency associated with performing the first command, wherein to generate the first number of intermediate frames is further based on the processing latency.

### Claim 29 (depends on 26)

The computing system of claim 26, wherein the first device is a first client device to which the computing system transmits the first number of intermediate frames and the first response frame, and wherein the instructions further manipulate the one or more processors to determine the network latency based at least in part on (i) a round trip communication latency between the first client device and the computing system, and/or (ii) a round trip communication latency between the computing system and a media device associated with the first client device.

### Claim 30

A non-transitory computer-readable storage medium storing one or more programs, the one or more programs comprising instructions, which, when executed by a computing device with one or more processors, cause the computing device to:
determine a first expected response latency associated with a first command;
generate a first number of intermediate frames based on a frame rate and on a comparison of a determined network latency with the first expected response latency;
generate a first response frame reflecting an initial result of the first command; and
transmit, at the frame rate, the first number of intermediate frames and the first response frame such that the first response frame is estimated to be received at a time corresponding to the first expected response latency.

### Claim 31 (depends on 30)

The non-transitory computer-readable storage medium of claim 30, wherein the instructions further cause the computing device to:
determining a first introduced latency based on a comparison of the determined network latency with the first expected response latency; and
determining the first number of intermediate frames, wherein determining the first number of intermediate frames comprises multiplying the introduced latency by the frame rate.

### Claim 32 (depends on 30)

The non-transitory computer-readable storage medium of claim 30, wherein the instructions further cause the computing device to determine a processing latency associated with performing the first command, wherein to generate the first number of intermediate frames is further based on the processing latency.

### Claim 33 (depends on 30)

The non-transitory computer-readable storage medium of claim 30, wherein the instructions further cause the computing device to determine the network latency based at least in part on (i) a round trip communication latency between a first client device from which the first command was received and the computing device, and/or (ii) a round trip communication latency between the computing device and a media device associated with the first client device.
