US 2026/0295442 A1Published application

Simulated state driven neural rendering for spectating gameplay

AssigneeElectronic Arts Inc.

InventorKallol Mitra

Life of this patent

Estimating the term…

Loading patent…

Abstract

Systems and methods of streaming simulated state data of a virtual interactive environment for spectating gameplay supporting visual modifications. A video game application transmits simulated state data to a spectating application that includes a machine learning model trained to render gameplay from the simulated state data. Through local client-side rendering of the spectated gameplay, the spectating application can offer interactive features for engaging with and changing visual aspects of the rendered frames, unlike traditional video streaming. The spectating application utilizes a neural renderer to generate high-fidelity visuals without requiring full game assets, maintaining smooth motion through state interpolation and supporting multiple synchronized viewpoints. By streaming simulated state data packets, the approach reduces bandwidth, software, and hardware requirements for locally rendering spectated gameplay.

Claims20

Dependent claims

A system comprising:

one or more processors;
and
one or more memory devices communicatively coupled to the one or more processors, the one or more memory devices storing computer-executable instructions corresponding to a spectating application that, during runtime execution by the one or more processors, causes at least one of the one or more processors to:
access, from a spectating service over a network to display the spectating application, a plurality of game sessions corresponding to one or more video game applications, wherein the plurality of game sessions is each available for spectating;
receive a selection, from among the accessed plurality of game sessions displayed on the spectating application, a game session among the plurality to spectate gameplay of the game session;
send, in response to the selection of the game session, a request to spectate the gameplay of the game session to the spectating service;
receive, in response to the request, a data stream corresponding to the game session from the spectating service, the data stream comprising at least simulation state data packets (SSDPs) defining one or more states of gameplay of the game session;
render, by a renderer of the spectating application, a first view of gameplay based at least in part on the data stream, wherein the renderer of the spectating application differs from the renderer of the video game application that produced the game session;
select, among a user interface of the spectating application, a first visual modification feature to apply to the first view rendered;
and
render a second view of gameplay based at least in part on the data stream and the first visual modification feature, wherein the second view renders at least one or more visual elements that differ from the first view.

8 more elements

A computer implemented method of a spectating application configured to:

access, from a spectating service over a network to display the spectating application, a plurality of game sessions corresponding to one or more video game applications, wherein the plurality of game sessions is each available for spectating;
receive a selection, from among the accessed plurality of game sessions displayed on the spectating application, a game session among the plurality to spectate gameplay of the game session;
send, in response to the selection of the game session, a request to spectate the gameplay of the game session to the spectating service;
receive, in response to the request, a data stream corresponding to the game session from the spectating service, the data stream comprising at least simulation state data packets (SSDPs) defining one or more states of gameplay of the game session;
render, by a renderer of the spectating application, a first view of gameplay based at least in part on the data stream, wherein the renderer of the spectating application differs from the renderer of the video game application;
select, among a user interface of the spectating application, a first visual modification feature to apply to the first view rendered;
and
render a second view of gameplay based at least in part on the data stream and the first visual modification feature, wherein the second view renders at least one or more visual elements that differ from the first view.

5 more elements

A computer readable medium storing computer-executable instructions defining at least a spectating application configured to:

access, from a spectating service over a network to display the spectating application, a plurality of game sessions corresponding to one or more video game applications, wherein the plurality of game sessions is each available for spectating;
receive a selection, from among the accessed plurality of game sessions displayed on the spectating application, a game session among the plurality to spectate gameplay of the game session;
send, in response to the selection of the game session, a request to spectate the gameplay of the game session to the spectating service;
receive, in response to the request, a data stream corresponding to the game session from the spectating service, the data stream comprising at least simulation state data packets (SSDPs) defining one or more states of gameplay of the game session;
render, by a renderer of the spectating application, a first view of gameplay based at least in part on the data stream, wherein the renderer of the spectating application differs from the renderer of the video game application;
select, among a user interface of the spectating application, a first visual modification feature to apply to the first view rendered;
and
render a second view of gameplay based at least in part on the data stream and the first visual modification feature, wherein the second view renders at least one or more visual elements that differ from the first view.

5 more elements

Dependencies are inferred from the claim text.