# US 2016/0259453 A1 · Dynamic adjustment of cloud game data streams to output device and network quality

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2016/0259453 A1
- Document ID: US20160259453A1
- Status: Published application
- Kind: A1
- Application number: 14/641,121
- Filed: 2015-03-06
- Published: 2016-09-08
- Earliest claimed: 2015-03-06
- Assignees: Sony Computer Entertainment America LLC
- Applicants: Sony Computer Entertainment America LLC
- Inventors: Roelof Roderick Colenbrander; David Perry
- Web page: https://patentgrep.com/patent/US20160259453A1

## CPC

- A63F 13/53: involving additional visual information provided to the game scene, e.g. by overlay to simulate a head-up display [HUD] or displaying a laser sight in a shooting game
- A63F 13/323: between game devices with different hardware characteristics, e.g. hand-held game devices connectable to game consoles or arcade machines
- A63F 13/335: using Internet
- A63F 13/355: Performing operations on behalf of clients with restricted processing capabilities, e.g. servers transform changing game scene into an encoded video stream for transmitting to a mobile phone or a thin client
- A63F 13/358: Adapting the game course according to the network or server load, e.g. for reducing latency due to different connection speeds between clients
- A63F 13/77: involving data related to game devices or game servers, e.g. configuration data, software version or amount of memory
- A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR

## Abstract

Aspects of the present disclosure relate to systems and methods for the dynamic adjustment of data streamed over a network which is then displayed on an output device. In particular, aspects of the present disclosure relate to systems and methods for determining the display capabilities of an output device and then formatting two or more streams of data configured for display on the output device, wherein the user interface and video data are contained in separate streams, such that the content is displayed in a manner consistent with the display capabilities of the output device. The output can then be adjusted or prioritized based on device orientation and network quality.

## Claims

### Claim 1

A non-transitory computer readable medium having processor-executable instructions embodied therein, wherein execution of the instructions by a processor causes the processor to implement a method, the method comprising:
a) determining the display capabilities of an output device;
b) formatting two or more data streams configured for display on the output device such that the content is displayed in a manner consistent with the display capabilities of the output device, wherein the two or more data streams include a data stream for user interface data and a separate data stream for video data; and
c) delivering the two or more streams of content data to the output device.

### Claim 2 (depends on 1)

The non-transitory computer readable medium of claim 1, wherein the two or more data streams include a data stream containing compressed data.

### Claim 3 (depends on 1)

The non-transitory computer readable medium of claim 1, wherein the two or more streams of content include a data stream containing data to be displayed as text.

### Claim 4 (depends on 1)

The non-transitory computer readable medium of claim 1, wherein the two or more streams of content include a data stream containing data to be displayed as a heads-up-display (HUD).

### Claim 5 (depends on 1)

The non-transitory computer readable medium of claim 1, wherein the two or more data streams include a data stream containing data to be displayed as inventory information.

### Claim 6 (depends on 1)

The non-transitory computer readable medium of claim 1, wherein the two or more data include a data stream containing data to be displayed map information.

### Claim 7 (depends on 1)

The non-transitory computer readable medium of claim 1, wherein the display of one data stream is prioritized over the display of another.

### Claim 8 (depends on 7)

The non-transitory computer readable medium of claim 7, wherein the prioritization of display is determined by the quality of the network connection.

### Claim 9 (depends on 1)

The non-transitory computer readable medium of claim 1, wherein the display instructions are delivered by a server to a client device platform used in combination with the output device.

### Claim 10 (depends on 9)

The non-transitory computer readable medium of claim 9, wherein the client device platform is a gaming console.

### Claim 11 (depends on 9)

The non-transitory computer readable medium of claim 9, wherein the client device platform is a computer.

### Claim 12 (depends on 9)

The non-transitory computer readable medium of claim 9, wherein the client device platform is a cellular phone.

### Claim 13 (depends on 9)

The non-transitory computer readable medium of claim 9, wherein the client device platform is a tablet.

### Claim 14 (depends on 9)

The non-transitory computer readable medium of claim 9, wherein the client device platform is a hand-held computing device.

### Claim 15 (depends on 9)

The non-transitory computer readable medium of claim 9, wherein the client device platform is a set top box.

### Claim 16 (depends on 9)

The non-transitory computer readable medium of claim 9, wherein the client device platform is a telephonic system.

### Claim 17 (depends on 9)

The non-transitory computer readable medium of claim 9, wherein the client device platform is a dongle device.

### Claim 18 (depends on 9)

The non-transitory computer readable medium of claim 9, wherein the client device is configured to query the output device to determine the display capabilities of the output device and deliver this information to the server.

### Claim 19 (depends on 1)

The non-transitory computer readable medium of claim 1, wherein the display capability information also includes a picture orientation of the output device.

### Claim 20 (depends on 1)

The non-transitory computer readable medium of claim 1, wherein the content data includes a video portion of a video game.

### Claim 21 (depends on 1)

The non-transitory computer readable medium of claim 1, wherein the content data is a stream of a computer program session running on a remote machine.

### Claim 22 (depends on 1)

The non-transitory computer readable medium of claim 1, wherein the output device is a television.

### Claim 23 (depends on 1)

The non-transitory computer readable medium of claim 1, wherein the output device is a projector.

### Claim 24 (depends on 1)

The non-transitory computer readable medium of claim 1, wherein the output device and the client device platform are the same device.

### Claim 25 (depends on 1)

The non-transitory computer readable medium of claim 1, wherein b) includes formatting the video data with an application used to generate video frames for the data stream for video data.

### Claim 26 (depends on 1)

The non-transitory computer readable medium of claim 1, wherein the two or more streams include a game stream and a user interface stream.

### Claim 27 (depends on 26)

The non-transitory computer readable medium of claim 26, wherein the two or more streams include a game stream, a user interface stream and one or more additional streams.

### Claim 28 (depends on 26)

The non-transitory computer readable medium of claim 26, wherein the two or more streams include a game stream, a user interface stream and a video chat stream between a first client device and a second client device.

### Claim 29 (depends on 26)

The non-transitory computer readable medium of claim 26, wherein the two or more streams include a game stream, a user interface stream and a video chat stream between a first client device and a second client device, wherein the method further comprises coordinating a peer-to-peer session between the first and second client devices to let the first and second client devices combine the video chat stream with the game stream and the user interface stream.

### Claim 30

On a server configured to operate on a network, a method, comprising:
a) determining the display capabilities of an output device;
b) formatting two or more data streams configured for display on the output device such that the content is displayed in a manner consistent with the display capabilities of the output device, wherein the two or more data streams include a data stream for user interface data and a separate data stream for video data.

### Claim 31

A system comprising:
a processor, and
a memory coupled to the processor;
wherein the processor is configured to perform a method, the method comprising:
a) determining the display capabilities of an output device;
b) formatting two or more data streams configured for display on the output device such that the content is displayed in a manner consistent with the display capabilities of the output device, wherein the two or more data streams include a data stream for user interface data and a separate data stream for video data; and
c) delivering the two or more streams of content data to the output device.
