# US 2017/0287097 A1 · Hybrid client-server rendering in a virtual reality system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0287097 A1
- Document ID: US20170287097A1
- Status: Published application
- Kind: A1
- Application number: 15/084,184
- Filed: 2016-03-29
- Published: 2017-10-05
- Earliest claimed: 2016-03-29
- Assignees: ATI Technologies ULC
- Applicants: Ati Technologies Ulc
- Inventors: I-Cheng Chen
- Web page: https://patentgrep.com/patent/US20170287097A1

## CPC

- G06T 1/20: Processor architectures; Processor configuration, e.g. pipelining
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A server partitions a model representative of a scene into a first portion and a second portion based on proximities of objects within the scene to a client device, renders a first portion of an image representative of the scene based on the first portion of the model, and transmits information representative of the second portion of the model and the first portion of the image over a wireless or wired network. The client device receives information representative of the second portion of the model and the first portion of the image. The client device renders the second portion of the image based on the second portion of the model and combines the first and second portions of the image.

## Claims

### Claim 1

An apparatus comprising:
at least one processor to partition a model representative of a scene into a first portion and a second portion based on proximities of the first portion and the second portion of the model to a client device and to render a first portion of an image representing the scene based on the first portion of the model; and
a network interface to transmit information representative of the second portion of the model and the rendered first portion of the image to the client device.

### Claim 2 (depends on 1)

The apparatus of claim 1, wherein the first portion of the model represents objects of the scene that are beyond a threshold distance from the client device, and wherein the second portion of the model represents objects of the scene that are within the threshold distance from the client device.

### Claim 3 (depends on 2)

The apparatus of claim 2, wherein the at least one processor is to partition the model into the first portion and the second portion further based on rates of change of the first portion and the second portion.

### Claim 4 (depends on 3)

The apparatus of claim 3, wherein the at least one processor is to partition the model so that the first portion of the model has a rate of change that is below a threshold rate and the second portion of the model has a rate of change that is above the threshold rate.

### Claim 5 (depends on 1)

The apparatus of claim 1, wherein the network interface is to transmit information indicating a coordinate system that is used to align the first portion of the image with a second portion of the image rendered by the client device using the second portion of the model.

### Claim 6 (depends on 1)

The apparatus of claim 1, wherein the network interface is to receive motion data indicative of motion of the client device.

### Claim 7 (depends on 6)

The apparatus of claim 6, wherein the at least one processor is to render the first portion of the image based on the first portion of the model and the motion data.

### Claim 8

An apparatus comprising:
a network interface to receive information representative of a first portion of a model representative of a scene and a first portion of an image rendered by the server based on a second portion of the model, wherein the model is partitioned into the first portion and the second portion based on proximity of objects in the scene represented in the first and second portions to the apparatus; and
at least one processor to render a second portion of the image based on the first portion of the model and merge the first and second portions of the image.

### Claim 9 (depends on 8)

The apparatus of claim 8, wherein the first portion of the model represents one or more objects of the scene that are within a threshold distance from the apparatus, and wherein the second portion of the model represents one or more objects of the scene that are beyond the threshold distance from the apparatus.

### Claim 10 (depends on 9)

The apparatus of claim 9, wherein the model is partitioned into the first portion and the second portion further based on rates of change of the first portion and the second portion.

### Claim 11 (depends on 10)

The apparatus of claim 10, wherein the model is partitioned into the first portion of the model that has a rate of change that is above a threshold rate and the second portion of the model that has a rate of change that is below the threshold rate.

### Claim 12 (depends on 8)

The apparatus of claim 8, wherein the transceiver is to receive information indicating a coordinate system that is used to align the first portion of the image with the second portion of the image.

### Claim 13 (depends on 8)

The apparatus of claim 8, wherein the at least one processor is to acquire motion data indicative of motion of the apparatus.

### Claim 14 (depends on 13)

The apparatus of claim 13, wherein the at least one processor is to render the second portion of the image based on the first portion of the model and the motion data.

### Claim 15 (depends on 14)

The apparatus of claim 14, wherein the at least one processor is to modify the first portion of the image based on the motion data prior to combining the first portion of the image with the second portion of the image.

### Claim 16 (depends on 13)

The apparatus of claim 13, wherein the network interface is to transmit the acquired motion data to the server.

### Claim 17 (depends on 8)

The apparatus of claim 8, further comprising:
at least one display, and wherein the at least one processor is to provide information indicative of the merged first and second portions of the image to the display for presentation to a user.

### Claim 18

An apparatus comprising:
a server to partition a model representative of a scene into a first portion and a second portion based on proximities of objects in the scene to a client device, render a first portion of an image representative of the scene based on the first portion of the model, and transmit information representative of the second portion of the model and the first portion of the image, and
a client device to receive, from the server, information representative of the second portion of the model and the first portion of the image, and wherein the client device is to render the second portion of the image based on the second portion of the model and combine the first and second portions of the image.

### Claim 19 (depends on 18)

The apparatus of claim 18, wherein the server is to transmit, to the client device, information indicating a coordinate system that is used to align the first portion of the image with the second portion of the image.

### Claim 20 (depends on 18)

The apparatus of claim 18, wherein the client device is to acquire motion data indicative of motion of the client device and transmit information indicative of the motion data to the server, wherein the server is to render the first portion of the image based on the first portion of the model and the motion data, wherein the client device is to render the second portion of the image based on the second portion of the model and the motion data, and wherein the client device is to modify the first portion of the image based on the motion data prior to combining the first portion of the image with the second portion of the image.
