# US 2018/0322669 A1 · Virtual reality image compositing

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0322669 A1
- Document ID: US20180322669A1
- Status: Published application
- Kind: A1
- Application number: 15/586,103
- Filed: 2017-05-03
- Published: 2018-11-08
- Earliest claimed: 2017-05-03
- Assignees: Microsoft Technology Licensing, LLC
- Applicants: Microsoft Technology Licensing, LLC
- Inventors: Jack ELLIOTT; Andrew YEUNG
- Web page: https://patentgrep.com/patent/US20180322669A1

## CPC

- G06T 15/503: {Blending, e.g. for anti-aliasing}
- A63F 13/20: Input arrangements for video game devices
- A63F 13/25: Output arrangements for video game devices
- G06T 5/80: Geometric correction
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- A63F 2300/8082: Virtual reality
- G06T 11/60: Creating or editing images; Combining images with text
- G06T 2207/20221: Image fusion; Image merging
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR

## Abstract

Methods and devices for performing one step compositing may include receiving at least a first surface from a first image source and a second surface from a second image source. The methods and devices may include generating a composite image with a combined first surface and second surface by contemporaneously applying position corrections to the first surface and the second surface and lens distortion corrections to the first surface and the second surface and blending the first surface and the second surface into respective positions in the composite image. The methods and devices may include transmitting the composite image representing a virtual environment for presentation to a downstream consumer.

## Claims

### Claim 1

A computer device, comprising:
a memory to store data and instructions;
a processor in communication with the memory; and
an operating system in communication with the memory and the processor, wherein the operating system is operable to:
receive at least a first surface from a first image source and a second surface from a second image source;
generate a composite image with a combined first surface and second surface by contemporaneously applying position corrections to the first surface and the second surface and lens distortion corrections to the first surface and the second surface and blending the first surface and the second surface into respective positions in the composite image; and
transmit the composite image representing a virtual environment for presentation to a downstream consumer.

### Claim 2 (depends on 1)

The computer device of claim 1, wherein the operating system is further operable to:
receive a latest change in position for the first surface and the second surface; and
apply the latest change in position to the first surface and the second surface,
wherein the composite image is generated by contemporaneously applying the position corrections, the lens distortion corrections, and the latest change in position to the first surface and the second surface.

### Claim 3 (depends on 1)

The computer device of claim 1, wherein to apply the position corrections to the first surface and the second surface the operating system is further operable to translate the first surface and the second surface into a common coordinate system.

### Claim 4 (depends on 1)

The computer device of claim 1, wherein the operating system is further operable to:
receive a first position for the first surface corresponding to a first head position of a user; and
receive a second position for the second surface corresponding to a second head position of the user;
wherein to apply the position corrections to the first surface and the second surface the operating system is further operable to translate the first head position and the second head position to a same head position.

### Claim 5 (depends on 1)

The computer device of claim 1, wherein the lens distortion corrections account for changes of the first surface and the second surface when projected through a lens of a display device.

### Claim 6 (depends on 1)

The computer device of claim 1, wherein the first image source is from a virtual reality application, mixed reality application, or augmented reality application.

### Claim 7 (depends on 1)

The computer device of claim 1, wherein the second image source is from a virtual reality application, mixed reality application, or augmented reality application.

### Claim 8 (depends on 1)

The computer device of claim 1, wherein the composite image is presented on a two dimensional surface in the virtual environment.

### Claim 9 (depends on 1)

The computer device of claim 1, wherein the operating system is operable to generate the composite image and contemporaneously apply the position corrections the lens distortion corrections to the first surface and the second surface in one step.

### Claim 10 (depends on 1)

The computer device of claim 1, wherein the composite image is displayed to a user.

### Claim 11

A method for performing one step compositing, comprising:
receiving, at an operating system executing on a computer device, at least a first surface from a first image source and a second surface from a second image source;
generating, at the operating system, a composite image with a combined first surface and second surface by contemporaneously applying position corrections to the first surface and the second surface and lens distortion corrections to the first surface and the second surface and blending the first surface and the second surface into respective positions in the composite image; and
transmitting the composite image representing a virtual environment for presentation to a downstream consumer.

### Claim 12 (depends on 11)

The method of claim 11, further comprising:
receiving a latest change in position for the first surface and the second surface; and
applying the latest change in position to the first surface and the second surface,
wherein the composite image is generated by contemporaneously applying the position corrections, the lens distortion corrections, and the latest change in position to the first surface and the second surface.

### Claim 13 (depends on 11)

The method of claim 11, wherein to apply the position corrections to the first surface and the second surface further includes translating the first surface and the second surface into a common coordinate system.

### Claim 14 (depends on 11)

The method of claim 11, further comprising:
receiving a first position for the first surface corresponding to a first head position of a user; and
receiving a second position for the second surface corresponding to a second head position of the user,
wherein to apply the position corrections to the first surface and the second surface further includes translating the first head position and the second head position to a same head position.

### Claim 15 (depends on 11)

The method of claim 11, wherein the lens distortion corrections account for changes of the first surface and the second surface when projected through a lens of a display device.

### Claim 16 (depends on 11)

The method of claim 11, wherein the first image source is from a virtual reality application, mixed reality application, or augmented reality application.

### Claim 17 (depends on 11)

The method of claim 11, wherein the second image source is from a virtual reality application, mixed reality application, or augmented reality application.

### Claim 18 (depends on 11)

The method of claim 11, wherein the composite image is presented on a two dimensional surface in the virtual environment.

### Claim 19 (depends on 11)

The method of claim 11, wherein generating the composite image further comprises contemporaneously applying the position corrections the lens distortion corrections to the first surface and the second surface in one step.

### Claim 20

A computer-readable medium storing instructions executable by a computer device, comprising:
at least one instruction for causing the computer device to receive at least a first surface from a first image source and a second surface from a second image source;
at least one instruction for causing the computer device to generate a composite image with a combined first surface and second surface by contemporaneously applying position corrections to the first surface and the second surface and lens distortion corrections to the first surface and the second surface and blending the first surface and the second surface into respective positions in the composite image; and
at least one instruction for causing the computer device to transmit the composite image representing a virtual environment for presentation to a downstream consumer.
