# US 2019/0378323 A1 · Fast Path Traced Reflections for Augmented Reality

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0378323 A1
- Document ID: US20190378323A1
- Status: Published application
- Kind: A1
- Application number: 16/004,348
- Filed: 2018-06-09
- Published: 2019-12-12
- Earliest claimed: 2018-06-09
- Assignees: Adshir Ltd.
- Applicants: Adshir Ltd.
- Inventors: Reuven Bakalash; Elad Haviv
- Web page: https://patentgrep.com/patent/US20190378323A1

## CPC

- G06T 15/06: Ray-tracing
- G06T 15/005: {General purpose rendering architectures}
- G06T 15/04: Texture mapping
- G06T 15/405: {using Z-buffer}
- G06T 15/506: {Illumination models}
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

The present disclosure describes a novel way of fast generation of physically correct reflections of virtual objects, augmented into real-world image. The method is based on global illumination ray tracing (aka path tracing) at a low computational complexity.

## Claims

### Claim 1

A computer based method for fast generation of path traced reflections of a virtual object, augmented into a real world image, utilizing a raster graphics pipeline, the method comprising the following steps:
a. identifying reflecting area in the real world image for creating reflection of an augmented object;
b. shooting a projection of primary rays from a camera onto the identified reflective area in the real world image, generating a cluster of primary hit points;
c. shooting projection of carrier rays at the augmented object through the cluster of generated primary hit points,
whereas only those carrier rays that intersect the primary hit points are used for generating secondary rays;
d. generating a render target texture which is an intersection result between secondary rays and the augmented object;
e. revealing and sampling light values in the render target texture at the points of intersection between secondary rays and augmented object;
f. feeding the sampled light values at the intersection points into their respective primary hit points; and
g. reconstructing reflection of the augmented object on the identified reflective area, from the fed light values.

### Claim 2 (depends on 1)

The method of claim 1, wherein the area of reflection in the real world image is identified on reflective or semi-reflective surfaces, which may reflect the augmented object.

### Claim 3 (depends on 1)

The method of claim 1, wherein the location and boundaries of the area of reflection is determined according to location of camera, distance and size of the augmented object, and consideration of principal direction according to Snell law.

### Claim 4 (depends on 1)

The method of claim 1, wherein the shot projection of primary rays is implemented by a hardware graphics pipeline of a graphics processing unit.

### Claim 5 (depends on 1)

The method of claim 1, wherein the projection of primary rays is implemented by a software graphics pipeline.

### Claim 6 (depends on 1)

The method of claim 1, wherein the projection of primary rays is repeated multiple times.

### Claim 7 (depends on 1)

The method of claim 1, wherein the multiple projections of primary rays are generated with no use of acceleration structures of binary trees, and are randomly deviated from each other.

### Claim 8 (depends on 7)

The method of claim 7, wherein each successive primary projection, is generated with no use of acceleration structures of binary trees, and is randomly deviated from the principal direction.

### Claim 9

(canceled)

### Claim 10 (depends on 8)

The method of claim 8, wherein each pixel of the image gets multiple samples

### Claim 11 (depends on 1)

The method of claim 1, wherein the secondary rays commence at the primary hit points.

### Claim 12 (depends on 1)

The method of claim 1, wherein the projection of secondary rays is implemented by a hardware raster pipeline of GPU.

### Claim 13

(canceled)

### Claim 14 (depends on 1)

The method of claim 1, wherein the projection of secondary rays is implemented by a software raster pipeline.

### Claim 15 (depends on 1)

The method of claim 1, wherein the projection of secondary rays has a perspective shape.

### Claim 16 (depends on 1)

The method of claim 1, wherein the projection of secondary rays has a parallel shape.

### Claim 17

(canceled)

### Claim 18 (depends on 1)

The method of claim 1, wherein the intersection points between secondary rays and augmented object are considered as a new generation of primary hit points.