# US 2020/0110262 A1 · Dynamic objects in virtual reality environments

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0110262 A1
- Document ID: US20200110262A1
- Status: Published application
- Kind: A1
- Application number: 16/499,258
- Filed: 2018-03-29
- Published: 2020-04-09
- Earliest claimed: 2017-03-31
- Assignees: Adverty AB
- Applicants: Adverty AB
- Inventors: Niklas BAKOS; Niclas KJELLGREN
- Web page: https://patentgrep.com/patent/US20200110262A1

## CPC

- G02B 27/017: {Head mounted}
- G06Q 30/0241: Advertisements
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/012: {Head tracking input arrangements}
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G02B 2027/0138: {comprising image capture systems, e.g. camera}
- G02B 2027/014: {comprising information/image processing systems}
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

There is provided a method for determining if an object has been observed by user, said object being rendered in a graphical environment provided to a user with a head-mounted device, where the computer generated graphical environment is able to change over time, the method comprising the steps of: a) determining if the geometric proportion S of the size of the object, in relation to the total field of view generated in the graphical environment, is larger than a predetermined threshold value (Smin), and, if S is larger than Smin, determining for how long time (T) that S is greater than Smin, and if T is greater than a predetermined time Tmin, determining that the object has been observed by the user. There is also provided a method for placing objects in a graphical environment.

## Claims

### Claim 1

A method for determining if an object rendered on a display has been observed by a user, said object being rendered in a computer-generated graphical environment provided to a user with a head-mounted device, the method comprising the steps of:
a) using proportion determination software to determine the area of the display that is used to render the object,
b) using the proportion determination software to determine the proportion (S) of the area of step a) in relation to the total field of view generated in the graphical environment,
c) the proportion determination software providing S to observation determination software,
d) using the observation detection software to determine if the object is larger than a predetermined threshold value (Smin), and, if S is larger than Smin, determining for how long time (T) that S is greater than Smin, and
if T is greater than a predetermined time Tmin, determining that the object has been observed by the user,
where the graphical environment is dependent on the direction of viewing of the user and were S is modified by a coefficient K, where said coefficient K is selected based on the angle α between the horizontal direction of observation of the user in the computer generated graphical environment and the horizontal direction from the point of observation of the user to a predefined point on the object, where α is determined by angle determination software and where K is constant for at least one interval of values of α,
or
where the object has a flat surface and the proportion S is modified by an incidence angle coefficient L, where L is selected based on the angle β between a vertical plane that is defined by the direction of observation 12 and a vertical plane that is perpendicular to the flat surface of the object, where β is determined by angle determination software and where L is constant for at least one interval of values of β.

### Claim 2 (depends on 1)

The method of claim 1 where there is a first threshold value Smin1 and a second threshold value Smin2 and where the method comprises
i. determining for how long time S is larger than Smin1, and
ii. determining for how long time S is larger than Smin2, and
if the time determined in i) is greater than a predetermined time Tmin1, or if the time determined in step ii) is greater than a predetermined time Tmin2, determining that the object has been observed by the user,
where Tmin1>Tmin2 when Smin1<Smin2.

### Claim 3 (depends on 1)

The method of claim 1 where Tmin is between 0.2 seconds and 5 seconds.

### Claim 4 (depends on 1)

The method of claim 1 where Smin is determined by dividing the area of the object with the area of the total field of view and Smin is between 0.05% and 3% of the total field of view generated in the computer generated graphical environment.

### Claim 5

(canceled)

### Claim 6

(canceled)

### Claim 7 (depends on 1)

The method of claim 1 were K is constant when α is larger than an upper limit of from 15° to 30°.

### Claim 8 (depends on 1)

The method of claim 1 were K is constant when α is larger than a lower limit of from 50° to 70°.

### Claim 9 (depends on 1)

The method of claim 1 where K=0 when α is larger than a lower limit of from 50° to 70°.

### Claim 10 (depends on 1)

The method of claim 1 where K is dependent on cos α when α is between a lower limit of from 15° to 30° and an upper limit of from 50° to 70°.

### Claim 11 (depends on 1)

The method of claim 1 where K is constant for at least some values of a and varies continuously for another interval of values of α, where the two intervals do not overlap.

### Claim 12

(canceled)

### Claim 13

(canceled)

### Claim 14 (depends on 1)

The method of claim 1 where L is constant when β is larger than or equal to 0° but smaller than an upper limit of from 50° to 70°.

### Claim 15 (depends on 1)

The method of claim 1 where L is constant when β is larger than a limit value of from 75° to 85°.

### Claim 16 (depends on 15)

The method of claim 15 where L=0 when β is larger than a limit value of from 75° to 85°.

### Claim 17 (depends on 1)

The method of claim 1 where L is dependent on cos β when β is between a lower limit of from 50° to 70° and an upper limit of from 75° to 85°.

### Claim 18 (depends on 1)

The method of claim 1 where L is constant for at least one interval of values of β and varies continuously for at least one other interval of values of β, where the two intervals do not overlap.

### Claim 19

A system comprising a head-mounted device for rendering a graphical environment provided to a user on a display, said system comprising a computer with a memory, the memory comprising observation detection software and area proportion determination software, and angle determination software,
said area proportion determination software being configured to determine the area of the display that is used to render the object, and to determine the proportion (S) of the area in relation to the total field of view of the graphical environment, and configured to provide S to the observation detection software,
said observation detection software being configured to receive S from the area determination software and configured to determine if S is larger than a predetermined threshold value (Smin), and configured to, if S is larger than Smin, determining for how long time (T) that S is greater than Smin, and configured to, if T is greater than a predetermined time Tmin, determine that the object has been observed by the user,
where the where the graphical environment is dependent on the direction of viewing of the user and were S is modified by a coefficient K, where said coefficient K is selected based on the angle α between the horizontal direction of observation of the user in the computer generated graphical environment and the horizontal direction from the point of observation of the user to a predefined point on the object, where K is constant for at least one interval of values of α, where α is determined by angle determination software,
or
where the object has a flat surface and the proportion S is modified by an incidence angle coefficient L, where L is selected based on the angle β between a vertical plane that is defined by the direction of observation 12 and a vertical plane that is perpendicular to the flat surface of the object, where L is constant for at least one interval of values of β, where β is determined by angle determination software.

### Claim 20 (depends on 1)

The method of claim 1 where the graphical environment is rendered by using pixels of the display and S is determined by calculating the proportion of the number of pixels used to render the object to the number of pixels used by the display of the device to render the graphical environment.