# US 2018/0024630 A1 · Editing cuts in virtual reality

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0024630 A1
- Document ID: US20180024630A1
- Status: Published application
- Kind: A1
- Application number: 15/656,843
- Filed: 2017-07-21
- Published: 2018-01-25
- Earliest claimed: 2016-07-21
- Assignees: Google Inc.
- Applicants: Google Inc.
- Inventors: Erik Hubert Dolly GOOSSENS
- Web page: https://patentgrep.com/patent/US20180024630A1

## CPC

- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
- G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts
- G09G 5/14: Display of multiple viewports
- G11B 27/102: {Programmed access in sequence to addressed parts of tracks of operating record carriers (access by moving the head G11B3/08, G11B5/54, G11B7/085, G11B21/022; by moving the record carrier G11B15/005, G11B17/005, by driving of both record carrier and head G11B15/1816)}
- A63F 2300/8082: Virtual reality
- G06T 2219/2004: Aligning objects, relative positioning of parts
- G09G 2320/10: Special adaptations of display systems for operation with variable images
- G09G 2354/00: Aspects of interface with display user
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)
- A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR

## Abstract

A computer-implemented method is described for configuring interaction zones for a virtual reality environment. The method may include defining a plurality of scenes, each scene including a plurality of selectable scene cuts and defining a first interaction zone and a second interaction zone. The method may also include automatically selecting a first scene cut to display the first scene, in response to detecting that a gaze direction, associated with a user accessing the virtual reality environment, is directed toward the first interaction zone. The method may also include automatically selecting a second scene cut to display the second scene, in response to detecting that the gaze direction, associated with the user accessing the virtual reality environment, is directed toward the second interaction zone. The first or second scenes may be triggered for display in a head mounted display device.

## Claims

### Claim 1

A computer-implemented method of configuring interaction zones for a virtual reality environment, the method comprising:
defining a plurality of scenes, each scene from the plurality of scenes including a plurality of selectable scene cuts;
defining a first interaction zone and a second interaction zone, the first interaction zone being associated with a first scene in the plurality of scenes and the second interaction zone being associated with a second scene in the plurality of scenes;
automatically selecting a first scene cut from the plurality of selectable scene cuts to display the first scene, in response to detecting that a gaze direction, associated with a user accessing the virtual reality environment, is directed toward the first interaction zone;
automatically selecting a second scene cut from the plurality of selectable scene cuts to display the second scene, in response to detecting that the gaze direction, associated with the user accessing the virtual reality environment, is directed toward the second interaction zone; and
triggering for display in a head mounted display device, the first scene according to the first scene cut or the second scene according to the second scene cut.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
detecting a location of the user within the virtual reality environment;
generating content to extend the first scene, in response to determining that the user is moving toward the first interaction zone; and
triggering for display in the head mounted display device, the generated content using a third scene cut, when the gaze direction associated with the user is directed away from the first interaction zone.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
receiving user settings indicating a level of experience for the user with the virtual environment; and
modifying at least one selected scene according to the user settings.

### Claim 4 (depends on 1)

The method of claim 1, further comprising:
in response to exhausting a countdown timer, automatically selecting and performing the first scene cut; and
triggering display of the first scene in the head mounted display device.

### Claim 5 (depends on 1)

The method of claim 1, further comprising:
in response to exhausting a countdown timer, generating a virtual feature for the second interaction zone and performing the second scene cut upon triggering display of the virtual feature in the head mounted display device; and
triggering display of the second scene in the head mounted display device.

### Claim 6 (depends on 5)

The method of claim 5, wherein the virtual feature is configured to attract the gaze direction, associated with the user, toward the second interaction zone in the virtual reality environment.

### Claim 7 (depends on 1)

The method of claim 1, wherein the plurality of selectable scene cuts are provided in virtual reality editing software for:
defining a plurality of interaction zones within the plurality of scenes;
defining a plurality of scenes using a plurality of images; and
associating at least one of the plurality of selectable scene cuts with at least one of the plurality of scenes and at least one of the plurality of interaction zones.

### Claim 8

A non-transitory, machine-readable medium having instructions stored thereon, the instructions, when executed by a processor, cause a computing device to:
define a plurality of scenes, each scene from the plurality of scenes including a plurality of selectable scene cuts;
define a first interaction zone and a second interaction zone, the first interaction zone being associated with a first scene in the plurality of scenes and the second interaction zone being associated with a second scene in the plurality of scenes;
automatically select a first scene cut from the plurality of selectable scene cuts to display the first scene, in response to detecting that a gaze direction, associated with a user accessing a virtual reality environment, is directed toward the first interaction zone;
automatically select a second scene cut from the plurality of selectable scene cuts to display the second scene, in response to detecting that the gaze direction, associated with the user accessing the virtual reality environment, is directed toward the second interaction zone; and
trigger for display in a head mounted display device, the first scene according to the first scene cut or the second scene according to the second scene cut.

### Claim 9 (depends on 8)

The non-transitory, machine-readable medium of claim 8, wherein the instructions further cause the computing device to:
detect a location of the user within the virtual reality environment;
generate content to extend the first scene, in response to determining that the user is moving toward the first interaction zone; and
trigger for display in the head mounted display device, the generated content using a third scene cut, when the gaze direction associated with the user is directed away from the first interaction zone.

### Claim 10 (depends on 8)

The non-transitory, machine-readable medium of claim 8, wherein the instructions further cause the computing device to:
receive user settings indicating a level of experience for the user with the virtual reality environment; and
modify at least one selected scene according to the user settings.

### Claim 11 (depends on 8)

The non-transitory, machine-readable medium of claim 8, wherein the instructions further cause the computing device to:
automatically select and perform the first scene cut, in response to exhausting a countdown timer; and
trigger display of the first scene in the head mounted display device.

### Claim 12 (depends on 8)

The non-transitory, machine-readable medium of claim 8, further comprising:
in response to exhausting a countdown timer, generate a virtual feature for the second interaction zone and performing the second scene cut upon triggering display of the virtual feature in the head mounted display device; and
trigger display of the second scene in the head mounted display device.

### Claim 13 (depends on 8)

The non-transitory, machine-readable medium of claim 8, wherein the instructions further cause the computing device to:
define a plurality of interaction zones within the plurality of scenes;
define a plurality of scenes using a plurality of images; and
associate at least one of the plurality of selectable scene cuts with at least one of the plurality of scenes and at least one of the plurality of interaction zones.

### Claim 14

A system comprising:
memory; and
at least one processor coupled to the memory, the at least one processor being configured to:
define a plurality of scenes, each scene from the plurality of scenes including a plurality of selectable scene cuts;
define a first interaction zone and a second interaction zone, the first interaction zone being associated with a first scene in the plurality of scenes and the second interaction zone being associated with a second scene in the plurality of scenes;
automatically select a first scene cut from the plurality of selectable scene cuts to display the first scene, in response to detecting that a gaze direction, associated with a user accessing a virtual reality environment, is directed toward the first interaction zone;
automatically select a second scene cut from the plurality of selectable scene cuts to display the second scene, in response to detecting that the gaze direction, associated with the user accessing the virtual reality environment, is directed toward the second interaction zone; and
trigger for display in a head mounted display device, the first scene according to the first scene cut or the second scene according to the second scene cut.

### Claim 15 (depends on 14)

The system of claim 14, wherein the at least one processor is further configured to:
detect a location of the user within the virtual reality environment;
generate content to extend the first scene, in response to determining that the user is moving toward the first interaction zone; and
trigger for display in the head mounted display device, the generated content using a third scene cut, when the gaze direction associated with the user is directed away from the first interaction zone.

### Claim 16 (depends on 14)

The system of claim 14, wherein the at least one processor is further configured to:
receive user settings indicating a level of experience for the user with the virtual reality environment; and
modify the selected scene according to the user settings.

### Claim 17 (depends on 14)

The system of claim 14, wherein the at least one processor is further configured to:
automatically select and perform the first scene cut, in response to exhausting a countdown timer; and
trigger display of the first scene in the head mounted display device.

### Claim 18 (depends on 14)

The system of claim 14, further comprising:
in response to exhausting a countdown timer, generate a virtual feature for the second interaction zone and performing the second scene cut upon triggering display of the virtual feature in the head mounted display device; and
trigger display of the second scene in the head mounted display device.

### Claim 19 (depends on 18)

The system of claim 18, wherein the virtual feature is configured to attract the gaze direction, associated with the user, toward the second interaction zone in the virtual reality environment.

### Claim 20 (depends on 14)

The system of claim 14, wherein the at least one processor is further configured to:
define a plurality of interaction zones within the plurality of scenes;
define a plurality of scenes using a plurality of images; and
associate at least one of the plurality of selectable scene cuts with at least one of the plurality of scenes and at least one of the plurality of interaction zones.
