# US 2019/0378336 A1 · Interactive virtual reality system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0378336 A1
- Document ID: US20190378336A1
- Status: Published application
- Kind: A1
- Application number: 16/447,423
- Filed: 2019-06-20
- Published: 2019-12-12
- Earliest claimed: 2015-09-30
- Assignees: Groupon, Inc.
- Applicants: Groupon, Inc.
- Inventors: Scott WERNER
- Web page: https://patentgrep.com/patent/US20190378336A1

## CPC

- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
- G06F 3/1454: {involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay}
- G06F 3/147: using display panels
- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G06Q 10/087: Inventory or stock management, e.g. order filling, procurement or balancing against orders
- G06Q 10/0877: {by inventory control or reporting using inventory tracking or counting}
- G06Q 20/322: {Aspects of commerce using mobile devices [M-devices]}
- G06Q 20/4014: {Identity check for transactions}
- G06T 15/20: Perspective computation
- G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts
- G09G 3/003: {to produce spatial visual effects}
- G09G 5/14: Display of multiple viewports
- G06T 2215/16: Using real world measurements to influence rendering
- G06T 2219/2016: Rotation, translation, scaling
- G09G 2358/00: Arrangements for display data security
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)

## Abstract

Provided herein are method, apparatus, and computer program products for generating a first and second three dimensional interactive environment. The first three dimensional interactive environment may contain one or more engageable virtual interfaces that correspond to one or more items. Upon engagement with a virtual interface the second three dimensional interactive environment is produced to virtual simulation related to the one or more items.

## Claims

### Claim 1

An interactive device comprising a processor and a memory associated with the processor having computer coded instructions configured to, with the processor, cause the interactive device to:
receive three dimensional environment data;
generate a first three dimensional interactive environment based on the three dimensional environment data;
receive inventory data from an inventory registry, the inventory data indicating an experiential item is in stock;
determine one or more virtual interfaces for presenting within the first three dimensional interactive environment, wherein the one or more virtual interfaces are determined based on the inventory data and the three dimensional environmental data, and wherein the one or more virtual interfaces comprises:
(1) an execution component configured to generate execution data in response to user interaction with the execution component, and
(2) a virtual experience portal;
output, to a display of the interactive device, the first three dimensional interactive environment and the one or more virtual interfaces;
receive user input data generated in association with user engagement of the interactive device, wherein the user input data indicates user engagement with the virtual experience portal of the one or more virtual interfaces;
generate a second three dimensional interactive environment based on the first three dimensional environment, wherein the second three dimensional interactive environment comprises:
(1) an experiential item virtual simulation based on the inventory data, and
(2) an experiential item environment virtual simulation associated with the experiential item virtual simulation; and
output, to the display, the second three dimensional interactive environment comprising the virtual simulation; and
transform the display from the first three dimensional interactive environment to the second three dimensional interactive environment.

### Claim 2 (depends on 1)

The interactive device of claim 1, further comprising communication circuitry configured to generate a network connection with other interactive devices, wherein the interactive device and other interactive devices substantially simultaneously output, to respective displays of the interactive device and the other interactive devices, shared versions of the first or second three dimensional interactive environment.

### Claim 3 (depends on 1)

The interactive device of claim 1, wherein the three dimensional environment data comprises profile data.

### Claim 4 (depends on 1)

The interactive device of claim 1, further configured to receive relevance data from a relevance system, wherein the three dimensional environment data comprises the relevance data.

### Claim 5

(canceled)

### Claim 6 (depends on 1)

The interactive device of claim 1, wherein the user input data comprises audio data, wherein the processor causes the interactive device to activate the execution component in response to comparing the audio data to a sensor registry.

### Claim at position 7

7-10. (canceled)

### Claim 11

A method for presenting, via an interactive device, an interactive three dimensional environment, the method comprising:
receiving, by a processor, three dimensional environmental data;
generating, by the processor, a first three dimensional interactive environment based on the three dimensional environmental data;
receiving, by the processor, inventory data from an inventory registry, the inventory data indicating an experiential item is in stock;
determining, by the processor, one or more virtual interfaces for presenting within the first three dimensional interactive environment, wherein the one or more virtual interfaces are determined based on the inventory data and the three dimensional environmental data, and wherein the one or more virtual interfaces comprises:
(1) an execution component to generate execution data in response to user interaction with the execution component, and
(2) a virtual experience portal;
outputting, by the processor, to a display of the interactive device, the first three dimensional interactive environment and the one or more virtual interfaces;
receiving, by the processor, user input data generated in association with user engagement of the interactive device, wherein the user input data indicates user engagement with the virtual experience portal of the one or more virtual interfaces;
generating, by the processor, a second three dimensional interactive environment based on the first three dimensional environment, wherein the second three dimensional interactive environment comprises:
(1) an experiential item virtual simulation based on the inventory data, and
(2) an experiential item environment virtual simulation associated with the experiential item virtual simulation; and
outputting, by the processor, to the display, the second three dimensional interactive environment comprising the virtual simulation; and
transforming, by the processor, the display from the first three dimensional interactive environment to the second three dimensional interactive environment.

### Claim 12 (depends on 11)

The method of claim 11, further comprising generating, by communication circuitry, a network connection with other interactive devices the interactive device to other interactive devices;
substantially simultaneously outputting, to respective displays of the interactive device and the other interactive devices, by the interactive device and other interactive devices shared first or second three dimensional interactive environment.

### Claim 13 (depends on 11)

The method of claim 11, wherein three dimensional environment data comprises profile data.

### Claim 14 (depends on 11)

The method of claim 11, further comprising receiving relevance data from a relevance system, wherein the three dimensional environment data comprises the relevance data.

### Claim 15

(canceled)

### Claim 16 (depends on 11)

The method of claim 11, further comprises receiving, by the processor, audio data;
comparing, by the processor, received audio data with data in a sensor database activating, by the processor, the execution component based the comparison.

### Claim at position 14

17-20. (canceled)

### Claim 21

A computer program product comprising non-transitory computer readable storage medium and computer program instructions stored therein, the computer program instructions comprising program instructions configured to:
receive, by a processor, three dimensional environmental data;
generate, via the processor, a first three dimensional interactive environment based on the three dimensional environmental data;
receive inventory data from an inventory registry, the inventory data indicating an experiential item is in stock;
determine, via the processor, one or more virtual interfaces for presenting within the first three dimensional interactive environment, wherein the one or more virtual interfaces are determined based on the inventory data and the three dimensional environmental data, and wherein the one or more virtual interfaces comprises:
(1) an execution component generates execution data, and
(2) a virtual experience portal;
output, via the processor, to a display of the interactive device, the first three dimensional interactive environment and the one or more virtual interfaces;
receive, via the processor, user input data generated in association with user engagement of the interactive device, wherein the user input data indicates user engagement with the virtual experience portal of the one or more virtual interfaces;
generate, via the processor, a second three dimensional interactive environment based on the first three dimensional environment, wherein the second three dimensional interactive comprises:
(1) an experiential item virtual simulation based on the inventory data, and
(2) an experiential item environment virtual simulation associated with the experiential item virtual simulation; and
output, via the processor, to the display, the second three dimensional interactive environment comprising the virtual simulation; and
transform, via the processor, the display from the first three dimensional interactive environment to the second three dimensional interactive environment.

### Claim 22 (depends on 21)

The computer program product of claim 21, further configured to generate, by communication circuitry, a network connection with other interactive devices the interactive device to other interactive devices;
substantially simultaneously output, to respective displays of the interactive device and the other interactive devices, by the interactive device and other interactive devices shared first or second three dimensional interactive environment.

### Claim 23 (depends on 21)

The computer program product of claim 21, wherein three dimensional environment data comprises profile data.

### Claim at position 18

24-25. (canceled)

### Claim 26 (depends on 21)

The computer program product of claim 21, further configured to receive, via the processor, audio data;
compare, via the process, received audio data with data in a sensor database;
activate, by the processor, the execution component based on the comparison.

### Claim at position 20

27-30. (canceled)

### Claim 31 (depends on 1)

The interactive device of claim 1, further configured to:
identify occurrence of a simulation end for a virtual simulation associated with the virtual simulation experiential environment; and
output, to the display, a related promotion as an execution component configured for, in response to user engagement, generating execution data associated with the related promotion.

### Claim 32 (depends on 31)

The interactive device of claim 31, further configured to:
receive second user input data generated in association with second user engagement of the interactive device, wherein the second user input data indicates execution of the related promotion as the execution component; and
initiate a payment authentication process in response to the execution of the related promotion as the execution component.

### Claim 33 (depends on 11)

The method of claim 11, further comprising:
identifying by the processor, occurrence of a simulation end for a virtual simulation associated with the virtual simulation experiential environment; and
outputting to the display, a related promotion as an execution component configured for, in response to user engagement, generating execution data associated with the related promotion.

### Claim 34 (depends on 33)

The method of claim 33, further comprising:
receiving, by the processor, second user input data generated in association with second user engagement of the interactive device, wherein the second user input data indicates execution of the related promotion as the execution component; and
initiating, by the processor, a payment authentication process in response to the execution of the related promotion as the execution component.

### Claim 35 (depends on 21)

The computer program product of claim 21, further configured to:
detect, via the processor, occurrence of a simulation end for a virtual simulation associated with the virtual simulation experiential environment; and
output, via the processor, to the display, a related promotion as an execution component configured for, in response to user engagement, generating execution data associated with the related promotion.

### Claim 36 (depends on 35)

The computer program product of claim 35, further configured to:
receive, via the processor, second user input data generated in association with second user engagement of the interactive device, wherein the second user input data indicates execution of the related promotion as the execution component; and
initiate, via the processor, a payment authentication process in response to the execution of the related promotion as the execution component.
