# US 10,373,383 B1 · Interactive virtual reality system > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,373,383 B1 - Document ID: US10373383B1 - Status: Granted - Kind: B1 - Application number: 15/281,024 - Filed: 2016-09-29 - Granted: 2019-08-06 - Earliest claimed: 2015-09-30 - Assignees: Groupon, Inc. - Applicants: Groupon, Inc. - Inventors: Scott Werner - Web page: https://patentgrep.com/patent/US10373383B1 ## CPC - G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)} - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object - G06F 3/1454: {involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay} - G06F 3/147: using display panels - G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback} - G06Q 10/087: Inventory or stock management, e.g. order filling, procurement or balancing against orders - G06Q 10/0877: {by inventory control or reporting using inventory tracking or counting} - G06Q 20/322: {Aspects of commerce using mobile devices [M-devices]} - G06Q 20/4014: {Identity check for transactions} - G06T 15/20: Perspective computation - G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts - G09G 3/003: {to produce spatial visual effects} - G09G 5/14: Display of multiple viewports - G06T 2215/16: Using real world measurements to influence rendering - G06T 2219/2016: Rotation, translation, scaling - G09G 2358/00: Arrangements for display data security - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR - G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00) ## Abstract Provided herein are method, apparatus, and computer program products for generating a first and second three dimensional interactive environment. The first three dimensional interactive environment may contain one or more engageable virtual interfaces that correspond to one or more items. Upon engagement with a virtual interface the second three dimensional interactive environment is produced to virtual simulation related to the one or more items. ## Claims ### Claim 1 An interactive device comprising a processor and a memory associated with the processor having computer coded instructions configured to, with the processor, cause the interactive device to: receive three dimensional environment data; generate a first three dimensional interactive environment based on the three dimensional environment data; receive inventory data comprising a measurable quantity from an inventory registry; determine one or more virtual interfaces for presenting within the first three dimensional interactive environment, wherein the one or more virtual interfaces are determined based on the inventory data and the three dimensional environmental data, and wherein each of the one or more virtual interfaces comprises an execution component configured to generate execution data, and a virtual experience portal configured to transform from the first three dimensional interactive environment to a second three dimensional interactive environment, the second three dimensional interactive environment comprising a virtual simulation associated with a sense stimuli module of the interactive device, wherein the virtual simulation is associated with an experiential item based on the inventory data and a virtual simulation experiential environment associated with the experiential item; output, to a display of the interactive device, the first three dimensional interactive environment and the one or more virtual interfaces, wherein the execution component associated with each of the one or more virtual interfaces comprises an execution component status generated based on the measurable quantity of the inventory data; receive user input data generated in association with user engagement of the interactive device; in circumstances where the user input data indicates user engagement with the execution component of the one or more virtual interfaces, store the associated execution data to a user execution registry, and update the measurable quantity associated with the inventory data; and in circumstances where the user input data indicates user engagement with the virtual experience portal of the one or more virtual interfaces, generate the second three dimensional interactive environment based on the three dimensional environment data and the user input data, trigger the sense stimuli module of the interactive device for simulating user senses associated with the virtual simulation; output to the display the second three dimensional interactive environment comprising the virtual simulation; and transform the display from the first three dimensional interactive environment to the second three dimensional interactive environment. ### Claim 2 (depends on 1) The interactive device of claim 1, further comprising communication circuitry configured to generate a network connection with other interactive devices, wherein the interactive device and other interactive devices substantially simultaneously output, to respective displays of the interactive device and the other interactive devices, shared versions of the first or second three dimensional interactive environment. ### Claim 3 (depends on 1) The interactive device of claim 1, wherein the three dimensional environment data comprises profile data. ### Claim 4 (depends on 1) The interactive device of claim 1, further configured to receive relevance data from a relevance system, wherein the three dimensional environment data comprises the relevance data. ### Claim 5 (depends on 1) The interactive device of claim 1, wherein the execution component status of the one or more virtual interfaces is an in-stock status, an out-of-stock status, or a purchasable amount determined based on the measurable quantity of the inventory data. ### Claim 6 (depends on 1) The interactive device of claim 1, wherein the user input data comprises audio data, wherein the processor causes the interactive device to activate the execution component in response to comparing the audio data to a sensor registry. ### Claim 7 (depends on 1) The interactive device of claim 1, wherein the second three dimensional interactive environment is generated based on item data. ### Claim 8 (depends on 7) The interactive device of claim 7, wherein item data comprises user feedback data. ### Claim 9 (depends on 1) The interactive device of claim 1, wherein the second three dimensional interactive environment comprises the virtual simulation of a part of at least one of: a vacation, a concert, or a trip. ### Claim 10 (depends on 1) The interactive device of claim 1, wherein the second three dimensional interactive environment comprises a virtual rendering of a good. ### Claim 11 (depends on 1) The interactive device of claim 1, wherein the sense stimuli module of the interactive device comprises an audio generator, an odor generator, a haptic generator, a heater or a fan. ### Claim 12 A method for presenting, via an interactive device, an interactive three dimensional environment, the method comprising: receiving, by a processor, three dimensional environmental data; generating, by the processor, a first three dimensional interactive environment based on the three dimensional environmental data; receiving, by the processor, inventory data comprising a measurable quantity from an inventory registry; determining, by the processor, one or more virtual interfaces for presenting within the first three dimensional interactive environment, wherein the one or more virtual interfaces are determined based on the inventory data and the three dimensional environmental data, and wherein each of the one or more virtual interfaces comprises an execution component configured to generate execution data and a virtual experience portal configured to transform from the first three dimensional interactive environment to a second three dimensional interactive environment, the second three dimensional interactive environment comprising a virtual simulation associated with a sense stimuli module of the interactive device, wherein the virtual simulation is associated with an experiential item based on the inventory data and a virtual simulation experiential environment associated with the experiential item; outputting, by the processor, to a display of the interactive device, the first three dimensional interactive environment and the one or more virtual interfaces, wherein the execution component associated with each of the one or more virtual interfaces comprises an execution component status generated based on the measurable quantity of the inventory data; receiving, by the processor, user input data generated in association with user engagement of the interactive device; in circumstances where the user input data indicates user engagement with the execution component of the one or more virtual interfaces, storing, by the processor, the associated execution data to a user execution registry, and updating, by the processor, the measurable quantity associated with the inventory data; and in circumstances where the user input data indicates user engagement with the virtual experience portal of the one or more virtual interfaces, generating, by the processor, the second three dimensional interactive environment based on the three dimensional environment data and the user input data, triggering, by the processor, the sense stimuli module of the interactive device for simulating user senses associated with the virtual simulation, and outputting, by the processor, to the display the second three dimensional interactive environment comprising the virtual simulation; and transforming the display from the first three dimensional interactive environment to the second three dimensional interactive environment. ### Claim 13 (depends on 12) The method of claim 12, further comprising generating, by communication circuitry, a network connection with other interactive devices the interactive device to other interactive devices; substantially simultaneously outputting, to respective displays of the interactive device and the other interactive devices, by the interactive device and other interactive devices shared first or second three dimensional interactive environment. ### Claim 14 (depends on 12) The method of claim 12, wherein three dimensional environment data comprises profile data. ### Claim 15 (depends on 12) The method of claim 12, further comprising receiving relevance data from a relevance system, wherein the three dimensional environment data comprises the relevance data. ### Claim 16 (depends on 12) The method of claim 12, wherein the execution component status of the one or more virtual interfaces is an in-stock status, an out-of-stock status, or a purchasable amount determined based on the measurable quantity of the inventory data. ### Claim 17 (depends on 12) The method of claim 12, further comprises receiving, by the processor, audio data; comparing, by the processor, received audio data with data in a sensor database activating, by the processor, the execution component based the comparison. ### Claim 18 (depends on 12) The method of claim 12, further comprises generating, by the processor, the second three dimensional interactive environment based on item data. ### Claim 19 (depends on 18) The method of claim 18, wherein the item data comprises user feedback data. ### Claim 20 (depends on 12) The method of claim 12, wherein the second three dimensional interactive environment comprises the virtual simulation of a part of a least at least one of: a vacation, a concert, or a trip. ### Claim 21 (depends on 12) The method of claim 12, wherein the second three dimensional interactive environment comprises a virtual rendering of a good. ### Claim 22 (depends on 12) The method of claim 12, wherein the sense stimuli module of the interactive device comprises an audio generator, an odor generator, a haptic generator, a heater or a fan. ### Claim 23 A computer program product comprising non-transitory computer readable storage medium and computer program instructions stored therein, the computer program instructions comprising program instructions configured to: receive, by a processor, three dimensional environmental data; generate, via the processor, a first three dimensional interactive environment based on the three dimensional environmental data; receive, via the processor, inventory data comprising a measurable quantity from an inventory registry; determine, via the processor, one or more virtual interfaces for presenting within the first three dimensional interactive environment, wherein the one or more virtual interfaces are determined based on the inventory data and the three dimensional environmental data, and wherein each of the one or more virtual interfaces comprises an execution component configured to generate execution data and a virtual experience portal configured to transform from the first three dimensional interactive environment to a second three dimensional interactive environment, the second three dimensional interactive environment comprising a virtual simulation associated with a sense stimuli module of the interactive device, wherein the virtual simulation is associated with an experiential item based on the inventory data and a virtual simulation experiential environment associated with the experiential item; output, via the processor, to a display of the interactive device, the first three dimensional interactive environment and the one or more virtual interfaces, wherein the execution component associated with each of the one or more virtual interfaces comprises an execution component status generated based on the measurable quantity of the inventory data; receive, via the processor, user input data generated in association with user engagement of the interactive device; in circumstances where the user input data indicates user engagement with the execution component of the one or more virtual interfaces, store, via the processor, the associated execution data to a user execution registry, and update, via the processor, the measurable quantity associated with the inventory data; and in circumstances where the user input data indicates user engagement with the virtual experience portal of the one or more virtual interfaces, generate, via the processor, the second three dimensional interactive environment based on the three dimensional environment data and the user input data, trigger, via the processor, the sense stimuli module of the interactive device for simulating user senses associated with the virtual simulation, and output, via the processor, to the display the second three dimensional interactive environment comprising the virtual simulation; and transform the display from the first three dimensional interactive environment to the second three dimensional interactive environment. ### Claim 24 (depends on 23) The computer program product of claim 23, further configured to generate, by communication circuitry, a network connection with other interactive devices the interactive device to other interactive devices; substantially simultaneously output, to respective displays of the interactive device and the other interactive devices, by the interactive device and other interactive devices shared first or second three dimensional interactive environment. ### Claim 25 (depends on 23) The computer program product of claim 23, wherein three dimensional environment data comprises profile data. ### Claim 26 (depends on 23) The computer program product of claim 23, further configured to receive relevance data from a relevance system, wherein the three dimensional environment data comprises the relevance data. ### Claim 27 (depends on 23) The computer program product of claim 23, wherein the execution component status of the one or more virtual interfaces is an in-stock status, an out-of-stock status, or a purchasable amount determined based on the measurable quantity of the inventory data. ### Claim 28 (depends on 23) The computer program product of claim 23, further configured to receive, via the processor, audio data; compare, via the process, received audio data with data in a sensor database; activate, by the processor, the execution component based on the comparison. ### Claim 29 (depends on 23) The computer program product of claim 23, further configured to generate, via the processor, the second three dimensional interactive environment based on item data. ### Claim 30 (depends on 29) The computer program product of claim 29, wherein item data comprises user feedback data. ### Claim 31 (depends on 23) The computer program product of claim 23, wherein the second three dimensional interactive environment comprises the virtual simulation of a part of a least one of: a vacation, a concert, or a trip. ### Claim 32 (depends on 23) The computer program product of claim 23, wherein the second three dimensional interactive environment comprises a virtual rendering of a good. ### Claim 33 (depends on 23) The computer program product of claim 23, wherein the sense stimuli module of the interactive device comprises an audio generator, an odor generator, a haptic generator, a heater or a fan.