# US 11,113,884 B2 · Techniques for immersive virtual reality experiences > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,113,884 B2 - Document ID: US11113884B2 - Status: Granted - Kind: B2 - Application number: 16/049,745 - Filed: 2018-07-30 - Published: 2020-01-30 - Granted: 2021-09-07 - Earliest claimed: 2018-07-30 - Assignees: Disney Enterprises, Inc. - Applicants: Disney Enterprises, Inc. - Inventors: Hambartsoum Demirchian; Madhura Pitale; Isaaca Seychelle Graetz Hoglen - Web page: https://patentgrep.com/patent/US11113884B2 ## CPC - G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)} - H04N 21/816: {involving special video data, e.g 3D video} - G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts - H04N 21/235: Processing of additional data, e.g. scrambling of additional data or processing content descriptors - H04N 21/2353: {specifically adapted to content descriptors, e.g. coding, compressing or processing of metadata} - H04N 21/2393: {involving handling client requests (scheduling or organising the servicing of application requests H04L67/60)} - H04N 21/4126: {The peripheral being portable, e.g. PDAs or mobile phones} - H04N 21/4312: {involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations} - H04N 21/435: Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream - H04N 21/44218: {Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV programme (methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45)} - H04N 21/4755: {for defining user preferences, e.g. favourite actors or genre (retrieval personalisation and generation of user profiles for the retrieval of video data G06F16/739; user profiles in network data switching protocols H04L67/306)} - H04N 21/6547: comprising parameters, e.g. for client setup - H04N 21/8146: {involving graphical data, e.g. 3D object, 2D graphics} - H04N 21/8586: {by using a URL (processing chained hypermedia data for information retrieval G06F16/94; information retrieval from the Internet by using URLs G06F16/955; URL in broadcast information H04H20/93; Web-based protocols H04L67/02)} - G06T 2219/2012: Colour editing, changing, or manipulating; Use of colour codes - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract Various embodiments of the invention disclosed herein provide techniques for generating a three-dimensional virtual environment. A 3D object/effects generator executing on a client device receives a media content item. The 3D object/effects generator receives content metadata associated with the media content item. The 3D object/effects generator generates at least a portion of a 3D virtual environment based on the content metadata. The 3D object/effects generator displays the media content item and the at least a portion of the 3D virtual environment on a display associated with a virtual reality device. ## Claims ### Claim 1 A computer-implemented method for generating a three-dimensional (3D) virtual environment, the method comprising: receiving a media content item; receiving content metadata associated with the media content item, wherein the content metadata specifies a character effect in which a character watches the media content item in a 3D virtual environment and, while watching the media content item, automatically interacts with a user in the 3D virtual environment by at least one of providing commentary about the media content item to the user, asking the user a question, or responding to the user based on at least one of a sound, a movement, or an input by the user; generating at least a portion of the 3D virtual environment based on the content metadata; and displaying the media content item and the at least a portion of the 3D virtual environment on a display associated with a virtual reality device. ### Claim 2 (depends on 1) The computer-implemented method of claim 1, wherein the content metadata further specifies an environment effect, and wherein generating the at least a portion of the 3D virtual environment based on the content metadata comprises: receiving a first parameter that includes at least one of an environment type or a uniform resource locater (URL) associated with the at least a portion of the 3D virtual environment; and applying the environment effect to the at least a portion of the 3D virtual environment based on the first parameter. ### Claim 3 (depends on 1) The computer-implemented method of claim 1, wherein generating the at least a portion of the 3D virtual environment based on the content metadata comprises: receiving a first parameter that includes at least one of a character type or a uniform resource locater (URL) associated with the character effect; and applying the character effect to the at least a portion of the 3D virtual environment based on the first parameter. ### Claim 4 (depends on 1) The computer-implemented method of claim 1, wherein the content metadata further specifies a color effect, and wherein generating the at least a portion of the 3D virtual environment based on the content metadata comprises: receiving a first parameter that includes at least one of a color value or a starting time; and applying the color effect to the at least a portion of the 3D virtual environment based on the first parameter. ### Claim 5 (depends on 1) The computer-implemented method of claim 1, wherein the content metadata further specifies a screen size effect, and wherein generating the at least a portion of the 3D virtual environment based on the content metadata comprises: receiving a first parameter that includes at least one of a size type or a starting time; and applying the screen size effect to a virtual screen included in the at least a portion of the 3D virtual environment based on the first parameter. ### Claim 6 (depends on 1) The computer-implemented method of claim 1, wherein the content metadata further specifies a 3D object effect, and wherein generating the at least a portion of the 3D virtual environment based on the content metadata comprises: receiving a first parameter that includes at least one of an effect type, a starting time, a duration, or a uniform resource locater (URL) associated with the 3D object effect; and applying the 3D object effect to a 3D object included in the at least a portion of the 3D virtual environment based on the first parameter. ### Claim 7 (depends on 1) The computer-implemented method of claim 1, wherein the at least a portion of the 3D virtual environment includes a virtual screen, and wherein displaying the media content item includes overlaying the media content item on the virtual screen. ### Claim 8 (depends on 1) The computer-implemented method of claim 1, wherein the at least a portion of the 3D virtual environment includes a 3D object that is related to the media content item. ### Claim 9 (depends on 1) The computer-implemented method of claim 1, further comprising: receiving a description of the at least a portion of the 3D virtual environment in a first format; and translating the description of the at least a portion of the 3D virtual environment into a second format that is native to the virtual reality device. ### Claim 10 A non-transitory computer-readable storage medium including instructions that, when executed by a processor, cause the processor to generate a three-dimensional (3D) virtual environment, by performing the steps of: receiving a media content item; receiving content metadata associated with the media content item, wherein the content metadata specifies a character effect in which a character watches the media content item in a 3D virtual environment and, while watching the media content item, automatically interacts with a user in the 3D virtual environment by at least one of providing commentary about the media content item to the user, asking the user a question, or responding to the user based on at least one of a sound, a movement, or an input by the user; generating at least a portion of the 3D virtual environment based on the content metadata; and displaying the media content item and the at least a portion of the 3D virtual environment on a display associated with a virtual reality device. ### Claim 11 (depends on 10) The non-transitory computer-readable storage medium of claim 10, wherein the content metadata further specifies an environment effect, and wherein generating the at least a portion of the 3D virtual environment based on the content metadata comprises: receiving a first parameter that includes at least one of an environment type or a uniform resource locater (URL) associated with the at least a portion of the 3D virtual environment; and applying the environment effect to the at least a portion of the 3D virtual environment based on the first parameter. ### Claim 12 (depends on 10) The non-transitory computer-readable storage medium of claim 10, wherein generating the at least a portion of the 3D virtual environment based on the content metadata comprises: receiving a first parameter that includes at least one of a character type or a uniform resource locater (URL) associated with the character effect; and applying the character effect to the at least a portion of the 3D virtual environment based on the first parameter. ### Claim 13 (depends on 10) The non-transitory computer-readable storage medium of claim 10, wherein the content metadata further specifies a color effect, and wherein generating the at least a portion of the 3D virtual environment based on the content metadata comprises: receiving a first parameter that includes at least one of a color value or a starting time; and applying the color effect to the at least a portion of the 3D virtual environment based on the first parameter. ### Claim 14 (depends on 10) The non-transitory computer-readable storage medium of claim 10, wherein the content metadata further specifies an environment vibration effect, and wherein generating the at least a portion of the 3D virtual environment based on the content metadata comprises: receiving a first parameter that includes at least one of a motion type or a starting time; and applying the environment vibration effect to the at least a portion of the 3D virtual environment based on the first parameter. ### Claim 15 (depends on 10) The non-transitory computer-readable storage medium of claim 10, wherein the content metadata further specifies a screen vibration effect, and wherein generating the at least a portion of the 3D virtual environment based on the content metadata comprises: receiving a first parameter that includes at least one of a motion type or a starting time; and applying the screen vibration effect to a virtual screen included in the at least a portion of the 3D virtual environment based on the first parameter. ### Claim 16 (depends on 10) The non-transitory computer-readable storage medium of claim 10, wherein the content metadata further specifies a screen location effect, and wherein generating the at least a portion of the 3D virtual environment based on the content metadata comprises: receiving a first parameter that includes at least one of a location type or a starting time; and applying the screen location effect to a virtual screen included in the at least a portion of the 3D virtual environment based on the first parameter. ### Claim 17 (depends on 10) The non-transitory computer-readable storage medium of claim 10, wherein the content metadata further specifies a screen size effect, and wherein generating the at least a portion of the 3D virtual environment based on the content metadata comprises: receiving a first parameter that includes at least one of a size type or a starting time; and applying the screen size effect to a virtual screen included in the at least a portion of the 3D virtual environment based on the first parameter. ### Claim 18 (depends on 10) The non-transitory computer-readable storage medium of claim 10, wherein the content metadata further specifies a 3D object effect, and wherein generating the at least a portion of the 3D virtual environment based on the content metadata comprises: receiving a first parameter that includes at least one of an effect type, a starting time, a duration, or a uniform resource locater (URL) associated with the 3D object effect; and applying the 3D object effect to a 3D object included in the at least a portion of the 3D virtual environment based on the first parameter. ### Claim 19 A computing device, comprising: a memory that includes a three-dimensional (3D) object/effects generator; and a processor that is coupled to the memory and, when executing the 3D object/effects generator, is configured to: receive a media content item from a content management server, receive, from the content management server, content metadata associated with the media content item, wherein the content metadata specifies a character effect in which a character watches the media content item in a 3D virtual environment and, while watching the media content item, automatically interacts with a user in the 3D virtual environment by at least one of providing commentary about the media content item to the user, asking the user a question, or responding to the user based on at least one of a sound, a movement, or an input by the user, and generate at least a portion of the 3D virtual environment based on the content metadata. ### Claim 20 (depends on 19) The computing device of claim 19, wherein the processor, when executing the 3D object/effects generator, is further configured to: receive a description of the at least a portion of the 3D virtual environment in a first format; and translate the description of the at least a portion of the 3D virtual environment into a second format that is native to a virtual reality device, wherein the memory further includes a native virtual reality engine, and the processor, when executing the native virtual reality engine, is configured to display, via the second format, the media content item and the at least a portion of the 3D virtual environment on a display associated with the virtual reality device.