# US 2018/0025753 A1 · Immersive virtual reality production and playback for storytelling content > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2018/0025753 A1 - Document ID: US20180025753A1 - Status: Published application - Kind: A1 - Application number: 15/717,561 - Filed: 2017-09-27 - Published: 2018-01-25 - Earliest claimed: 2014-12-05 - Assignees: Warner Bros. Entertainment Inc. - Applicants: Warner Bros. Entertainment, Inc. - Inventors: Gregory I. Gewickey; Lewis S. Ostrover; Michael Smith; Michael Zink - Web page: https://patentgrep.com/patent/US20180025753A1 ## CPC - G11B 27/036: Insert-editing - G11B 27/031: Electronic editing of digitised analogue information signals, e.g. audio or video signals - G11B 27/11: by using information not detectable on the record carrier - H04N 13/117: the virtual viewpoint locations being selected by the viewers or determined by viewer tracking - H04N 13/25: using two or more image sensors with different characteristics other than in their location or field of view, e.g. having different resolutions or colour pickup characteristics; using image signals from one sensor to control the characteristics of another sensor - H04N 13/344: with head-mounted left-right displays - H04N 13/388: Volumetric displays, i.e. systems where the image is built up from picture elements distributed through a volume - G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract Methods for digital content production and playback of an immersive stereographic video work provide or enhance interactivity of immersive entertainment using various different playback and production techniques. “Immersive stereographic” may refer to virtual reality, augmented reality, or both. The methods may be implemented using specialized equipment for immersive stereographic playback or production. Aspects of the methods may be encoded as instructions in a computer memory, executable by one or more processors of the equipment to perform the aspects. ## Claims ### Claim 1 A method for controlling a display of an immersive stereographic content display apparatus, the method comprising: processing, by a processor of the apparatus, sensor data from at least one sensor coupled to the processor during performance of a immersive stereographic video work playing on the apparatus for a user; determining, during the performance, a virtual position of a region of visual focus in a virtual environment defined by the immersive stereographic video work, based on the sensor data; and controlling output of the apparatus in response to the determining. ### Claim 2 (depends on 1) The method of claim 1, wherein the controlling output comprises adjusting at least one of a depth of focus of the region of visual focus or an apparent focal length on a display of the immersive stereographic content display apparatus, based on the sensor data indicating that the region of visual focus exists. ### Claim 3 (depends on 2) The method of claim 2, wherein adjusting at least one of the depth of focus or apparent focal length comprises transitioning from a deep focus to a shallow focus, holding the shallow focus for a period of time, and then transitioning back to a deep focus. ### Claim 4 (depends on 2) The method of claim 2, wherein adjusting at least one of the depth of focus or apparent focal length comprises shifting a focus point from an original depth towards a foreground object, holding the focus point on the foreground object for a period of time, and then shifting the focus point to a predetermined depth. ### Claim 5 (depends on 2) The method of claim 2, wherein adjusting at least one of the depth of focus or apparent focal length comprises shifting a focus point from an original depth towards a background object, holding the focus point on the background object for a period of time, and then shifting the focus point to a predetermined depth. ### Claim 6 (depends on 2) The method of claim 2, wherein adjusting at least one of the depth of focus or apparent focal length comprises changing the apparent focal length from an initial length to a second length, holding the apparent focal length at the second length for a period of time, and then changing the apparent focal length to a predetermined length. ### Claim 7 (depends on 2) The method of claim 2, wherein adjusting at least one of the depth of focus or apparent focal length comprises at least one of constructing and displaying a video segment based on photogrammetry metadata of the immersive stereographic video work for the predetermined period, or displaying prerecorded video segments characterized by an adjusted depth of focus or focal length for the predetermined period. ### Claim 8 (depends on 1) The method of claim 1, wherein determining the virtual position of the region of visual focus comprises processing the sensor data indicating at least one of a user head orientation, a user eye orientation, or a user eye surface shape. ### Claim 9 (depends on 8) The method of claim 8, further comprising receiving the sensor data from the sensor comprising at least one of: an image sensor, an accelerometer, an interferometer, or a microphone. ### Claim 10 (depends on 1) The method of claim 1, wherein the determining the virtual position of the region of visual focus comprises sensing that the user is viewing a limited portion of the display for a qualifying period of time, based on the sensor data. ### Claim 11 (depends on 1) The method of claim 1, wherein controlling the output comprises selecting a video segment from a plurality of possible video segments, wherein each of the possible video segments depicts a different narrative element of a story line. ### Claim 12 (depends on 1) The method of claim 1, wherein controlling the output comprises selecting a video segment from a plurality of possible video segments, wherein each of the possible video segments depicts an event happening at a corresponding one of different locations of the virtual environment. ### Claim 13 (depends on 1) The method of claim 1, wherein controlling the output comprises driving an audio transducer with a signal that produces a directional cue indicating a direction of interest for the user. ### Claim 14 (depends on 13) The method of claim 13, wherein the directional cue is selected from the group consisting of spoken language or a sound field configured to be perceived as originating from a particular location of the virtual environment. ### Claim 15 An apparatus for controlling a display of an immersive stereographic content display apparatus, the apparatus comprising a processor coupled to a memory and to at least one sensor, the memory holding program instructions that when executed by the processor cause the apparatus to perform: processing sensor data from at least one sensor coupled to the processor during performance of a immersive stereographic video work playing on the apparatus for a user; determining, during the performance, a virtual position of a region of visual focus in a virtual environment defined by the immersive stereographic video work, based on the sensor data; and controlling output of the apparatus in response to the determining. ### Claim 16 (depends on 15) The apparatus of claim 15, wherein the memory holds further instructions for controlling the output at least in part by adjusting at least one of a depth of focus of the region of visual focus or an apparent focal length on a display of the immersive stereographic content display apparatus, based on the sensor data indicating that the region of visual focus exists. ### Claim 17 (depends on 15) The apparatus of claim 15, wherein the memory holds further instructions for determining the virtual position of the region of visual focus at least in part by processing the sensor data indicating at least one of a user head orientation, a user eye orientation, or a user eye surface shape. ### Claim 18 (depends on 15) The apparatus of claim 15, wherein the memory holds further instructions for determining the virtual position of the region of visual focus at least in part by sensing that the user is viewing a limited portion of the display for a qualifying period of time, based on the sensor data. ### Claim 19 (depends on 15) The apparatus of claim 15, wherein the memory holds further instructions for controlling the output at least in part by selecting a video segment from a plurality of possible video segments, wherein each of the possible video segments depicts a different narrative element of a story line. ### Claim 20 (depends on 15) The apparatus of claim 15, wherein the memory holds further instructions for controlling the output at least in part by driving an audio transducer with a signal that produces a directional cue indicating a direction of interest for the user.