# US 2018/0025752 A1 · Methods and Systems for Customizing Immersive Media Content > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2018/0025752 A1 - Document ID: US20180025752A1 - Status: Published application - Kind: A1 - Application number: 15/284,330 - Filed: 2016-10-03 - Published: 2018-01-25 - Earliest claimed: 2016-07-22 - Assignees: Zeality Inc. - Applicants: Zeality Inc. - Inventors: Dipak Mahendra Patel; Arlene Joy Ganancial Santos; Scott Riley Collins; Bryan Daniel Bor; Adam Mark Dubov; Timothy George Harington, II - Web page: https://patentgrep.com/patent/US20180025752A1 ## CPC - G11B 27/036: Insert-editing - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour - G06F 3/04847: Interaction techniques to control parameter settings, e.g. interaction with sliders or dials - G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback} - G11B 27/32: on separate auxiliary tracks of the same or an auxiliary record carrier - G11B 27/34: Indicating arrangements {(indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D)} - H04N 5/765: Interface circuits between an apparatus for recording and another apparatus - H04N 5/77: between a recording apparatus and a television camera - H04N 9/8211: {the additional signal being a sound signal (H04N9/835 takes precedence)} - H04N 9/8715: {involving the mixing of the reproduced video signal with a non-recorded signal, e.g. a text signal} - H04N 21/816: {involving special video data, e.g 3D video} - H04N 23/698: for achieving an enlarged field of view, e.g. panoramic image capture - G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R) - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract A computing system has memory, a microphone, and an image sensor. A process displays an immersive media customization user interface, and plays a 360 video. In response to a first user action, the process captures a freeze frame of the 360 video at a specific moment. In response to a second user action, the process starts recording a customized video of the captured freeze frame in real time according to a dynamically adjustable visibility window of the captured freeze frame. While recording the customized video, a user adjusts the visibility window. After recording, a user annotates the customized video, including one or more of: adding a visual overlay in a portion of the customized video, where the visual overlay is a recorded video of the user; adding an audio overlay (e.g., user comments); and adding text or an image. The process transmits the customized video to another computing system. ## Claims ### Claim 1 A method for customizing immersive media content, comprising: at a computing device having one or more processors, memory, a microphone, and an image sensor: displaying an immersive media customization user interface; playing a 360 video in a first region of the user interface; in response to a first user action, capturing a freeze frame of the 360 video at a specific moment; in response to a second user action, beginning recording of a customized video of the captured freeze frame in real time according to a dynamically adjustable visibility window of the captured freeze frame; while recording the customized video, receiving user input to adjust the visibility window; in response to a third user action, ending recording of the customized video; annotating the customized video, including one or more of: (a) adding a visual overlay in a peripheral portion of the customized video, wherein the visual overlay comprises a recorded video of the user captured by the image sensor; (b) adding an audio overlay that comprises recorded audio captured using the microphone; and (c) adding a visual annotation comprising text or an image; transmitting the customized video to a second computing device. ### Claim 2 (depends on 1) The method of claim 1, wherein annotating the customized video includes two or more of: (a) adding a visual overlay in a peripheral portion of the customized video, wherein the visual overlay comprises a recorded video of the user captured by the image sensor; (b) adding an audio overlay that comprises recorded audio captured using the microphone; and (c) adding a visual annotation comprising text or an image. ### Claim 3 (depends on 2) The method of claim 2, wherein annotating the customized video includes: (a) adding a visual overlay in a peripheral portion of the customized video, wherein the visual overlay comprises a recorded video of the user captured by the image sensor; and (b) adding an audio overlay that comprises recorded audio captured using the microphone. ### Claim 4 (depends on 3) The method of claim 3, wherein: the recorded audio captured using the microphone and recorded video captured by the image sensor are both captured while recording the customized video; and annotating the customized video comprises synchronizing the video overlay with the customized video and synchronizing the audio overlay with the customized video. ### Claim 5 (depends on 3) The method of claim 3, further comprising after recording the customized video, playing the customized video, wherein: the recorded audio captured using the microphone and recorded video captured by the image sensor are both captured while playing the customized video; and annotating the customized video comprises synchronizing the video overlay with the customized video and synchronizing the audio overlay with the customized video. ### Claim 6 (depends on 1) The method of claim 1, wherein the user input to adjust the visibility window comprises moving the computing device. ### Claim 7 (depends on 1) The method of claim 1, wherein the user input to adjust the visibility window comprises using a mouse pointer, finger gesture, hand gesture, arm gesture, or eye gesture. ### Claim 8 (depends on 1) The method of claim 1, wherein the user input to adjust the visibility window includes changing magnification of the visibility window. ### Claim 9 (depends on 1) The method of claim 1, wherein the user input to adjust the visibility window includes moving the visibility window. ### Claim 10 (depends on 1) The method of claim 1, wherein the customized video includes a frame-shaped portion of the captured freeze frame outside of the visibility window, wherein the frame-shaped portion of the captured freeze frame is displayed in an obfuscated manner. ### Claim 11 (depends on 1) The method of claim 1, wherein displaying in an obfuscated manner comprises displaying the frame-shaped portion as dimmed or unfocused. ### Claim 12 (depends on 1) The method of claim 1, wherein the customized video comprises the captured freeze frame and metadata that defines placement and magnification of the visibility window within the captured freeze frame. ### Claim 13 (depends on 1) The method of claim 1, wherein the customized video comprises a video stream from the captured freeze frame that includes only what was visible in the visibility window while playing the customized video. ### Claim 14 (depends on 1) The method of claim 1, wherein the customized video includes a visual annotation that is added within the customized video for a specified interval of time that is less than the duration of the customized video. ### Claim 15 (depends on 1) The method of claim 1, wherein the customized video includes a visual annotation that has a specified expiration date, thereby preventing display of the visual annotation during playback after the specified expiration date. ### Claim 16 (depends on 1) The method of claim 1, wherein annotating the customized video further comprises adding a pre-recorded audio track. ### Claim 17 A computer system, comprising: one or more processors; memory; a microphone; an image sensor; and one or more programs stored in the memory, configured for execution by the one or more processors, wherein the one or more programs include instructions for: displaying an immersive media customization user interface; playing a 360 video in a first region of the user interface; in response to a first user action, capturing a freeze frame of the 360 video at a specific moment; in response to a second user action, beginning recording of a customized video of the captured freeze frame in real time according to a dynamically adjustable visibility window of the captured freeze frame; while recording the customized video, receiving user input to adjust the visibility window; in response to a third user action, ending recording of the customized video; annotating the customized video, including one or more of: (a) adding a visual overlay in a peripheral portion of the customized video, wherein the visual overlay comprises a recorded video of the user captured by the image sensor; (b) adding an audio overlay that comprises recorded audio captured using the microphone; and (c) adding a visual annotation comprising text or an image; transmitting the customized video to a second computer system. ### Claim 18 (depends on 17) The computer system of claim 17, wherein annotating the customized video includes two or more of: (a) adding a visual overlay in a peripheral portion of the customized video, wherein the visual overlay comprises a recorded video of the user captured by the image sensor; (b) adding an audio overlay that comprises recorded audio captured using the microphone; and (c) adding a visual annotation comprising text or an image. ### Claim 19 (depends on 18) The computer system of claim 18, wherein annotating the customized video includes: (a) adding a visual overlay in a peripheral portion of the customized video, wherein the visual overlay comprises a recorded video of the user captured by the image sensor; and (b) adding an audio overlay that comprises recorded audio captured using the microphone; wherein: the recorded audio captured using the microphone and recorded video captured by the image sensor are both captured while recording the customized video; and annotating the customized video comprises synchronizing the video overlay with the customized video and synchronizing the audio overlay with the customized video. ### Claim 20 A non-transitory computer readable storage medium storing one or more programs configured for execution by one or more processors of a computer system that has a microphone and an image sensor, the one or more programs comprising instructions for: displaying an immersive media customization user interface; playing a 360 video in a first region of the user interface; in response to a first user action, capturing a freeze frame of the 360 video at a specific moment; in response to a second user action, beginning recording of a customized video of the captured freeze frame in real time according to a dynamically adjustable visibility window of the captured freeze frame; while recording the customized video, receiving user input to adjust the visibility window; in response to a third user action, ending recording of the customized video; annotating the customized video, including one or more of: (a) adding a visual overlay in a peripheral portion of the customized video, wherein the visual overlay comprises a recorded video of the user captured by the image sensor; (b) adding an audio overlay that comprises recorded audio captured using the microphone; and (c) adding a visual annotation comprising text or an image; transmitting the customized video to a second computer system.