Methods and system for generating and displaying 3d videos in a virtual, augmented, or mixed reality environment
AssigneeMagic Leap, Inc.
InventorsPraveen BABU J D, Sean Christopher RILEY
Life of this patent
Estimating the term…
Abstract
Disclosed is an approach for displaying 3D videos in a VR and/or AR system. The 3D videos may include 3D animated objects that escape from the display screen. The 3D videos may interact with objects within the VR and/or AR environment. The 3D video may be interactive with a user such that based on user input corresponding to decisions elected by the user at certain portions of the 3D video such that a different storyline and possibly a different conclusion may result for the 3D video. The 3D video may be a 3D icon displayed within a portal of a final 3D render world.
Claims20
A computer implemented method of displaying interactive 3D video in a virtual and/or augmented reality environment, the method comprising:
- identifying a 3D video as a stream of non-executable data periodically interrupted by decision nodes;
- receiving one or more interactions from a user as input corresponding to decisions elected by the user;
- and
- rendering the 3D video based at least on the decisions elected by the user.
A virtual and/or augmented reality display system comprising:
- a camera to capture a virtual and/or augmented reality environment;
- and
- a module for processing data, wherein the module is stored in a memory, the module when executed, performs a process of:
- identifying a 3D video as a stream of non-executable data periodically interrupted by decision nodes,
- receiving one or more interactions from a user as input corresponding to decisions elected by the user, and
- rendering the 3D video based at least on the decisions elected by the user.
A computer system implementing a mixed reality video player, comprising:
- a computer processor to execute a set of program code instructions;
- and
- a memory to hold the program code instructions, in which the program code instructions comprises program code to perform:
- receiving a video file of a video, the video file comprising
- one or more animation streams;
- a data store comprising control data;
- and
- at least one of a video stream or an audio stream;
- dynamically generating a control stream from the control data and a timeline controller;
- requesting a user interaction answering a question displayed to the user at a point in time of the video;
- receiving an answer to the question via the user interaction;
- notifying a timeline controller of the answer;
- skipping to an appropriate portion of the video corresponding to the answer;
- and
- displaying the video from the appropriate portion.
Dependencies are inferred from the claim text.