# US 12,002,164 B2 · Authoring and presenting 3D presentations in augmented reality > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,002,164 B2 - Document ID: US12002164B2 - Status: Granted - Kind: B2 - Application number: 17/384,514 - Filed: 2021-07-23 - Published: 2022-05-19 - Granted: 2024-06-04 - Earliest claimed: 2018-01-26 - Assignees: Microsoft Technology Licensing, LLC - Applicants: Microsoft Technology Licensing, LLC - Inventors: Darren Alexander Bennett; David J. W. Seymour; Charla M. Pereira; Enrico William Guld; Kin Hang Chu; Julia Faye Taylor-Hell; Jonathon Burnham Cobb; Helen Joan Hem Lam; You-Da Yang; Dean Alan Wadsworth; Andrew Jackson Klein - Web page: https://patentgrep.com/patent/US12002164B2 ## CPC - G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)} - G02B 27/0172: {characterised by optical features} - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object - G06Q 10/00: Administration; Management - G06Q 10/10: Office automation; Time management - G06T 13/20: Three-dimensional [3D] animation - G06T 17/20: Finite element generation, e.g. wire-frame surface description, {tesselation} - G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts - G02B 2027/0138: {comprising image capture systems, e.g. camera} - G02B 2027/014: {comprising information/image processing systems} - G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)} - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR ## Abstract Various methods and systems are provided for authoring and presenting 3D presentations. Generally, an augmented or virtual reality device for each author, presenter and audience member includes 3D presentation software. During authoring mode, one or more authors can use 3D and/or 2D interfaces to generate a 3D presentation that choreographs behaviors of 3D assets into scenes and beats. During presentation mode, the 3D presentation is loaded in each user device, and 3D images of the 3D assets and corresponding asset behaviors are rendered among the user devices in a coordinated manner. As such, one or more presenters can navigate the scenes and beats of the 3D presentation to deliver the 3D presentation to one or more audience members wearing augmented reality headsets. ## Claims ### Claim 1 A method for spatially authoring three dimensional (“3D”) presentations, the method comprising: generating a virtual 3D environment comprising a virtual representation of one or more 3D assets, wherein the virtual 3D environment is generated in an authoring mode associated with a 3D interface that supports spatial authoring including aligning one or more 3D assets relative to a physical space based on scenes and behaviors, wherein, in the authoring mode, each of the scenes predefines a particular arrangement of the one or more 3D assets and the corresponding behaviors in the physical space for rendering in a presentation mode; generating a 3D presentation, wherein the 3D presentation comprises the scenes and the behaviors of the one or more 3D assets in alignment with the physical space, wherein the 3D presentation is associated with the 3D interface; and providing the 3D presentation for rendering of the scenes including 3D images of the one or more 3D assets and the corresponding behaviors. ### Claim 2 (depends on 1) The method of claim 1, wherein the 3D presentation is configured to facilitate a selectively rendered 3D virtual image of a gaze heat map indicating a concentration of audience gaze vectors. ### Claim 3 (depends on 1) The method of claim 1, wherein behavior parameters for the behaviors are set in association with temporary ownership of corresponding 3D assets. ### Claim 4 (depends on 1) The method of claim 1, additionally comprising: including in the 3D presentation a toggled scrubbable animation of a first of the 3D images to enable one of a plurality of audience devices to update a current state of an associated one of the one or more 3D assets to scrub the animation; and providing for distributing the current state substantially in real-time to facilitate coordinated rendering of the scrubbable animation. ### Claim 5 (depends on 1) The method of claim 1, additionally comprising: toggling a spatial storyboarding mode to enable one or more author devices to record a 3D drawing using a 3D interface; and distributing the 3D drawing to facilitate coordinated rendering of the 3D drawing, wherein the 3D drawing comprises one or more segments capable of being replaced with a corresponding one of the one or more 3D assets. ### Claim 6 (depends on 1) The method of claim 1, additionally comprising including in the 3D presentation a 3D volumizer animation, wherein the 3D volumizer animation is a 3D visualization comprising 3D image replicates of a selected 3D model, wherein the 3D volumizer animation is configured to visually illustrate data based on first behavior parameters for a first collection of the one or more 3D assets, wherein the first behavior parameters comprise the selected 3D model and a selected quantity of the 3D image replicates of the 3D model to be generated for the first collection. ### Claim 7 (depends on 1) The method of claim 1: wherein a first of the behaviors is configured to permit an audience device to influence a coordinated rendering of a data visualization based on a location of the audience device; and wherein a first one of the 3D images comprises the data visualization. ### Claim 8 One or more computer storage media storing computer-useable instructions that, when used by one or more computing devices, cause the one or more computing devices to perform operations comprising: generating a virtual three-dimensional (“3D”) environment comprising a virtual representation of one or more 3D assets, wherein the virtual 3D environment is generated in an authoring mode associated with a 3D interface that supports spatial authoring including aligning one or more 3D assets relative to a physical space based on scenes and behaviors, wherein, in the authoring mode, each of the scenes predefines a particular arrangement of the one or more 3D assets and the corresponding behaviors in the physical space for rendering in a presentation mode; receiving a 3D presentation, wherein the 3D presentation comprises the scenes and the behaviors of the one or more 3D assets in alignment with the physical space, wherein the 3D presentation is associated with the 3D interface; and providing the 3D presentation for rendering of the scenes including 3D images of the one or more 3D assets and the corresponding behaviors. ### Claim 9 (depends on 8) The media of claim 8, wherein the operations additionally comprise providing for selective rendering, by the presenter device, of a 3D virtual image of a gaze heat map indicating a concentration of audience gaze vectors associated with the audience devices. ### Claim 10 (depends on 8) The media of claim 8, wherein behavior parameters for the behaviors are set in association with temporary ownership of corresponding 3D assets. ### Claim 11 (depends on 8) The media of claim 8, wherein the operations additionally comprise: toggling a scrubbed animation of a first of the 3D images to enable one or more audience devices to update a current state of an associated one of the one or more 3D assets to scrub the animation; and distributing the current state substantially in real-time to facilitate coordinated rendering of the scrubbed animation. ### Claim 12 (depends on 8) The media of claim 8, wherein the operations additionally comprise: toggling a drawing with light mode to enable an audience device to record a time-dependent 3D drawing using a 3D interface; and distributing the 3D drawing substantially in real-time to facilitate coordinated rendering of the 3D drawing. ### Claim 13 (depends on 8) The media of claim 8, wherein the operations additionally comprise triggering a 3D volumizer animation, wherein the 3D volumizer animation is a 3D visualization comprising 3D image replicates of a selected 3D model, wherein the 3D volumizer animation is configured to visually illustrate data based on first behavior parameters for a first collection of the one or more 3D assets, wherein the first behavior parameters comprise the selected 3D model, a selected quantity of the 3D image replicates of the 3D model to be generated for the first collection, and physics to be applied to the replicates. ### Claim 14 (depends on 8) The media of claim 8: wherein a first of the behaviors is configured to permit at least one audience device to influence a coordinated rendering of a data visualization based on a location of the at least one audience device; and additionally comprising triggering a first one of the 3D images comprising the data visualization. ### Claim 15 A computer system comprising: one or more hardware processors and memory configured to provide computer program instructions to the one or more hardware processors; a three-dimensional (“3D”) environment generator configured to utilize the one or more hardware processors to generate a virtual 3D environment comprising a virtual representation of one or more 3D assets, wherein the virtual 3D environment is generated in an authoring mode associated with a 3D interface that supports spatial authoring including aligning one or more 3D assets relative to a physical space based on scenes and behaviors, wherein, the authoring mode, each of the scenes predefines a particular arrangement of the one or more 3D assets and the corresponding behaviors in the physical space for rendering in a presentation mode; an authoring component configured to utilize the one or more hardware processors to generate a 3D presentation, wherein the 3D presentation comprises the scenes and the behaviors of the one or more 3D assets in alignment with the physical space, wherein the 3D presentation is associated with the 3D interface; and a presentation component configured to utilize the one or more hardware processors to provide the 3D presentation for rendering of the scenes including 3D images of the one or more 3D assets and the corresponding behaviors. ### Claim 16 (depends on 15) The computer system of claim 15, wherein the presentation component is additionally configured to selectively render a 3D virtual image of a gaze heat map indicating a concentration of audience gaze vectors. ### Claim 17 (depends on 15) The computer system of claim 15, wherein the presentation component is additionally configured to: toggle a scrubbed animation of a first of the 3D images to enable an audience device to update a current state of an associated one of the one or more 3D assets to scrub the animation; and receive the current state substantially in real-time to facilitate coordinated rendering of the scrubbed animation. ### Claim 18 (depends on 15) The computer system of claim 15, wherein the presentation component is additionally configured to: toggle a drawing with light mode to enable one or more author devices to record a time-dependent 3D drawing using a 3D interface and to enable capturing an associated audio recording; and receive the 3D drawing and the associated audio recording to facilitate coordinated playback of the 3D drawing and the associated audio recording, wherein the playback of the 3D drawing comprises visualization trails that do not disappear. ### Claim 19 (depends on 15) The computer system of claim 15, wherein the presentation component is additionally configured to trigger a 3D volumizer animation, wherein the 3D volumizer animation is a 3D visualization comprising 3D image replicates of a selected 3D model, wherein the 3D volumizer animation is configured to visually illustrate data based on first behavior parameters for a first collection of the one or more 3D assets, wherein the first behavior parameters comprise the selected 3D model, a selected quantity of the 3D image replicates of the 3D model to be generated for the first collection, and an idle animation to be applied to the 3D image replicates. ### Claim 20 (depends on 15) The computer system of claim 15: wherein a first of the behaviors is configured to permit one of the audience devices to influence a coordinated rendering of a data visualization based on a location of the audience device; wherein the presentation component is additionally configured to trigger a first one of the 3D images comprising the data visualization.