Mixing and simulcasting extended reality content
AssigneeMXR Holdings LLC
InventorEric Wagliardo
Life of this patent
Estimating the term…
Abstract
The disclosed system pertains to the generation, mixing, and simulcasting of extended reality (XR) content in real-time. The system includes a first data input source providing live data and a server computer. The server computer receives the live data and user input, enabling a user to select and configure at least one three-dimensional (3D) graphical object. The server computer renders a simulcast comprising a composite of the live data and an animation of the 3D graphical object, and outputs the simulcast to at least one display device. The live data can be video broadcast data, live performance video data, motion capture data, location data, or audio data. The animation is responsive to changes in the live data.
Claims17
A system for mixing and simulcasting extended reality content, comprising:
- a first data input source configured to provide live data;
- a server computer including a mixer module comprising a node system, a real-time render pipeline, and a multi-user simulcast input/output interface, the server computer configured to:
- receive the live data from the first data input source;
- receive user input, via the mixer module, that enables a user to select at least one three-dimensional (3D) graphical object and configure at least one characteristic of the 3D graphical object by connecting, in the node system, the live data to the at least one characteristic, wherein a data manager routes serialized data streams produced by the node system to the at least one characteristic without requiring code execution within functions of the 3D graphical object;
- render, in the real-time render pipeline, a simulcast comprising a composite of the live data and a generative animation of the at least one 3D graphical object, the generative animation being responsive in real-time to changes in the live data provided via the node system;
- and
- output, via the multi-user simulcast input/output interface, the simulcast simultaneously to a plurality of display devices including at least one conventional display and at least one extended reality display.
A method for mixing and simulcasting extended reality content, comprising the steps of:
- receiving live data from a first data input source;
- via a server-hosted mixer module comprising a node system, receiving user input that enables a user to select at least one three-dimensional (3D) graphical object and to configure at least one characteristic of the 3D graphical object by connecting, in the node system, the live data to the at least one characteristic, wherein a data manager serializes the live data into one or more data streams and routes the one or more data streams to the at least one characteristic without requiring code execution within functions of the 3D graphical object;
- providing the routed one or more data streams to a real-time render pipeline and rendering a simulcast comprising a composite of the live data and a generative animation of the at least one 3D graphical object, the generative animation being responsive in real time to changes in the live data;
- and
- simultaneously outputting, via a multi-user simulcast input/output interface, the simulcast to a plurality of display devices including at least one conventional display and at least one extended reality display.
Dependencies are inferred from the claim text.