Back to results
US 2022/0028173 A1Published application
System and method for populating a virtual crowd in real time using augmented and virtual reality
AssigneeSilver Spoon Animation Inc.
InventorRotem Shiffman
Life of this patent
Estimating the term…
Abstract
The present disclosure describes a software-based solution for rendering digital crowds in real-time. The system at large is a network of machines that processes and ingests broadcast camera feeds and tracking data and then leverages an augmented reality system for compositing and tracking platforms to render tens of thousands of crowd members on top of live footage.
Claims20
A system for rendering virtual or digital crowds in real-time, the system comprising:
- a computing device comprising at least an application, a memory, a storage device and a graphical user interface (GUI), wherein the application is configured to:
- map a venue of a first location hosting an event in a three-dimensional (3D) view;
- receive data from one or more cameras in a second location, wherein the data comprises tracking data of one or more users in the second location;
- process the data;
- and
- transmit the processed data to an augmented reality system;
- the augmented reality system being configured to:
- receive the processed data;
- combine the processed data with additional data to form digital crowd members;
- and
- place the digital crowd members into the 3D view of venue;
- an operator configured to engage the GUI to manipulate the digital crowd members;
- and
- a transmission control protocol (TCP) network configured to propagate commands of the operator to render machines in real-time.
11 more elements
A method executed by a system for rendering virtual or digital crowds in real-time, the method comprising:
- mapping, via a processor of a computing device via a light detection and ranging (LiDar) remote sensing method, a venue of a first location hosting an event in a three-dimensional (3D) view, wherein the venue comprises a stadium or a sporting arena;
- receiving, by the processor, data from one or more cameras in a second location, wherein the data comprises tracking data of one or more users in the second location;
- processing, by the processor, the data;
- transmitting, by the processor, the processed data to an augmented reality system;
- receiving, by the augmented reality system, the processed data;
- combining, by the augmented reality system, the processed data with additional data to form digital crowd members;
- placing, by the augmented reality system, the digital crowd members into the 3D view of the venue;
- engaging, by an operator, a graphical user interface (GUI) of the computing device to manipulate the digital crowd members;
- and
- propagating, by a transmission control protocol (TCP) network, commands of the operator to render machines in real-time.
7 more elements
A computer system comprising:
- one or more processors;
- one or more memories;
- and
- one or more computer-readable hardware storage devices, wherein the one or more computer-readable hardware storage devices contain program code executable by the one or more processors via the one or more memories to implement a method for rendering virtual or digital crowds in real-time, the method comprising:
- mapping, via a light detection and ranging (LiDar) remote sensing method, a venue of a first location hosting an event in a three-dimensional (3D) view, wherein the venue comprises a stadium or a sporting arena;
- receiving data from one or more cameras in a second location, wherein the data comprises tracking data of one or more users in the second location;
- processing the data;
- transmitting the processed data to an augmented reality system, wherein the augmented reality system is configured to:
- receive the processed data;
- combine the processed data with additional data to form digital crowd members;
- and
- place the digital crowd members into the 3D view of the venue;
- engaging, by an operator, a graphical user interface (GUI) to manipulate the digital crowd members;
- and
- propagating, by a transmission control protocol (TCP) network, commands of the operator to render machines in real-time.
12 more elements
Dependencies are inferred from the claim text.