Generating three-dimensional content from two-dimensional images

A system comprising:

• one or more processors coupled to a memory;
• a processing module stored in the memory and executable by the one or more processors, the processing module operable to receive two-dimensional video streams from a plurality of cameras, the two-dimensional video streams including multiple angles of a live event;
• a machine learning module stored in the memory and executable by the one or more processors, the machine learning module operable to generate a machine learning model to determine boundaries of the live event from the two-dimensional video streams and identify a location of a live object during the live event;
• a tracking module stored in the memory and executable by the one or more processors, the tracking module operable to, based on the machine learning model, identify one or more players in the live event, identify one or more social network profiles that correspond to the one or more players in the live event, and identify poses of each of the one or more players during the live event;
• a simulation module stored in the memory and executable by the one or more processors, the simulation module operable to, based on the machine learning model, generate a three-dimensional model of the live event based on the boundaries of the live event, the location of the live object during the live event, and the poses of each of the one or more players during the live event and generate a simulation of the three-dimensional model;
• and
• a user interface module stored in memory and executable by the one or more processors, the user interface module operable to provide a presentation of the simulation of the three-dimensional model as an augmentation of real-world content in a cross-reality view presented to a user, the real-world content including a presentation of the live event that is different from the presentation of the simulation of the three-dimensional model in the cross-reality view;
• wherein the user interface module is operable to provide, together with the presentation of the simulation of the three-dimensional model and as an additional augmentation of the real-world content in the cross-reality view presented to the user, a presentation of one or more links to the one or more social network profiles of the one or more players and a presentation of an additional three-dimensional model, the additional three-dimensional model being of buttons for controlling the presentation of the simulation.

A non-transitory computer storage medium encoded with instructions that, when executed by one or more processors, cause the one or more processors to perform operations comprising:

• receiving two-dimensional video streams from a plurality of cameras, the two-dimensional video streams including multiple angles of a live event;
• determining boundaries of the live event from the two-dimensional video streams;
• identifying a location of a live object during the live event;
• identifying one or more players in the live event;
• identifying poses of each of the one or more players during the live event;
• identifying the one or more social network profiles that correspond to the one or more players in the live event;
• generating a three-dimensional model of the live event based on the boundaries of the live event, the location of the live object during the live event, and the poses of each of the one or more players during the live event;
• generating a simulation of the three-dimensional model;
• providing a presentation of the simulation of the three-dimensional model as an augmentation of real-world content in a cross-reality view presented to a user, the real-world content including a presentation of the live event that is different from the presentation of the simulation of the three-dimensional model in the cross-reality view;
• and
• providing, together with the presentation of the simulation of the three-dimensional model and as an additional augmentation of the real-world content in the cross-reality view presented to the user, a presentation of one or more links to the one or more social network profiles of the one or more players and a presentation of an additional three-dimensional model, the additional three-dimensional model being of buttons for controlling the presentation of the simulation.