Back to results
US 2026/0196005 A1Published application
Systems and methods for providing real-time composite video from multiple source devices featuring augmented reality elements
OwnerRussell Holmesinventor
Life of this patent
Estimating the term…
Abstract
Systems and methods for superimposing the human elements of video generated by computing devices, wherein a first user device implemented as a mixed reality headset and second user device capture and transmit video to a central server which analyzes the video to identify and extract human elements, superimpose these human elements upon one another, adds in at least one augmented reality element, and then transmits the newly created superimposed video back to at least one of the user devices.
Claims20
A computer-implemented method of superimposing video carried out by at least a first processor of a first user device and a second processor of a second user device, the method comprising the steps of:
- receiving a first live video from the first user device comprising a mixed reality headset, the first live video including video of a first human element of a first user captured by a camera of the first user device, wherein the first user is simultaneously viewing a display of the mixed reality headset while the video of the first human element of the first user is being captured by the camera of the first user device;
- receiving a second video from the second user device, the second video including video of a second user, wherein at least one of the first live video and the second video is a volumetric video;
- identifying the first human element of the first user from the first live video using a detection algorithm;
- combining a virtual human element representing the first human element of the first user with a portion, or all, of the second video to create a first superimposed video including the virtual human element representing the first human element of the first user captured by the camera of the first user device from the first live video and a second human element of the second user from the second video;
- displaying the first superimposed video on the screen of the mixed reality headset;
- wherein the location of the virtual human element representing the first human element captured by the camera of the first user device and displayed on the screen of the mixed reality headset within the first superimposed video is directly controlled by the position of the first human element relative to the location of the camera of the first user device;
- and wherein the first user views the first superimposed video on the screen of the mixed reality headset while the video of the first human element of the first user is being captured by the camera of the first user device and the first user moves the virtual human element representing the first human element into a chosen position relative to the second human element in the superimposed video.
4 more elements
A computer-implemented system for superimposing video, comprising:
- a first user device comprising a mixed reality headset having a camera, a screen, processor, memory, and networking interface;
- a second user device featuring a camera, processor, memory, and networking interface;
- wherein the first user device's processor is configured to:
- receive a first live video from the first user device, the first live video including video of a first human element of a first user captured by a camera of the first user device, wherein the first user is simultaneously viewing a front facing display of the first user device while the video of the first human element of the first user is being captured by the camera of the first user device, and a second video from a second user device, the second video including video of a second user, wherein at least one of the first live video and the second video is a volumetric video;
- identify a first human element of the first user from the first live video using a detection algorithm comprising determination of positional parameters;
- combine a virtual human element representing the first human element of the first user with at least a portion of the second video to create a first superimposed video including the virtual human element representing the first human element of the first user captured by the camera of the first user device from the first live video and a second human element of the second user captured by the camera of the second user device from the second video;
- and display the first superimposed video on the screen of the mixed reality headset, wherein the location of the first human element of the first user or the virtual human element representing the first human element captured by the camera of the first user device that is displayed on the screen of the mixed reality headset within the first superimposed video is directly controlled by the position of the first human element relative to the location of the camera of the first user device;
- and wherein the first user views the first superimposed video on the screen of the mixed reality headset while the video of the first human element of the first user is being captured by the camera of the first user device and the first user moves the first human element into a chosen position relative to the second human element in the superimposed video.
5 more elements
Dependencies are inferred from the claim text.