Systems and methods for providing real-time composite video from multiple source devices featuring augmented reality elements
OwnerRussell Holmesinventor
Life of this patent
Estimating the term…
Abstract
Systems and methods for superimposing the human elements of video generated by computing devices, wherein a first user device implemented as a mixed reality headset and second user device capture and transmit video to a central server which analyzes the video to identify and extract human elements, superimpose these human elements upon one another, adds in at least one augmented reality element, and then transmits the newly created superimposed video back to at least one of the user devices.
Claims31
A computer-implemented system for superimposing video using a first user device used by a first user and a second user device used by a second user, wherein the first user device includes (i) a front display screen, and (ii) a rear facing camera, and wherein the second user device includes (i) a front display screen, and (ii) a front facing camera, and wherein the front facing camera of the first user device faces the first user while the first user is viewing the front display screen of the first user device, and wherein the rear facing camera of the first user faces away from the first user while the first user is viewing the front display screen of the first user device, and wherein the front facing camera of the second user device faces the second user while the second user is viewing the front display screen of the second user device, and wherein the rear facing camera of the second user faces away from the second user while the second user is viewing the front display screen of the second user device, the system comprising:
- (a) a detection algorithm configured to identify and extract human elements in real-time video;
- and
- (b) a processor configured to:
- (i) receive real-time video captured by the front facing camera of the second user device,
- (ii) identify and extract a human element of the second user in the real-time video captured by the front facing camera of the second user device using the detection algorithm,
- (iii) receive real-time video captured by the rear facing camera of the first user device,
- (iv) identify and extract a human element of the first user in the real-time video captured by the rear facing camera of the first user device using the detection algorithm,
- (v) superimpose the identified and extracted human elements of the first user and the second user upon one another to create a superimposed video containing overlapping human elements from the first user and the second user, thereby giving a visual impression of physical interaction between the first user and the second user, and
- (vi) electronically provide the superimposed video to at least one of the first user device and the second user device for viewing on the front display screen of the respective first user device and/or the second user device.
A computer-implemented method for superimposing video using a first user device used by a first user and a second user device used by a second user, wherein the first user device includes (i) a front display screen, and (ii) a rear facing camera, and wherein the second user device includes (i) a front display screen, and (ii) a front facing camera, and wherein the front facing camera of the first user device faces the first user while the first user is viewing the front display screen of the first user device, and wherein the rear facing camera of the first user faces away from the first user while the first user is viewing the front display screen of the first user device, and wherein the front facing camera of the second user device faces the second user while the second user is viewing the front display screen of the second user device, and wherein the rear facing camera of the second user faces away from the second user while the second user is viewing the front display screen of the second user device, the method comprising:
- (a) receiving by a processor real-time video captured by the front facing camera of the second user device;
- (b) identifying and extracting a human element of the second user in the real-time video captured by the front facing camera of the second user device using a detection algorithm configured to identify and extract human elements in real-time video;
- (c) receiving by the processor real-time video captured by the rear facing camera of the first user device;
- (d) identifying and extracting a human element of the first user in the real-time video captured by the rear facing camera of the first user device using the detection algorithm;
- (e) superimposing by the processor the identified and extracted human elements of the first user and the second user upon one another to create a superimposed video containing overlapping human elements from the first user and the second user, thereby giving a visual impression of physical interaction between the first user and the second user;
- and
- (f) electronically providing by the processor the superimposed video to at least one of the first user device and the second user device for viewing on the front display screen of the respective first user device and/or the second user device.
A computer-implemented system for superimposing video using a first user device used by a first user and a second user device used by a second user, wherein the first user device is a virtual reality (VR) headset and includes (i) a front display screen, and (ii) a rear facing camera, and wherein the second user device includes (i) a front display screen, and (ii) a front facing camera, and wherein the front display screen of the first user device faces the first user while the first user is viewing the front display screen of the first user device, and wherein the rear facing camera of the first user faces away from the first user while the first user is viewing the front display screen of the first user device, and wherein the second user device is a smartphone or tablet, and wherein the front facing camera of the second user device faces the second user while the second user is viewing the front display screen of the second user device, the system comprising:
- (a) a detection algorithm configured to identify and extract human elements in real-time video;
- and
- (b) a processor configured to:
- (i) receive real-time video captured by the front facing camera of the second user device, wherein the real-time video captured by the front facing camera of the second user device includes real-time video of the second user,
- (ii) receive real-time video captured by the rear facing camera of the first user device,
- (iii) identify and extract a human element of the first user in the real-time video captured by the rear facing camera of the first user device using the detection algorithm,
- (iv) superimpose the identified and extracted human elements of the first user and the real-time video of the second user upon one another to create a real-time superimposed video containing overlapping human elements from the first user and the real-time video of the second user, thereby giving a visual impression of physical interaction between the first user and the second user, and
- (v) electronically provide the real-time superimposed video to the first user device for viewing on the front display screen of the first user device.
A computer-implemented method for superimposing video using a first user device used by a first user and a second user device used by a second user, wherein the first user device is a virtual reality (VR) headset and includes (i) a front display screen, and (ii) a rear facing camera, and wherein the second user device includes (i) a front display screen, and (ii) a front facing camera, and wherein the front display screen of the first user device faces the first user while the first user is viewing the front display screen of the first user device, and wherein the rear facing camera of the first user faces away from the first user while the first user is viewing the front display screen of the first user device, and wherein the second user device is a smartphone or tablet, and wherein the front facing camera of the second user device faces the second user while the second user is viewing the front display screen of the second user device, the method comprising:
- (a) receiving by a processor real-time video captured by the front facing camera of the second user device, wherein the real-time video captured by the front facing camera of the second user device includes real-time video of the second user;
- (b) receiving by the processor real-time video captured by the rear facing camera of the first user device;
- (c) identifying and extracting a human element of the first user in the real-time video captured by the rear facing camera of the first user device using a detection algorithm that is configured to identify and extract human elements in real-time video;
- (d) superimposing by the processor the identified and extracted human elements of the first user and the real-time video of the second user upon one another to create a real-time superimposed video containing overlapping human elements from the first user and the real-time video of the second user, thereby giving a visual impression of physical interaction between the first user and the second user;
- and
- (e) electronically providing by the processor the real-time superimposed video to the first user device for viewing on the front display screen of the first user device.
Dependencies are inferred from the claim text.