US 10,873,709 B2 · Systems and methods for automatic detection and insetting of digital streams into a 360-degree video

Abstract

Systems and methods for automatic detection and insetting of digital streams into a 360 video. Various examples of such regions of interest to the user include, without limitation, content displayed on various electronic displays or written on electronic paper (electronic ink), content projected on various surfaces using electronic projectors, content of paper documents appearing in the 360-degree video and/or content written on white (black) boards inside the 360-degree video. For some content, such as whiteboards, paper documents or paintings in a museum, a participant (or curator) could have taken pictures of the regions, again stored digitally somewhere and available for download. These digital streams with content of interest to the user are obtained and then inset onto the 360-degree view generated from the raw 360-degree video feed, giving users the ability to view them at their native high resolution.

Claims16

Dependent claims

A system comprising:

at least one camera for acquiring a 360-degree video of an environment;
and
at least one processor executing instruction stored in a memory to:
detect a person in the 360-degree video using object recognition within the 360 degree video;
identify an inset candidate region within the acquired 360-degree video that is in proximity to the detected person;
select a digital media content based on facial recognition of the detected person located in proximity to the identified inset candidate region;
and
inset the digital media content into the identified inset candidate region.

5 more elements

Dependencies are inferred from the claim text.

Systems and methods for automatic detection and insetting of digital streams into a 360-degree video

Life of this patent

Systems and methods for automatic detection and insetting of digital streams into a 360-degree video

Life of this patent

Abstract

Claims16