Back to results
US 10,944,959 B2Granted
Automated spatial indexing of images to video
AssigneeOpen Space Labs, Inc.
InventorsMichael Ben Fleischman, Philip DeCamp, Jeevan James Kalanithi
Life of this patent
Estimating the term…
Abstract
A spatial indexing system receives a video that is a sequence of frames depicting an environment, such as a floor of a construction site, and performs a spatial indexing process to automatically identify the spatial locations at which each of the images were captured. The spatial indexing system also generates an immersive model of the environment and provides a visualization interface that allows a user to view each of the images at its corresponding location within the model.
Claims20
A method comprising:
- receiving, from a mobile device comprising a first camera, a plurality of images each comprising an image timestamp, the images captured by the first camera of the mobile device as the mobile device is moved through an environment;
- receiving, from a video capture system, a video comprising a sequence of frames, each frame associated with a frame timestamp, the video recorded by a second camera of the video capture system as the video capture system is moved through the environment;
- generating an estimated camera path of the video capture system representative of the movement of the video capture system through the environment, the estimated camera path specifying, for frames in the sequence of frames, a position of the frames relative to one or more reference points;
- and
- associating the images of the plurality of images with locations along the estimated camera path based on the image timestamps captured by the first camera and the frame timestamps captured by the video capture system.
2 more elements
A system comprising:
- a processor;
- and
- a non-transitory computer readable storage medium comprising computer program instructions that when executed by the processor, cause the processor to:
- receive, from a mobile device comprising a first camera, a plurality of images each comprising an image timestamp, the images captured by the first camera of the mobile device as the mobile device is moved through an environment;
- receive, from a video capture system, a video comprising a sequence of frames, each frame associated with a frame timestamp, the video recorded by a second camera of the video capture system as the video capture system is moved through the environment;
- generate an estimated camera path of the video capture system representative of the movement of the video capture system through the environment, the estimated camera path specifying, for frames in the sequence of frames, a position of the frames relative to one or more reference points;
- and
- associate the images of the plurality of images with locations along the estimated camera path based on the image timestamps captured by the first camera and the frame timestamps captured by the video capture system.
5 more elements
Dependencies are inferred from the claim text.