Back to results
US 12,764,427 B2Granted
Floor plan construction system and method
AssigneeDolby Laboratories Licensing Corporation
InventorsPhilip Wootaek Shin, Janos Horvath, Guan-Ming Su
Life of this patent
Estimating the term…
Abstract
Novel methods and systems for creating a 2D floor plan visualization from video from sparse camera views, based on object recognition creating latent vectors for camera pose estimation. Estimated camera poses are converted to world coordinates, which are projected onto a 2D plane. These world coordinates can be used to form the 2D floor plan, useful for user interface implementation.
Claims19
A method to construct a 2D floor plan visualization based on views of a plurality of sparse cameras viewing one or more objects of interest, the method comprising:
- performing computer object detection on the one or more objects of interest for video from each of the plurality of sparse cameras;
- performing feature extraction from the computer object detection;
- performing feature aggregation on features of the feature extraction creating latent vectors;
- transforming the latent vectors to view features;
- estimating camera poses for each of the plurality of sparse cameras based on the view features;
- transforming the estimated camera poses into world coordinates;
- and
- constructing the 2D floor plan visualization based on the world coordinates.
5 more elements
A system, comprising:
- an object detection module configured to perform computer object detection from video data from a plurality of sparse cameras;
- a latent feature extraction module configured to convert data from the object detection module into latent vectors for views of each of the plurality of sparse cameras;
- a latent vector aggregation module configured to aggregate the latent vectors into aggregated latent vectors;
- a transformer module configured to convert the aggregated latent vectors into view features;
- a camera pose estimation module configured to estimate camera poses for each of the plurality of sparse cameras from the view features;
- and
- a single-frame floor plan construction module configured to construct a 2D floor plan visualization from the estimated camera poses.
4 more elements
Dependencies are inferred from the claim text.