Method of pose estimation and model refinement for video representation of a three dimensional scene
AssigneeSarnoff Corporation
InventorsHarpreet Singh Sawhney, Rakesh Kumar, Steve Hsu, Supun Samarasekera
Life of this patent
Estimating the term…
Loading patent…
AssigneeSarnoff Corporation
InventorsHarpreet Singh Sawhney, Rakesh Kumar, Steve Hsu, Supun Samarasekera
Estimating the term…
The present invention is embodied in a video flashlight method. This method creates virtual images of a scene using a dynamically updated three-dimensional model of the scene and at least one video sequence of images. An estimate of the camera pose is generated by comparing a present image to the three-dimensional model. Next, relevant features of the model are selected based on the estimated pose. The relevant features are then virtually projected onto the estimated pose and matched to features of the image. Matching errors are measured between the relevant features of the virtual projection and the features of the image. The estimated pose is then updated to reduce these matching errors. The model is also refined with updated information from the image. Meanwhile, a viewpoint for a virtual image is selected. The virtual image is then created by projecting the dynamically updated three-dimensional model onto the selected virtual viewpoint.
A method for accurately estimating a pose of a camera within a scene using a three dimension model of the scene, comprising the steps of:
A method for accurately estimating a pose of an image of a scene using a three dimension model of the scene, comprising the steps of:
A method for refining a three dimensional model of a scene using an image of the scene taken by a camera having an unknown pose, comprising the steps of:
A method for accurately estimating a position of remote vehicle using a three dimension model and an image from a camera having a known orientation relative to the remote vehicle, comprising the steps of:
A method for refining a three dimension model of a scene containing an object using a plurality of images of the scene, each image including the object, comprising the steps of:
A method for refining a three dimension model of a scene containing an object using a plurality of images of the scene, each image including the object, comprising the steps of:
A method for creating a hybrid three dimension model of a scene using a plurality of images of the scene, comprising the steps of:
A method for creating a textured three dimension model of a scene using a plurality of images of the scene, comprising the steps of:
A method for creating a dynamic sequence of virtual images of a scene using a dynamically updated three dimension model of the scene, comprising the steps of:
A computer readable medium adapted to instruct a general purpose computer to update a three dimensional model of a scene using the three dimensional model of the scene, an image received from a camera having an unknown pose, the method comprising the steps of:
An automatic three-dimensional model updating apparatus for accurately estimating a point of view of an image of a scene, relative to a three-dimensional model of the scene, and updating the three-dimensional model comprising:
Dependencies are inferred from the claim text.