Back to results
US 10,896,549 B1Granted
System for multimedia spatial annotation, visualization, and recommendation
AssigneeOccipital, Inc.
InventorsJeffrey Powers, Vikas Reddy, Alex Schiff
Life of this patent
Estimating the term…
Abstract
A system configured to provide a three-dimensional representation of a physical environment. The three-dimensional representation including annotation data associated with particular objects and/or viewpoints of the three-dimensional representation. In some cases, the viewpoints may be rendered using image data associated with a photograph captured from a corresponding viewpoint within the physical environment.
Claims20
A method comprising:
- obtaining a first plurality of photos of a first environment, individual photos of the first plurality of photos having a different view of the first environment, a first photo of the first plurality of photos having an associated first camera pose and first annotation data, the first annotation data having a first trajectory;
- generating a first three-dimensional (3D) model of the first environment from first model data including the first plurality of photos of the environment;
- associating the first annotation data with a first object within the 3D model;
- positioning the first annotation data within a first viewpoint of the 3D model of the first environment and with respect to the first object based on the first trajectory, the first trajectory associated with a first motion path of the first camera pose at a first time that the first annotation data is captured and the first viewpoint displayed to a user from a point of view based on the first camera pose;
- obtaining a second plurality of photos of a second environment, individual photos of the second plurality of photos having a different view of the second environment, a second photo of the second plurality of photos having a second associated camera pose and second annotation data, the second annotation data having a second trajectory;
- generating a second 3D model of the second environment from second model data including the second plurality of photos of the second environment;
- associating the second annotation data with a second object within the 3D model;
- positioning the second annotation data within a second viewpoint of the 3D model of the second environment and with respect to the second object based on the second trajectory, the second trajectory associated with a second motion path of the second camera pose at a second time that the second annotation data is captured and the second viewpoint displayed to a user from a point of view based on the second camera pose;
- determining that the first environment is adjacent to the second environment;
- generating a third 3D model including the first environment and the second environment;
- and
- generating a walkthrough of a third environment reparented by the third 3D model, the walkthrough including the first viewpoint and the second viewpoint and transitioning the user through the first viewpoint and the second viewpoint along a fixed path, the fixed path based at least in part on the first trajectory and the second trajectory.
9 more elements
A method comprising:
- receiving a first set of image data, the first set of image data associated with a first room of a first environment;
- generating a first three-dimensional (3D) model of the first room from first model data including the first set of image data;
- receiving a second set of image data, the second set of image data associated with a second room of a second environment;
- generating a second 3D model of the second room from second model data including the second set of image data;
- determining that a third environment includes the first environment and the second environment;
- determining that the first 3D model and the second 3D model are adjacent within the third environment;
- determining a first doorway of the first 3D model and a second doorway of the second 3D model;
- and
- aligning, based at least in part on the first doorway of the first 3D model and the second doorway of the second 3D model, the first 3D model with the second 3D model to generate a third 3D model representative of the combination of the first room and the second room.
6 more elements
A method comprising:
- obtaining first image data of a first environment, the first image data including a first plurality of photos of the first environment;
- generating a first three-dimensional (3D) representation of the environment using the first image data, the first 3D representation of the first environment having a first plurality of viewpoints from which a user may view the 3D representation of the first environment, a perspective of each viewpoint of the first plurality of viewpoints corresponding to a perspective of at least one of the first plurality of photos;
- obtaining second image data of an environment, the second image data including a second plurality of photos of the second environment;
- generating a second three-dimensional (3D) representation of the second environment using the second image data, the second 3D representation of the second environment having a second plurality of viewpoints from which the user may view the second 3D representation of the second environment, a perspective of each viewpoint of the second plurality of viewpoints corresponding to a perspective of at least one of the second plurality of photos;
- determining that the first environment is adjacent to the second environment;
- and
- generating a walkthrough of a third 3D representation of a third environment from the first plurality of viewpoints and the second plurality of viewpoints, the walkthrough transitions the user through first plurality of viewpoints and the second plurality of viewpoints along a fixed path, the third environment including the first environment and the second environment.
4 more elements
Dependencies are inferred from the claim text.