Back to results
US 10,706,624 B1Granted
Three-dimensional room model generation using panorama paths with augmented reality guidance
AssigneeAmazon Technologies, Inc.
InventorsJoonhao Chuah, Dillon Baker, Kristian Kane, Hai Quang Kim, Brian Mount, Michael Thomas
Life of this patent
Estimating the term…
Abstract
Systems and methods related to augmented reality guidance for an image capture process using panorama paths may include presenting various text, cues, and indications to guide the image capture process. A user device including an imaging sensor and position and orientation sensors may present, via a display, the various text, cues, and indications during portions of the image capture process, including a plurality of image capture locations, imaging sensor sweep guides, textual instructions, arrows, and position guides.
Claims20
A computer-implemented method, comprising:
- receiving, from an imaging sensor of a user device, imaging data including at least a portion of a room within a field of view of the imaging sensor;
- presenting, via a display of the user device, the imaging data including at least the portion of the room within the field of view of the imaging sensor;
- presenting, via the display of the user device and overlaying the imaging data including at least the portion of the room, an indication to move the user device towards individual locations of a plurality of locations of a panorama path within the room in a defined order, wherein the indication to move comprises at least one of an arrow or a textual cue associated with individual locations;
- receiving, from a sensor of the user device, movement data of the user device towards individual locations of the room in the defined order;
- capturing, via the imaging sensor and during movement of the user device towards individual locations in the defined order, a first plurality of images of the room during the movement of the user device towards individual locations;
- receiving, from the sensor of the user device, position and orientation data of the user device associated with respective ones of the first plurality of images captured during the movement of the user device towards individual locations;
- at individual locations of the plurality of locations, presenting, via the display of the user device and overlaying the imaging data including at least the portion of the room, an indication to orient the user device to place a starting point for image capture within the field of view of the imaging sensor of the user device, wherein the indication to orient comprises at least one of an arrow or a textual cue associated with the starting point;
- at individual locations of the plurality of locations, receiving, from the sensor of the user device, movement data of the user device to orient the user device to place the starting point for image capture within the field of view of the imaging sensor of the user device;
- responsive to placing the starting point for image capture within the field of view of the imaging sensor, at individual locations of the plurality of locations, presenting, via the display of the user device and overlaying the imaging data including at least the portion of the room, an indication to sweep the user device in a defined direction, wherein the indication to sweep comprises at least one of an arrow, a textual cue, or a progress bar;
- at individual locations of the plurality of locations, capturing, via the imaging sensor of the user device, a second plurality of images of the room during sweep of the user device in the defined direction;
- receiving, from the sensor of the user device, position and orientation data of the user device associated with respective ones of the second plurality of images captured during sweep of the user device;
- and
- generating a three-dimensional model of the room based on the first plurality of images, the second plurality of images, the position and orientation data of the user device associated with respective ones of the first plurality of images, and the position and orientation data of the user device associated with respective ones of the second plurality of images.
10 more elements
A method, comprising:
- receiving, from a first sensor associated with a user device, imaging data including at least a portion of a space within a field of view of the first sensor;
- presenting, via a display associated with the user device and overlaying at least a portion of the field of view, an indication to move the user device towards a first location of a plurality of locations within the space, wherein the indication to move comprises at least one of an arrow or a textual cue associated with the first location;
- receiving, from a second sensor associated with the user device, movement data of the user device towards the first location;
- capturing, via the first sensor and during movement of the user device towards the first location, a first plurality of images of the space during the movement of the user device towards the first location;
- receiving, from the second sensor associated with the user device, data associated with position and orientation of the user device associated with respective ones of the first plurality of images captured during the movement of the user device towards the first location;
- capturing, via the first sensor and responsive to the user device being positioned at the first location, a second plurality of images of the space during sweep of the user device at the first location;
- and
- causing a three-dimensional model of the space to be generated based on the first plurality of images, the second plurality of images, and the data associated with position and orientation of the user device associated with respective ones of the first plurality of images.
5 more elements
A system, comprising:
- a user device, comprising:
- a display;
- a first sensor;
- a second sensor;
- and
- a processor configured to at least:
- receive, from the first sensor, imaging data including at least a portion of a space within a field of view of the first sensor;
- present, via the display and overlaying the field of view, an indication to move the user device towards a first location of a plurality of locations within the space, wherein the indication to move comprises at least one of an arrow or a textual cue associated with the first location;
- receive, from the second sensor, movement data of the user device towards the first location;
- capture, via the first sensor and during movement of the user device towards the first location, a first plurality of images of the space during the movement of the user device towards the first location;
- receive, from the second sensor, data associated with position and orientation of the user device associated with respective ones of the first plurality of images captured during the movement of the user device towards the first location;
- capture, via the first sensor and responsive to the user device being positioned at the first location, a second plurality of images of the space during sweep of the user device at the first location;
- and
- cause a three-dimensional model of the space to be generated based on the first plurality of images, the second plurality of images, and the data associated with position and orientation of the user device associated with respective ones of the first plurality of images.
11 more elements
Dependencies are inferred from the claim text.