# US 2013/0155047 A1 · Image three-dimensional (3d) modeling > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2013/0155047 A1 - Document ID: US20130155047A1 - Status: Published application - Kind: A1 - Application number: 13/325,466 - Filed: 2011-12-14 - Published: 2013-06-20 - Earliest claimed: 2011-12-14 - Assignees: Microsoft Corporation - Inventors: Samuel Williams; Jett Evan Jones; Peter G. Sibley; Don Kim; Sandeep Kanumuri; Jonathan Rosenberg - Web page: https://patentgrep.com/patent/US20130155047A1 ## CPC - G06T 3/40: Scaling of whole images or parts thereof, e.g. expanding or contracting - G06T 3/4038: Image mosaicing, e.g. composing plane images from plane sub-images - G06T 7/30: Determination of transform parameters for the alignment of images, i.e. image registration - G06T 15/205: {Image-based rendering} - G06T 17/00: Three-dimensional [3D] modelling for computer graphics - G06T 2207/10028: Range image; Depth image; 3D point clouds - G06T 2207/30252: Vehicle exterior; Vicinity of vehicle - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract Among other things, one or more techniques and/or systems are disclosed for creating a three-dimensional model of an image. Image data, comprise a series of images of a location, such as along a route, can be received. The image data can comprise a first image element location for a first image element, where the first image element location may correspond to a three-dimensional point in the image, such as a location in the image with a depth from a point of observation. The first image element can be segmented into a first façade plane using the first image element location. The first façade plane can be merged with a second façade plane, resulting in a three-dimensional model of the image. The second façade plane can comprise a second image element, where the image data comprises a second image element location for the second image element. ## Claims ### Claim 1 A computer-based method for creating a three-dimensional model of an image, comprising: receiving image data comprising a first image element location for a first image element in the image data, the first image element location corresponding to a three-dimensional point in the image; segmenting the first image element into a first façade plane based at least upon the first image element location, at least a portion of the segmenting performed by a computer-based processor; and merging the first façade plane with a second façade plane resulting in the three-dimensional model of the image, the second façade plane comprising at least a second image element, the image data comprising a second image element location for the second image element. ### Claim 2 (depends on 1) The method of claim 1, comprising identifying the first image element location, comprising determining the three-dimensional point in the image based at least upon a two-dimensional image location for the first image element and an image element depth for the first image element. ### Claim 3 (depends on 2) The method of claim 2, comprising determining the two-dimensional image location based at least upon a two-dimensional image element coordinate location in the image. ### Claim 4 (depends on 2) The method of claim 2, comprising determining the image element depth based at least upon one or more of: detection and ranging data collected at image capture; stereoscopic estimation using at least two images respectively comprising different views; and surface modeling of a location comprised by the image. ### Claim 5 (depends on 1) The method of claim 1, segmenting comprising one or more of: grouping the first image element with one or more first façade image elements, the first façade image elements corresponding to a first viewable portion of an object face at a first desired depth in the image; and grouping the second image element with one or more second façade image elements, the second façade image elements corresponding to a second viewable portion of an object face at a second desired depth in the image. ### Claim 6 (depends on 1) The method of claim 1, the first façade plane comprised at a first desired façade depth corresponding to an image element depth for the first image element. ### Claim 7 (depends on 6) The method of claim 6, the merging comprising merging the first façade plane at the first desired façade depth with the second façade plane at a second desired façade depth. ### Claim 8 (depends on 7) The method of claim 7, comprising rendering a planar panorama such that the first façade plane moves at a first speed and the second façade plane moves at a second speed during panning. ### Claim 9 (depends on 1) The method of claim 1, comprising merging one or more façade planes from the image with one or more façade planes from a second image. ### Claim 10 (depends on 9) The method of claim 9, comprising rendering a planar panorama using one or more merged façade planes, the planar panorama comprising a first composite view from a first view point and a second composite view from a second view point. ### Claim 11 (depends on 1) The method of claim 1, the merging comprising combining the three-dimensional point for the first image element location with a three-dimensional point for the second image element location. ### Claim 12 (depends on 1) The method of claim 1, comprising rendering a planar panorama using the three-dimensional model of the image. ### Claim 13 A system for creating a three-dimensional model of an image, comprising: a computer-based processor configured to process data for the system; a segmentation component, operably coupled with the processor, configured to segment a first image element into a first façade plane based at least upon a first image element location, for the first image element, comprised in received image data, the first image element location corresponding to a three-dimensional point in the image; and a merging component, operably coupled with the segmentation component, configured to merge the first façade plane with a second façade plane resulting in the three-dimensional model of the image, the second façade plane comprising at least a second image element corresponding to a second image element location. ### Claim 14 (depends on 13) The system of claim 13, comprising an image element location determination component configured to determine the three-dimensional point in the image based at least upon a two-dimensional image location for the first image element and an image element depth for the first image element. ### Claim 15 (depends on 14) The system of claim 14, the two-dimensional image location based at least upon a two-dimensional image element coordinate location in the image. ### Claim 16 (depends on 14) The system of claim 14, the image element location determination component configured to determine the image element depth based at least upon one or more of: detection and ranging data collected at image capture; stereoscopic estimation using at least two images respectively comprising different views; and dense surface mapping of a location comprised by the image. ### Claim 17 (depends on 13) The system of claim 13, the segmentation component configured to segment the first image element into the first façade plane comprised at a first desired façade depth corresponding to an image element depth for the first image element. ### Claim 18 (depends on 17) The system of claim 17, the merging component configured to merge the first façade plane at the first desired façade depth with the second façade plane at a second desired façade depth. ### Claim 19 (depends on 18) The system of claim 18, comprising a rendering component configured to render a planar panorama such that the first façade plane moves at a first speed and the second façade plane moves at a second speed during panning. ### Claim 20 A computer readable medium comprising computer executable instructions that when executed via a processor perform a method for creating a three-dimensional model of an image, comprising: receiving image data comprising a first image element location for a first image element in the image data, the first image element location corresponding to a three-dimensional point in the image; segmenting the first image element into a first façade plane based at least upon the first image element location; and merging the first façade plane with a second façade plane resulting in the three-dimensional model of the image, the second façade plane comprising at least a second image element, the second façade plane comprising at least a second image element, the image data comprising a second image element location for the second image element.