# US 2022/0284668 A1 · Estimating dimensions of geo-referenced ground-level imagery using orthogonal imagery > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2022/0284668 A1 - Document ID: US20220284668A1 - Status: Published application - Kind: A1 - Application number: 17/751,567 - Filed: 2022-05-23 - Published: 2022-09-08 - Earliest claimed: 2013-10-25 - Assignees: Hover Inc. - Applicants: Hover Inc. - Inventors: Bo Hu; Sarthak Sahu - Web page: https://patentgrep.com/patent/US20220284668A1 ## CPC - G06T 17/00: Three-dimensional [3D] modelling for computer graphics - G06T 1/0007: {Image acquisition} - G06T 7/75: {involving models} - G06T 17/20: Finite element generation, e.g. wire-frame surface description, {tesselation} - G06T 2207/10004: Still image; Photographic image - G06T 2210/04: Architectural design, interior design - G06T 2219/012: Dimensioning, tolerancing - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract A system and method is provided for measurements of building facade elements by combining ground-level and orthogonal imagery. The measurements of the dimension of building facade elements are based on ground-level imagery that is scaled and geo-referenced using orthogonal imagery. The method continues by creating a tabular dataset of measurements for one or more architectural elements such as siding (e.g., aluminum, vinyl, wood, brick and/or paint), windows or doors. The tabular dataset can be part of an estimate report. ## Claims ### Claim at position 1 -11. (canceled) ### Claim 12 One or more non-transitory computer-readable media storing instructions that, when executed by a system comprising one or more processors, cause the one or more processors to perform operations comprising: collecting, using a smartphone, a plurality of ground-level images capturing all sides of a single building; determining a location for the plurality of ground-level images; generating an outline of a plurality of facades associated with all sides of the single building shown within the ground-level images to assist in generation of a three-dimensional building model of the single building; generating the three-dimensional building model based on the outlined plurality of facades associated with all sides of the single building, wherein the generating the three-dimensional building model includes at least correlation and rectification of the outlined plurality of facades and representing points of the single building projected in three-dimensional space; retrieving a geo-referenced top-view orthogonal image of the single building based on the determined location of at least one of the plurality of ground-level images; deriving a scale as between all points of the three-dimensional building model by geo-referencing all points of the three-dimensional building model using the geo-referenced top-view orthogonal image by correlating the geo-referenced top-view orthogonal image to include matching at least two points of the three-dimensional building model to corresponding roof pixels in the geo-referenced top-view orthogonal image and identifying those matches as being part of a same feature within the three-dimensional building model of the single building; measuring, on the scaled three-dimensional building model, between at least one starting georeferenced point and at least one ending geo-referenced point to determine dimensions of one or more architectural elements, the dimensions including at least width and height of the one or more architectural elements, located within at least a first facade of the geo-referenced three-dimensional building model; and labeling the architectural element within the scaled three-dimensional building model, the labeling representing the determined dimensions. ### Claim 13 (depends on 12) The one or more non-transitory computer-readable media of claim 12, wherein the one or more architectural elements comprise windows. ### Claim 14 (depends on 12) The one or more non-transitory computer-readable media of claim 12, wherein the one or more architectural elements comprise doors. ### Claim 15 (depends on 12) The one or more non-transitory computer-readable media of claim 12, further comprising creating a tabular dataset of measurements for one or more architectural elements and their respective determined measurements. ### Claim 16 (depends on 15) The one or more non-transitory computer-readable media of claim 15, wherein the tabular dataset comprises one or more of default ones of the architectural elements or selectable ones of the architectural elements. ### Claim 17 (depends on 15) The one or more non-transitory computer-readable media of claim 15, wherein the tabular dataset comprises one or more portions of an estimate report. ### Claim 18 (depends on 17) The one or more non-transitory computer-readable media of claim 17, wherein the one or more portions of an estimate report are modified using product data. ### Claim 19 (depends on 15) The one or more non-transitory computer-readable media of claim 15, wherein the tabular dataset comprises measurements for siding. ### Claim 20 (depends on 15) The one or more non-transitory computer-readable media of claim 15, wherein the tabular dataset comprises measurements for paint. ### Claim 21 (depends on 12) The one or more non-transitory computer-readable media of claim 12, wherein the measuring is conducted interactively by repeated selecting of at least one starting geo-referenced point and at least one ending geo-referenced point. ### Claim 22 One or more non-transitory computer-readable media storing instructions that, when executed by a system comprising one or more processors, cause the one or more processors to perform operations comprising: collecting, using a smartphone, a plurality of ground-level images capturing all sides of a single building; determining a location for the plurality of ground-level images; generating an outline of a plurality of facade shown within the ground-level images of all sides of the single building to assist in generation of a three-dimensional building model of the single building; generating the three-dimensional building model based on the outlined plurality of facades, wherein the generating the three-dimensional building model includes at least correlation and rectification of the outlined plurality of facades and representing points of the single building projected in three-dimensional space; retrieving a geo-referenced top-view orthogonal image of the single building based on the determined location of at least one of the plurality of ground-level images; deriving a scale as between all points of the three-dimensional building model by geo-referencing all points within the three-dimensional building model by matching at least two points of the three-dimensional building model associated with at least one outlined facade to corresponding roof pixels in the geo-referenced top-view orthogonal image; measuring, on the scaled three-dimensional building model, between at least one starting georeferenced point and at least one ending geo-referenced point to determine dimensions of one or more architectural elements located within the plurality of facades; and labeling the one or more architectural element with the determined dimensions. ### Claim 23 (depends on 22) The one or more non-transitory computer-readable media of claim 22, wherein the one or more architectural elements comprise windows. ### Claim 24 (depends on 22) The one or more non-transitory computer-readable media of claim 22, wherein the one or more architectural elements comprise doors. ### Claim 25 (depends on 22) The one or more non-transitory computer-readable media of claim 22, further comprising creating a tabular dataset of measurements for one or more architectural elements and their respective determined measurements. ### Claim 26 (depends on 25) The one or more non-transitory computer-readable media of claim 25, wherein the tabular dataset comprises one or more of default ones of the architectural elements or selectable ones of the architectural elements. ### Claim 27 (depends on 25) The one or more non-transitory computer-readable media of claim 25, wherein the tabular dataset comprises one or more portions of an estimate report. ### Claim 28 (depends on 27) The one or more non-transitory computer-readable media of claim 27, wherein the one or more portions of an estimate report are modified using product data. ### Claim 29 (depends on 25) The one or more non-transitory computer-readable media of claim 25, wherein the tabular dataset comprises measurements for siding. ### Claim 30 (depends on 25) The one or more non-transitory computer-readable media of claim 25, wherein the tabular dataset comprises measurements for paint. ### Claim 31 (depends on 22) The one or more non-transitory computer-readable media of claim 22, wherein the measuring is conducted interactively by repeated selecting of at least one starting geo-referenced point and at least one ending geo-referenced point.