# US 12,182,937 B2 · 3D building model materials auto-populator > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,182,937 B2 - Document ID: US12182937B2 - Status: Granted - Kind: B2 - Application number: 18/116,283 - Filed: 2023-03-01 - Published: 2023-06-29 - Granted: 2024-12-31 - Earliest claimed: 2013-07-23 - Assignees: Hover Inc. - Applicants: Hover Inc. - Inventors: Steven Caamano; Javier Cambon Sanjurjo; Derek Halliday - Web page: https://patentgrep.com/patent/US12182937B2 ## CPC - G06T 17/05: Geographic models - G06F 3/14: Digital output to display device {; Cooperation and interconnection of the display device with other functional units} - G06Q 30/0283: Price estimation or determination - G06Q 30/0633: {Managing shopping lists, e.g. compiling or processing purchase lists (shipping orders G06Q10/083; order filling G06Q10/087)} - G06T 15/04: Texture mapping - G06T 15/20: Perspective computation - G06T 17/00: Three-dimensional [3D] modelling for computer graphics - G06T 19/00: Manipulating three-dimensional [3D] models or images for computer graphics - G06T 19/003: {Navigation within 3D models or images} - G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts - G06V 20/176: {Urban or other man-made structures} - G06V 20/653: {by matching three-dimensional models, e.g. conformal mapping of Riemann surfaces} - G06T 2200/08: involving all processing steps from image acquisition to 3D model generation - G06T 2200/24: involving graphical user interfaces [GUIs] - G06T 2207/10028: Range image; Depth image; 3D point clouds - G06T 2210/04: Architectural design, interior design - G06T 2210/56: Particle system, point based geometry or rendering - G06T 2219/012: Dimensioning, tolerancing - G06T 2219/2008: Assembling, disassembling - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract Disclosed are systems and method for automatic building material ordering based on determined measurements from a multi-dimensional building model. The multi-dimensional model may be based on a plurality of received images, such as ground-based images of a building. The multi-dimensional model may be scaled, or a scale extracted based on data of the model. The multi-dimensional model may comprise architectural elements, and the scale used to determine measurements of such architectural elements. With the scaled measurements of the architectural elements in the model, product information related to multi-dimensional model may be processed, such as confirming availability of the sizes and quantities associated with the architectural elements. Ordering manufacturer products may based on the processed information. ## Claims ### Claim 1 A system for automatic building material ordering from a multi-dimensional building model comprising: a multi-dimensional building model database operable to store an unscaled multi-dimensional building model; and a processor communicatively coupled to the multi-dimensional building model database and operable to: receive a plurality of captured building images; retrieve an unscaled multi-dimensional building model, wherein the unscaled multidimensional building model includes one or more architectural elements present in the captured building images; extract a scaling factor of the unscaled multi-dimensional building model wherein extracting a scaling factor comprises correlating pixels of one or more architectural elements present in at least one of the captured building images with pixels of the one or more architectural elements of the unscaled multi-dimensional building model; scale the unscaled multi-dimensional building model using the scaling factor; calculate measurements of one or more architectural elements located on one or more planes within the scaled multi-dimensional building model, the measurements of the one or more architectural elements based on the scaling factor; determine manufacturer product information corresponding to the measurements of the one or more architectural elements; determine availability of manufacture products, based on the manufacturer product information, from one or more providers of the manufacturer products based on the measurements and a total count of the one or more architectural elements; and order the available manufacturer products. ### Claim 2 (depends on 1) The system of claim 1, wherein the processor is further operable to track delivery of materials to a location of the captured building images. ### Claim 3 (depends on 1) The system of claim 1, wherein the one or more architectural elements include siding elements. ### Claim 4 (depends on 3) The system of claim 3, wherein the one or more architectural elements include one or more of doors and bricks. ### Claim 5 (depends on 1) The system of claim 1, wherein the one or more architectural elements include roofing elements. ### Claim 6 (depends on 1) The system of claim 1, wherein extracting a scaling factor is based on one or more architectural elements present in at least one of the captured building images that were used to generate the unscaled multi-dimensional building model. ### Claim 7 (depends on 1) The system of claim 1, wherein the manufacturer product information comprises cost and shipping information from one or more providers of manufacturer products based on the calculated measurements of the one or more architectural elements and the manufacturer product information. ### Claim 8 (depends on 1) The system of claim 1, wherein the processor is further operable to generate an aggregate dimension for each architectural element, within the scaled multi-dimensional model, belonging to a classification of architectural element types. ### Claim 9 (depends on 8) The system of claim 8, wherein the aggregated dimension is based on an incremental selection of surfaces of the scaled multi-dimensional model. ### Claim 10 (depends on 9) The system of claim 9, wherein the measurements of the one or more architectural elements is further based on the incremental selection of surfaces of the scaled multi-dimensional model. ### Claim 11 (depends on 1) The system of claim 1, wherein the processor is further operable to quantify the number of architectural elements, within the scaled multi-dimensional model, belonging to a classification of architectural element type. ### Claim 12 (depends on 11) The system of claim 11, wherein the processor is further operable to generate an aggregated dimension for each architectural element, within the scaled multi-dimensional building model, belonging to the classification of architectural element type. ### Claim 13 (depends on 1) The system of claim 1, wherein the processor is further operable to identify an associated component to architectural elements in the captured building images. ### Claim 14 (depends on 13) The system of claim 13, wherein the associated component comprises frieze board. ### Claim 15 (depends on 13) The system of claim 13, wherein the associated component comprises an outside corner. ### Claim 16 (depends on 13) The system of claim 13, wherein the processor is further operable to correlate the associated component to a measurement of at least one of the one or more architectural elements located within the scaled multi-dimensional model. ### Claim 17 (depends on 16) The system of claim 16, wherein the processor is further operable to determine manufacturer product information of the associated component based on the measurement of the at least one of the one or more architectural elements located within the scaled multi-dimensional model. ### Claim 18 A method for automatic building material ordering from a multi-dimensional building model, the method comprising: receiving a plurality of captured building images; retrieving an unscaled multi-dimensional building model, wherein the unscaled multidimensional building model includes one or more architectural elements present in the captured building images; extracting a scaling factor of the unscaled multi-dimensional building model wherein extracting a scaling factor comprises correlating pixels of one or more architectural elements present in at least one of the captured building images with pixels of the one or more architectural elements of the unscaled multi-dimensional building model; scaling the unscaled multi-dimensional building model using the scaling factor; calculating measurements of one or more architectural elements located on one or more planes within the scaled multi-dimensional building model, the measurements of the one or more architectural elements based on the scaling factor; determining manufacturer product information corresponding to the measurements of the one or more architectural elements; determining availability of manufacture products, based on the manufacturer product information, from one or more providers of the manufacturer products based on the measurements and a total count of the one or more architectural elements; and ordering the available manufacturer products. ### Claim 19 (depends on 18) The method of claim 18, further comprising tracking delivery of materials to a location of the captured building images. ### Claim 20 (depends on 18) The method of claim 18, wherein the one or more architectural elements include siding elements. ### Claim 21 (depends on 18) The method of claim 18, wherein the one or more architectural elements include roofing elements. ### Claim 22 (depends on 18) The method of claim 18, wherein the one or more architectural elements include one or more of doors and bricks. ### Claim 23 (depends on 18) The method of claim 18, wherein extracting a scaling factor is based on one or more architectural elements present in at least one of the captured building images that were used to generate the unscaled multi-dimensional building model. ### Claim 24 (depends on 18) The method of claim 18, wherein the manufacturer product information comprises cost and shipping information from one or more providers of manufacturer products based on the calculated measurements of the one or more architectural elements and the manufacturer product information. ### Claim 25 (depends on 18) The method of claim 18, further comprising generating an aggregate dimension for each architectural element, within the scaled multi-dimensional model, belonging to a classification of architectural element types. ### Claim 26 (depends on 25) The method of claim 25, wherein the aggregated dimension is based on an incremental selection of surfaces of the scaled multi-dimensional model. ### Claim 27 (depends on 26) The method of claim 26, wherein the measurements of the one or more architectural elements is further based on the incremental selection of surfaces of the scaled multi-dimensional model. ### Claim 28 (depends on 18) The method of claim 18, further comprising quantifying the number of architectural elements, within the scaled multi-dimensional model, belonging to a classification of architectural element type. ### Claim 29 (depends on 28) The method of claim 28, further comprising generating an aggregated dimension for each architectural element, within the scaled multi-dimensional building model, belonging to the classification of architectural element type. ### Claim 30 (depends on 18) The method of claim 18, further comprising identifying an associated component to architectural elements in the captured building images. ### Claim 31 (depends on 30) The method of claim 30, wherein the associated component comprises frieze board. ### Claim 32 (depends on 30) The method of claim 30, wherein the associated component comprises an outside corner. ### Claim 33 (depends on 30) The method of claim 30, further comprising correlating the associated component to a measurement of at least one of the one or more architectural elements located within the scaled multi-dimensional model. ### Claim 34 (depends on 33) The method of claim 33, further comprising determining manufacturer product information of the associated component based on the measurement of the at least one of the one or more architectural elements located within the scaled multi-dimensional model.