# US 2013/0155109 A1 · System for automatic structure footprint detection from oblique imagery > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2013/0155109 A1 - Document ID: US20130155109A1 - Status: Published application - Kind: A1 - Application number: 13/689,006 - Filed: 2012-11-29 - Published: 2013-06-20 - Earliest claimed: 2011-11-29 - Assignees: Pictometry International Corp. - Inventors: Stephen L. Schultz; Yandong Wang - Web page: https://patentgrep.com/patent/US20130155109A1 ## CPC - G06T 12/00: Tomographic reconstruction from projections - G01C 11/06: by comparison of two or more pictures of the same area - G06T 7/13: Edge detection - G06T 7/181: involving edge growing; involving edge linking - G06T 7/50: Depth or shape recovery - G06T 7/62: of area, perimeter, diameter or volume - G06T 17/05: Geographic models - G06T 2207/10032: Satellite or aerial image; Remote sensing - G06T 2207/30132: Masonry; Concrete - G06T 2207/30184: Infrastructure - G06T 2210/04: Architectural design, interior design - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S) ## Abstract A set of instructions stored on at least one computer readable medium for running on a computer system. The set of instructions includes instructions for identifying edges of a structure displayed in multiple oblique images, instructions for determining three-dimensional information of the edges including position, orientation and length of the edges utilizing multiple oblique images from multiple cardinal directions, and instructions for determining, automatically, at least one line segment of a portion of a footprint of the structure utilizing at least one of the relative position and orientation of the edges. ## Claims ### Claim 1 A set of instructions stored on at least one non-transitory computer readable medium for running on a computer system, comprising: a. instructions for receiving one or more electronic files of oblique images into one or more memory; b. instructions for identifying a structure having at least four sides within the one or more electronic files, the sides having edges; c. instructions for determining locations and orientations of the edges of the sides of the structure; d. instructions for determining, relative lengths of the sides of the structure utilizing the locations and orientations of edges of the sides of the structure to produce a series of line segments representing the sides of the structure, the line segments having a relative length and an orientation; and e. instructions for assembling the line segments based on their relative lengths and orientations to form a footprint of the structure. ### Claim 2 (depends on 1) The set of instructions stored on the at least one non-transitory computer readable medium of claim 1, wherein the instructions c.-e. are adapted to be executed without manual intervention. ### Claim 3 (depends on 1) The set of instructions stored on the at least one non-transitory computer readable medium of claim 1, wherein the instructions c. include instructions for receiving user input for determining the locations and orientations of the edges. ### Claim 4 (depends on 1) The set of instructions stored on the at least one non-transitory computer readable medium of claim 1, where the instructions are adapted to cause the computer system to generate a three-dimensional model of the structure utilizing the line segments. ### Claim 5 (depends on 1) The set of instructions stored on the at least one non-transitory computer readable medium of claim 1, further comprising at least one instruction for storing information indicative of the edges as line segments. ### Claim 6 (depends on 5) The set of instructions stored on the at least one non-transitory computer readable medium of claim 5, wherein the line segments have lengths, and further comprising instructions for providing a cumulative length of the line segments for the footprint of the structure. ### Claim 7 (depends on 5) The set of instructions stored on the at least one non-transitory computer readable medium of claim 5, wherein the line segments have lengths, and further comprising instructions for determining an area of the footprint of the structure. ### Claim 8 (depends on 1) The set of instructions stored on the at least one non-transitory computer readable medium of claim 1, wherein the set of instructions further comprises instructions for grouping the edges by relative position. ### Claim 9 (depends on 8) The set of instructions stored on the at least one non-transitory computer readable medium of claim 8, wherein the instructions for grouping the edges by relative position includes instructions for receiving user input to group edges by relative position. ### Claim 10 (depends on 1) The set of instructions stored on the at least one non-transitory computer readable medium of claim 1, wherein the edges include vertical edges and at least one horizontal edge and wherein the set of instructions includes instructions for determining vertices of the footprint. ### Claim 11 (depends on 10) The set of instructions stored on the at least one non-transitory computer readable medium of claim 10, wherein the set of instructions includes instructions for determining at least one horizontal edge extending a length between the vertical edges in determining at least one line segment of the footprint, the vertical edges having a top and a bottom, and the at least one horizontal edge being above the bottoms of the vertical edges. ### Claim 12 (depends on 11) The set of instructions stored on the at least one computer readable medium of claim 11, wherein the horizontal edge extending between the vertices extends the entire length between the vertices and wherein the at least one line segment of the footprint is determined with the at least one horizontal edge. ### Claim 13 (depends on 11) The set of instructions stored on the at least one computer readable medium of claim 11, wherein the horizontal edge extending between the vertices extends only a portion of the length between the vertices and wherein the at least one line segment of the footprint is determined with the at least one horizontal edge. ### Claim 14 (depends on 10) The set of instructions stored on the at least one computer readable medium of claim 10, where the set of instructions includes instructions for determining an angle between at least one vertical edge and at least one horizontal edge for determining at least one line segment of the footprint. ### Claim 15 (depends on 1) The set of instructions stored on the at least one computer readable medium of claim 1, wherein the set of instructions for determining at least one line segment forming a portion of a footprint utilizes wire frame data of the structure determined from the one or more electronic file of the oblique images. ### Claim 16 A method, comprising the step of: making a set of instructions on a computer readable medium accessible to a processor of a computer system, the set of instructions including instructions for: identifying edges of a structure by analyzing one or more electronic file stored in one or more non-transitory memory, the electronic file being indicative of at least one geo-referenced oblique image; determining three-dimensional information of the edges including position, orientation and relative lengths of the edges using multiple oblique images from multiple cardinal directions; and determining, automatically, at least one line segment of a portion of a footprint of the structure utilizing at least one of the relative position and orientation of the edges. ### Claim 17 A method, comprising the step of: selling and distributing a set of instructions stored on at least one computer readable medium for: identifying edges of a structure by analyzing one or more electronic file stored in one or more non-transitory memory, the electronic file being indicative of at least one geo-referenced oblique image; determining three-dimensional information of the edges including position, orientation and relative length of the edges using multiple oblique images from multiple cardinal directions; and determining, automatically, at least one line segment of a portion of a footprint of the structure utilizing at least one of the relative position and orientation of the edges. ### Claim 18 A method comprising the step of: providing access to a set of instructions stored on a first computer readable medium for installation on a second computer readable medium associated with a user device, the set of instructions including instructions for: identifying edges of a structure by analyzing one or more electronic file stored in one or more non-transitory memory, the electronic file being indicative of at least one geo-referenced oblique image; determining three-dimensional information of the edges including position, orientation and relative length of the edges using multiple oblique images from multiple cardinal directions; and determining, automatically, at least one line segment of a portion of a footprint of the structure utilizing at least one of the relative position and orientation of the edges. ### Claim 19 A computer system, comprising: at least one processor; one or more computer readable medium storing a set of instructions that when executed by the at least one processor causes the at least one processor to: identify edges of a structure displayed within one or more geo-referenced images by analyzing one or more electronic file stored in one or more non-transitory memory, the electronic file being indicative of the one or more geo-referenced images; determine three-dimensional information of the edges including position, orientation and relative length of the edges utilizing the one or more geo-referenced images; and determine, automatically, at least one line segment of a portion of a footprint of the structure utilizing at least one of the relative position and orientation of the edges. ### Claim 20 (depends on 19) The computer system of claim 19, wherein the edges include vertical edges and at least one horizontal edge and wherein the set of instructions when executed by the at least one processor further causes the at least one processor to determine vertices of the footprint. ### Claim 21 (depends on 20) The computer system of claim 20, wherein the set of instructions when executed by the at least one processor further causes the at least one processor to determine at least one horizontal edge extending a length between the vertical edges in determining at least one line segment of the footprint, the vertical edges having a top and a bottom, and the at least one horizontal edge being above the bottoms of the vertical edges.