Using images to create measurements of structures through the videogrammetric process
AssigneeMetalforming, Inc.
InventorsGeoffrey Stone, William Gaither Wilkins, Habib Fathi, Ioannis Brilakis
Life of this patent
Estimating the term…
Abstract
According to various embodiments, a stream of image frames depicting a structure in a scene are obtained. The stream of image frames may comprise first image frames from a first imaging device and second image frames from a second imaging device. Using the first image frames and the second image frames, a wireframe of at least a portion of the structure is generated. From the wireframe, as-built dimensions may be identified, materials estimates may be determined, and/or data for a fabrication device may be generated, for example.
Claims20
A non-transitory computer-readable medium embodying a program executable in a computing device, the program comprising:
- code that obtains a stream of image frames depicting a structure in a scene, the stream of image frames comprising a plurality of first image frames corresponding to a first imaging device and a plurality of second image frames corresponding to a second imaging device;
- code that identifies a plurality of edge pixels in a plurality of the image frames;
- code that identifies a plurality of groups of the edge pixels;
- code that identifies a plurality of preliminary lines based at least in part on the groups of the edge pixels;
- code that shortens the preliminary lines to thereby create a plurality of line segments;
- code that extends the line segments to thereby create a plurality of extended line segments;
- code that combines a plurality of the line segments to thereby create a plurality of lines;
- code that identifies a plurality of potential planes in a plurality of the image frames;
- code that matches a plurality of the lines for the first image frames with a plurality of the lines for the second image frames based at least in part on the potential planes to thereby identify a plurality of matched lines;
- code that identifies a camera set motion for the image frames;
- and
- code that generates a wireframe for at least a portion of the structure based at least in part on the matched lines and the camera set motion.
A system, comprising:
- at least one computing device;
- and
- a structure dimensioning system executable in the at least one computing device, the structure dimensioning system comprising:
- logic that obtains a stream of image frames depicting a structure in a scene, the stream of image frames comprising a plurality of first image frames corresponding to a first imaging device and a plurality of second image frames corresponding to a second imaging device;
- logic that generates a plurality of two-dimensional (2D) lines for at least a portion of the structure;
- logic that generates a plurality of three-dimensional (3D) lines using at least a subset of the 2D lines, the 3D lines representing a plurality of physical edges depicted in the stream of image frames;
- logic that identifies an imaging set motion for the stream of image frames;
- logic that adjusts the 3D lines based at least in part on the imaging set motion to thereby generate a plurality of adjusted 3D lines;
- and
- logic that generates a wireframe of at least a portion of the structure using at least a subset of the adjusted 3D lines.
A method, comprising:
- obtaining, in at least one computing device, a stream of image frames depicting a structure in a scene, the stream of image frames comprising a plurality of first image frames corresponding to a first imaging device and a plurality of second image frames corresponding to a second imaging device;
- generating, in the at least one computing device, a plurality of two-dimensional (2D) lines for at least a portion of the structure;
- generating, in the at least one computing device, a plurality of three-dimensional (3D) lines using at least a subset of the 2D lines, the 3D lines representing a plurality of physical edges depicted in the stream of image frames;
- identifying, in the at least one computing device, an imaging set motion for the stream of image frames;
- adjusting, in the at least one computing device, the 3D lines based at least in part on the imaging set motion to thereby generate a plurality of adjusted 3D lines;
- and
- generating, in the at least one computing device, a wireframe of at least a portion of the structure using at least a subset of the adjusted 3D lines.
Dependencies are inferred from the claim text.