Using photo collections for three dimensional modeling

A method performed by a computing device, the method comprising:

• providing a three-dimensional model, the three-dimensional model corresponding to a real-world subject, wherein the three-dimensional model is in a three-dimensional space and has a surface corresponding to a portion of the three-dimensional model;
• displaying a rendering of the three-dimensional model;
• given a virtual projection point having a fixed position in the three-dimensional space, computing a pyramidal projection of a digital photo out from the virtual projection point and in a direction toward the surface;
• during interactive reorienting or repositioning of the surface relative to the three-dimensional model and relative to the projection:
• displaying the surface moving as it is reoriented or repositioned relative to the three-dimensional model and relative to the projection,
• automatically repeatedly computing intersections of the projection with the surface as the surface is being reoriented or repositioned relative to the three-dimensional model and the projection, and
• repeatedly redisplaying at least a portion of the digital photo in the intersections.

A computer implemented method for interactively editing a three-dimensional model, the method comprising:

• providing a plurality of viewpoints oriented toward the three-dimensional model and positioned in three dimensions in correspondence to the three-dimensional model, each viewpoint having a corresponding digital photo of a real world scene at least partly corresponding to the three-dimensional model;
• computing pyramidal projections from the viewpoints, respectively, each projection oriented toward the three-dimensional model according to its corresponding viewpoint;
• repeatedly recomputing intersections of the projections with a surface of the three-dimensional model while the surface of the is being interactively reoriented or repositioned surface relative to the three-dimensional model and while the surface is displayed with movement corresponding to the repositioning or reorienting;
• and
• mapping portions of the digital photos, respectively, to the respective intersections of the projections, and displaying the mapped portions on the surface while the surface is being interactively repositioned or reoriented.