Augmentation of 3D surface of dental site using 2D images

A non-transitory computer readable medium comprising instructions that, when executed by a processing device, cause the processing device to perform operations comprising:

• receiving a plurality of intraoral scans of a dental site generated by an intraoral scanner and a plurality of two-dimensional (2D) images of the dental site generated by the intraoral scanner;
• generating a three-dimensional (3D) surface of the dental site based at least in part on the plurality of intraoral scans;
• determining a correspondence between points on the 3D surface and points in one or more 2D images of the plurality of 2D images;
• determining a first estimate for a portion of the dental site based on the 3D surface of the dental site;
• determining a second estimate for the portion of the dental site based on the one or more 2D images of the dental site;
• comparing the first estimate for the portion of the dental site to the second estimate for the portion of the dental site;
• and
• performing one or more operations using the correspondence between the points on the 3D surface and the points in the one or more 2D images and a result of the comparing.

A non-transitory computer readable medium comprising instructions that, when executed by a processing device, cause the processing device to perform operations comprising:

• receiving a plurality of intraoral scans of a dental site generated by an intraoral scanner and a plurality of two-dimensional (2D) images of the dental site generated by the intraoral scanner, wherein the dental site comprises a preparation tooth;
• generating a three-dimensional (3D) surface of the dental site based at least in part on the plurality of intraoral scans;
• determining a correspondence between points on the 3D surface and points in one or more 2D images of the plurality of 2D images;
• identifying a margin line around the preparation tooth from the 3D surface;
• determining that a confidence for a segment of the margin line is low;
• and
• performing one or more operations using the correspondence between the points on the 3D surface and the points in the one or more 2D images, the one or more operations comprising:
• determining one or more 3D curves for the segment of the margin line based on the one or more 2D images of the plurality of 2D images;
• and
• modifying the 3D surface to cause it to have the one or more 3D curves.

A non-transitory computer readable medium comprising instructions that, when executed by a processing device, cause the processing device to perform operations comprising:

• receiving a plurality of intraoral scans of a dental site generated by an intraoral scanner and a plurality of two-dimensional (2D) images of the dental site generated by the intraoral scanner;
• generating a three-dimensional (3D) surface of the dental site based at least in part on the plurality of intraoral scans;
• determining a correspondence between points on the 3D surface and points in one or more 2D images of the plurality of 2D images;
• and
• performing one or more operations using the correspondence between the points on the 3D surface and the points in the one or more 2D images, the one or more operations comprising:
• determining a first 2D image of the plurality of 2D images that most closely matches a current view of the 3D surface and a selection of a point on the 3D surface;
• registering the first 2D image to the 3D surface;
• and
• overlaying the first 2D image over the 3D surface in accordance with the registration.

A non-transitory computer readable medium comprising instructions that, when executed by a processing device, cause the processing device to perform operations comprising:

• receiving a plurality of intraoral scans of a dental site generated by an intraoral scanner and a plurality of two-dimensional (2D) images of the dental site generated by the intraoral scanner;
• generating a three-dimensional (3D) surface of the dental site based at least in part on the plurality of intraoral scans;
• determining a correspondence between points on the 3D surface and points in one or more 2D images of the plurality of 2D images;
• performing one or more operations using the correspondence between the points on the 3D surface and the points in the one or more 2D images, the one or more operations comprising:
• determining a first 2D image of the plurality of 2D images that most closely matches a current view of the 3D surface and a selection of a point on the 3D surface;
• projecting the first 2D image onto a plane corresponding to the current view of the 3D surface to generate a synthetic 2D image;
• registering the synthetic 2D image to the 3D surface;
• and
• overlaying the synthetic 2D image over the 3D surface in accordance with the registration.