Teeth segmentation using neural networks

A computer-implemented method of digitally segmenting teeth in a digital model, comprising:

• receiving a 3D digital model of patient scan data of at least a portion of a patient's dentition;
• generating a 2D depth map from the 3D digital model;
• determining, using a first neural network, one or more digital tooth bounding regions in the 2D depth map;
• determining one or more sampled digital surface points on the 3D digital model corresponding to one or more sampled points in the one or more digital tooth bounding regions;
• generating a two dimensional (2D) panoramic image using the one or more sampled digital surface points on the 3D digital model;
• labeling, using a second trained neural network, one or more regions of the 2D panoramic image to provide a labeled 2D panoramic image;
• and
• mapping one or more regions of the labeled panoramic image to one or more corresponding coarse digital surface triangle labels in the 3D digital model to provide a labeled 3D digital model.

A system to digitally label virtual teeth in a digital model, comprising:

• a processor;
• and
• a computer-readable storage medium comprising instructions executable by the processor to perform steps comprising:
• receiving a 3D digital model of patient scan data of at least a portion of a patient's dentition;
• generating a 2D depth map from the 3D digital model;
• determining, using a first neural network, one or more digital tooth bounding regions in the 2D depth map;
• determining one or more sampled digital surface points on the 3D digital model corresponding to one or more sampled points in the one or more digital tooth bounding regions;
• generating a two dimensional (2D) panoramic image using the one or more sampled digital surface points on the 3D digital model;
• labeling, using a second trained neural network, one or more regions of the 2D panoramic image to provide a labeled 2D panoramic image;
• and
• mapping one or more regions of the labeled panoramic image to one or more corresponding coarse digital surface triangle labels in the 3D digital model to provide a labeled 3D digital model.

A non-transitory computer readable medium storing executable computer program instructions to provide a labeled virtual teeth 3D digital model, the computer program instructions comprising:

• receiving a 3D digital model of patient scan data of at least a portion of a patient's dentition;
• generating a 2D depth map from the 3D digital model;
• determining, using a first neural network, one or more digital tooth bounding regions in the 2D depth map;
• determining one or more sampled digital surface points on the 3D digital model corresponding to one or more sampled points in the one or more digital tooth bounding regions;
• generating a two dimensional (2D) panoramic image using the one or more sampled digital surface points on the 3D digital model;
• labeling, using a second trained neural network, one or more regions of the 2D panoramic image to provide a labeled 2D panoramic image;
• and
• mapping one or more regions of the labeled panoramic image to one or more corresponding coarse digital surface triangle labels in the 3D digital model to provide a labeled 3D digital model.