A system and method for automated labeling and annotating unstructured medical datasets
AssigneeThe General Hospital Corporation
InventorSynho Do
Life of this patent
Estimating the term…
Abstract
Supervised and unsupervised learning schemes may be used to automatically label medical images for use in deep learning applications. Large labeled datasets may be generated from a small initial training set using an iterative snowball sampling scheme. A machine learning powered automatic organ classifier for imaging datasets, such as CT datasets, with a deep convolutional neural network (CNN) followed by an organ dose calculation is also provided. This technique can be used for patient-specific organ dose estimation since the locations and sizes of organs for each patient can be calculated independently.
Claims19
A method for automatically processing unstructured medical imaging data to generate classified images, the method comprising:
- a) acquiring medical image data of a subject;
- b) subjecting the medical image data of the subject to a neural network to generate classified image data;
- c) comparing the classified image data to a confidence test;
- d) upon determining that the classified image data does not pass the confidence test, subjecting the classified image data to a variational autoencoder (VAE) that implements a snowball sampling algorithm to refine the classified image data by representing features of the classified image data into latent space with a Gaussian distribution;
- e) repeating steps c) and d) until the classified image data passes the confidence test;
- and
- f) generating annotated images from the classified image data.
A method for automatic labeling and annotation for unstructured medical datasets with snowball sampling comprising:
- a) acquiring images of a region of a subject and labeling the images to generate a training dataset with the images;
- b) training a convolutional neural network with the training dataset;
- c) classifying unlabeled images using the trained network;
- d) determining if a performance threshold is exceeded for the classified images;
- and
- e) refining the dataset if the threshold is not exceeded by using a variational autoencoder to label the unlabeled images to create labeled images and updating the dataset with the labeled images.
A system for automatic labeling and annotation for unstructured medical datasets from medical images with snowball sampling, the system comprising:
- a) a computer system configured to:
- i) acquire images of a region of a subject and label the images to generate a training dataset with the images;
- ii) train a convolutional neural network with the training dataset;
- iii) classify unlabeled images using the trained network;
- iv) determine if a performance threshold is exceeded for the classified images;
- and
- v) refine the dataset if the threshold is not exceeded by using a variational autoencoder to label the unlabeled images to create labeled images and updating the dataset with the labeled images.
Dependencies are inferred from the claim text.