Systems and Methods for Automatically Tagging Concepts to, and Generating Text Reports for, Medical Images Based On Machine Learning
AssigneePetuum Inc.
InventorsPengtao Xie, Eric Xing
Life of this patent
Estimating the term…
Abstract
A system for assigning concepts to a medical image includes a visual feature module and a tagging module. The visual feature module is configured to obtain an image feature vector from the medical image. The tagging module is configured to apply a machine-learned algorithm to the image feature vector to assign a set of concepts to the image. The system may also include a text report generator that is configured to generate a written report describing the medical image based on the set of concepts assigned to the medical image.
Claims19
A method of assigning concepts to a medical image, the method comprising:
- obtaining an image feature vector from the medical image;
- and
- applying a machine-learned algorithm to the image feature vector to assign a set of concepts to the medical image.
A system for assigning concepts to a medical image, the system comprising:
- a visual feature module configured to obtain an image feature vector from the medical image;
- and
- a tagging module configured to apply a machine-learned algorithm to the image feature vector to assign a set of concepts to the medical image.
A machine learning apparatus for generating a map between medical image concepts and medical images, the apparatus comprising:
- a processor;
- and
- a memory coupled to the processor;
- and
- wherein the processor is configured to:
- generate representations of medical images in a form of image feature vectors;
- generate representations of concepts describing medical images in a form of concept vectors;
- process the image feature vectors and the concept vectors to obtain measures of relevance between images and concepts and measures of correlation among different concepts, and
- associate each medical image represented in the image feature vector with one or more concepts represented in the concept vector based on the measures of relevance and the measures of correlation.
Dependencies are inferred from the claim text.