Hierarchical self-supervised visual language model with medical image localization
AssigneeSiemens Healthineers AG
InventorsBogdan Georgescu, Awais Mansoor, Sasa Grbic, Dorin Comaniciu
Life of this patent
Estimating the term…
Loading patent…
AssigneeSiemens Healthineers AG
InventorsBogdan Georgescu, Awais Mansoor, Sasa Grbic, Dorin Comaniciu
Estimating the term…
Systems and methods for determining a correction between an input text-based query and one or more input medical images are provided. An input text-based query and one or more input medical images are received. The input text-based query is encoded into text features using a machine learning based text encoder network. The one or more input medical images are encoded into a spatial hierarchy of image features using a machine learning based image encoder network. A correlation is determined between the text features and the image features from a top-down of the spatial hierarchy of image features using the machine learning based text encoder network. The correlation between the text features and the image features is output.
A computer-implemented method comprising:
An apparatus comprising:
A non-transitory computer-readable storage medium comprising instructions which, when executed by a computer, cause the computer to carry out operations comprising:
A computer-implemented method comprising:
Dependencies are inferred from the claim text.