Automatic selection and display layout of medical images from clinical descriptions
AssigneeSiemens Healthineers AG
InventorsDaphne Yu, Yamini Varadan, Poikavila Ullaskrishnan
Life of this patent
Estimating the term…
Abstract
Systems and methods for automatic selection and display layout of medical images are provided. User input comprising 1) a description of desired medical images and 2) viewing preferences for the desired medical images is received. One or more nodes of a clinical knowledge ontological database that match the description of the desired medical images are determined. The one or more matching nodes are associated with one or more medical images in the clinical knowledge ontological database. A display layout of the one or more medical images is generated based on the viewing preferences. The display layout is output.
Claims20
A computer-implemented method comprising:
- receiving user input comprising 1) a description of desired medical images and 2) viewing preferences for the desired medical images;
- determining one or more nodes of a graph of a clinical knowledge ontological database that match the description of the desired medical images, the graph comprising 1) a plurality of nodes each associated with clinical nomenclature of medical images and 2) edges connecting at least some of the plurality of nodes, wherein at least one of the plurality of nodes is associated with at least one medical image that corresponds to its associated clinical nomenclature, wherein the one or more nodes of the graph are determined by:
- extracting a vector representation of the description of the desired medical images from the user input,
- performing a vector search between the vector representation of the description of the desired medical images and a vector representation of each of the plurality of nodes of the graph of the clinical knowledge ontological database, and
- identifying the one or more nodes as matching the description of the desired medical images based on results of the vector search;
- generating a display layout of one or more medical images associated with the one or more nodes based on the viewing preferences;
- and
- outputting the display layout.
An apparatus comprising:
- means for receiving user input comprising 1) a description of desired medical images and 2) viewing preferences for the desired medical images;
- means for determining one or more nodes of a graph of a clinical knowledge ontological database that match the description of the desired medical images, the graph comprising 1) a plurality of nodes each associated with clinical nomenclature of medical images and 2) edges connecting at least some of the plurality of nodes, wherein at least one of the plurality of nodes is associated with at least one medical image that corresponds to its associated clinical nomenclature, wherein the one or more nodes of the graph are determined by
- extracting a vector representation of the description of the desired medical images from the user input,
- performing a vector search between the vector representation of the description of the desired medical images and a vector representation of each of the plurality of nodes of the graph of the clinical knowledge ontological database, and
- identifying the one or more nodes as matching the description of the desired medical images based on results of the vector search;
- means for generating a display layout of one or more medical images associated with the one or more nodes based on the viewing preferences;
- and
- means for outputting the display layout.
A non-transitory computer-readable medium comprising instructions which, when executed by a computer, cause the computer to carry out operations comprising:
- receiving user input comprising 1) a description of desired medical images and 2) viewing preferences for the desired medical images;
- determining one or more nodes of a graph of a clinical knowledge ontological database that match the description of the desired medical images, the graph comprising 1) a plurality of nodes each associated with clinical nomenclature of medical images and 2) edges connecting at least some of the plurality of nodes, wherein at least one of the plurality of nodes is associated with at least one medical image that corresponds to its associated clinical nomenclature, wherein the one or more nodes of the graph are determined by:
- extracting a vector representation of the description of the desired medical images from the user input,
- performing a vector search between the vector representation of the description of the desired medical images and a vector representation of each of the plurality of nodes of the graph of the clinical knowledge ontological database, and
- identifying the one or more nodes as matching the description of the desired medical images based on results of the vector search;
- generating a display layout of one or more medical images associated with the one or more nodes based on the viewing preferences;
- and
- outputting the display layout.
Dependencies are inferred from the claim text.