Content based image retrieval for lesion analysis

A method, comprising:

• extracting features from image data of a query potentially cancerous lesion utilizing a trained convolutional neural network (CNN) model and including the extracted features in a set of associated features of the query potentially cancerous lesion;
• calculating a similarity of the query potentially cancerous lesion to one or more potentially cancerous lesions in a database based on at least a subset of the set of associated features of the query potentially cancerous lesion;
• retrieving a plurality of potentially cancerous lesions from the database ranked by similarity to the query potentially cancerous lesion;
• and
• causing presentation of the plurality of potentially cancerous lesions by performing at least one of:
• causing displaying of the plurality of potentially cancerous lesions in stratified sections each corresponding to a different lesion type;
• causing displaying of the plurality of potentially cancerous lesions in a multi-dimensional polar plot representing multiple dimensions of similarity;
• or
• causing displaying of the plurality of potentially cancerous lesions with gaps separating one from another, wherein the gaps are calculated based on respective similarities between corresponding potentially cancerous lesions.

A non-transitory computer-readable medium storing contents that, when executed by one or more processors, cause performance of actions comprising:

• extracting features from image data of a query potentially cancerous lesion utilizing a trained convolutional neural network (CNN) model and including the extracted features in a set of associated features of the query potentially cancerous lesion;
• calculating a similarity of the query potentially cancerous lesion to one or more potentially cancerous lesions in a database based on at least a subset of the set of associated features of the query potentially cancerous lesion;
• retrieving a plurality of potentially cancerous lesions from the database ranked by similarity to the query potentially cancerous lesion;
• and
• causing presentation of the plurality of potentially cancerous lesions by performing at least one of:
• causing displaying of the plurality of potentially cancerous lesions in stratified sections each corresponding to a different lesion type;
• causing displaying of the plurality of potentially cancerous lesions in a multi-dimensional polar plot representing multiple dimensions of similarity;
• or
• causing displaying of the plurality of potentially cancerous lesions with gaps separating one from another, wherein the gaps are calculated based on respective similarities between corresponding potentially cancerous lesions.