Viewers and related methods, systems and circuits with patch gallery user interfaces
AssigneeSectra AB
InventorsJesper Molin, Claes Lundström
Life of this patent
Estimating the term…
Abstract
Methods, systems, workstations, and computer programs with user interactive patch gallery user interfaces that allow a user to alter at least one feature dimension of the patches and/or WSI image using the patch gallery. The patches are different small regions of interest of excerpts of the WSI and are not required to be neighboring excerpts but can be random samples spanning an extent of the feature dimension.
Claims32
A method of processing digital pathology and cytology images for viewing, comprising:
- electronically generating a plurality of patches of different sub-regions of a region of interest (ROI) from a digital pathology or cytology whole slide image (WSI) image, wherein the patches are, actual region excerpts from the WSI image, and wherein the patches each have a pre-defined and common shape and are distributed and spaced apart from each other across the ROI with a complementary space between the patches;
- then
- electronically classifying the patches into a plurality of different classes;
- then
- electronically providing samples of the patches from each of the different classes;
- electronically adding new patches from the complementary space of the ROI to the patch gallery to improve a calculated confidence interval associated with the patches being correctly classified in the different classes;
- presenting a plurality of the provided patches as a patch gallery on a display;
- and
- accepting user input to electronically interface with the patch gallery to perform at least one of:
- (i) adjust a threshold value of a feature dimension of the patches using an electronic interface input feature on the patch gallery;
- (ii) reduce a parameter span/extent from the parameter span/extent shown for the patches in the patch gallery which electronically updates the patch gallery displayed to include a more narrow extent of the parameter span/extent;
- (iii) select or exclude at least one of the patches in the patch gallery to automatically reduce a first positive total cell count by removing cell counts associated with positive cells in the selected or excluded patch;
- and
- (iv) select or exclude at least one of the patches in the patch gallery to automatically reclassify the selected patch from its classification in the patch gallery.
A method of processing digital pathology and cytology images for viewing, comprising:
- electronically generating a plurality of patches of different sub-regions of a region of interest from a digital pathology or cytology whole slide image (WSI) image;
- electronically classifying the patches into a plurality of different classes;
- electronically providing random samples of the patches from each of the different classes;
- presenting a plurality of the provided patches as a patch gallery on a display;
- and
- accepting user input to electronically interface with the patch gallery to perform at least one of:
- (i) adjust a threshold value of a feature dimension of the patches using an electronic interface input feature on the patch gallery;
- (ii) reduce a parameter span/extent from the parameter span/extent shown for the patches in the patch gallery which electronically updates the patch gallery displayed to include a more narrow extent of the parameter span/extent;
- (iii) select or exclude at least one of the patches in the patch gallery to automatically reduce a first positive total cell count by removing cell counts associated with positive cells in the selected or excluded patch;
- and
- (iv) select or exclude at least one of the patches in the patch gallery to automatically reclassify the selected patch from its classification in the patch gallery,
- wherein the method further comprises one or more of:
- (a) automatically electronically resorting patches in different classifications based on user input to change the classification of one of the patches from its initial classification, then electronically generating a revised confidence interval of the different classification of the patches;
- and/or
- (b) providing an electronic verification mode that allows a user to electronically change a classification of different patches by moving a patch in a patch gallery to another location associated with a different classification;
- and/or
- (c) providing an electronic verification mode that allows a user to electronically change a classification of different patches by selecting a user input in a main view showing a high magnification portion of an associated patch under review in the WSI;
- and/or
- (d) electronically allowing a user to direct a circuit to add new patches of a complementary space of the region of interest of the WSI to increase a statistical confidence interval of a likelihood of correct identification of positive cell count.
A viewer for evaluating Whole Slide Images (WSI), comprising:
- a display;
- and
- a circuit in communication with the display, the circuit comprising at least one processor that:
- generates a plurality of patches of different regions of interest from a digital pathology or cytology whole slide image (WSI), wherein the patches are actual region excerpts from a respective WSI image that are spaced apart and distributed across a region of interest of the respective WSI image and that have a pre-defined height and width dimension with a complementary space between patches;
- then
- classifies the patches into a plurality of different classes;
- then
- provides samples of the patches from the different classes;
- then
- presents a plurality of the patches from each of the different classes as a patch gallery on a display;
- accepts user input to electronically interface with the patch gallery;
- and
- adds new patches from the complementary space of the ROI to the patch gallery to improve a calculated confidence interval associated with the patches being correctly classified in the different classes.
A method of processing digital pathology and cytology images for viewing, comprising:
- electronically generating a plurality of patches of different sub-regions of a region of interest (ROI) from a digital pathology or cytology whole slide image (WSI) image, wherein the patches are actual region excerpts from the WSI image that are spaced apart across the ROI;
- then
- electronically classifying the patches into a plurality of different classes;
- then
- electronically providing samples of the patches from each of the different classes;
- presenting a plurality of the provided patches as a patch gallery on a display;
- allowing a user to set a cut-off threshold of a positivity level by selecting a patch, selecting a level between two patches and moving a path to a different side of the cut-off threshold;
- electronically adding new patches from a complementary space of the ROI to the patch gallery to improve a calculated confidence interval associated with the classified patches being correctly classified;
- and
- accepting user input to electronically interface with the patch gallery to perform at least one of:
- (i) adjust a threshold value of a feature dimension of the patches using an electronic interface input feature on the patch gallery;
- (ii) reduce a parameter span/extent from the parameter span/extent shown for the patches in the patch gallery which electronically updates the patch gallery displayed to include a more narrow extent of the parameter span/extent;
- (iii) select or exclude at least one of the patches in the patch gallery to automatically reduce a first positive total cell count by removing cell counts associated with positive cells in the selected or excluded patch;
- and
- (iv) select or exclude at least one of the patches in the patch gallery to automatically reclassify the selected patch from its classification in the patch gallery.
A method of processing digital pathology and cytology images for viewing, comprising:
- electronically generating a plurality of patches of different sub-regions of a region of interest (ROI) from a digital pathology or cytology whole slide image (WSI) image, wherein the patches are actual region excerpts from the WSI image, and wherein the patches are distributed and spaced apart from each other across the ROI with a complementary space between the patches;
- then
- electronically classifying the patches into a plurality of different classes;
- and then
- electronically automatically or by user interaction adding patches from the complementary space of the ROI to improve a calculated confidence interval associated with the patches being correctly classified in the different classes.
Dependencies are inferred from the claim text.