Facilitating interpretability of classification model
AssigneeKoninklijke Philips N.V.
InventorsNicola PEZZOTTI, Jacek Lukasz KUSTRA
Life of this patent
Estimating the term…
Abstract
A system and computer-implemented method are provided for generating a visualization of the classification uncertainty of a classification model which is applied to clinical data, wherein said visualization is provided in a lower-dimensional space which is obtained by applying a non-linear and manifold preserving dimensionality reduction technique to feature vectors of the clinical data. The visualization techniques consider the classification model as a ‘black box’ by not being dependent on internal parameters of the classification model.
Claims15
A system configured to apply a classification model to clinical data, the system comprising:
- a data interface for accessing:
- clinical data comprising data instances which are each representable as a feature vector in a multi-dimensional feature space;
- a classification model configured to be applied to the feature vector to provide a classification of the respective data instance;
- a processor subsystem configured to:
- apply a non-linear and manifold-preserving dimensionality reduction technique to all or a subset of the feature vectors to obtain a plurality of clinical data points in a lower-dimensional space wherein the lower-dimensional space is a two-dimensional space;
- create synthetic data points in the lower-dimensional space and determine feature vectors for the synthetic data points by applying an interpolation technique to the feature vectors of the clinical data points, thereby obtaining an interpolated feature vector for each of the synthetic clinical data points;
- for each synthetic clinical data point:
- apply the classification model to the respective interpolated feature vector to obtain a classification for the synthetic clinical data point, and
- determine a classification uncertainty of the classification;
- and
- generate a visualization of the lower-dimensional space for display to a user, wherein the visualization comprises a visualization of the classification uncertainty in visual relation to the synthetic clinical data points
- generate, in the visualization of the lower-dimensional space, a visualization of the classification by the classification model;
- and
- generate the visualization as a 2D image in which the classification uncertainty is assigned to a visual property of respective pixels of the 2D image.
(canceled)
(canceled)
A computer-implemented method for applying a classification model to clinical data, comprising:
- accessing:
- clinical data comprising data instances which are each representable as a feature vector in a multi-dimensional feature space;
- a classification model configured to be applied to the feature vector to provide a classification of the respective data instance;
- applying a non-linear and manifold-preserving dimensionality reduction technique to all or a subset of the feature vectors to obtain a plurality of clinical data points in a lower-dimensional space, wherein the lower-dimensional space is a two-dimensional space;
- creating synthetic data points in the lower-dimensional space and determining feature vectors for the synthetic data points by applying an interpolation technique to the feature vectors of the clinical data points, thereby obtaining an interpolated feature vector for each of the synthetic clinical data points;
- for each synthetic clinical data point:
- applying the classification model to the respective interpolated feature vector to obtain a classification for the synthetic clinical data point, and
- determining a classification uncertainty of the classification;
- and
- generating a visualization of the lower-dimensional space for display to a user, wherein the visualization comprises a visualization of the classification uncertainty in visual relation to the synthetic clinical data points, wherein the visualization is generated as a 2D image in which the classification uncertainty is assigned to a visual property of respective pixels of the 2D image;
- and
- generating, in the visualization of the lower-dimensional space, a visualization of the classification by the classification model.
Dependencies are inferred from the claim text.