# US 8,150,192 B2 · System and method for feature score mapping and visualization of medical images > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 8,150,192 B2 - Document ID: US8150192B2 - Status: Granted - Kind: B2 - Application number: 11/944,338 - Filed: 2007-11-21 - Published: 2008-06-05 - Granted: 2012-04-03 - Earliest claimed: 2006-11-27 - Assignees: Merge CAD Inc. - Inventors: Tanya L. Niemeyer; Paul V. Budak; Brian W. Epps; James J. Boisseranc - Web page: https://patentgrep.com/patent/US8150192B2 ## CPC - G06T 7/0012: {Biomedical image inspection} - G06T 2200/24: involving graphical user interfaces [GUIs] - G06T 2207/10088: Magnetic resonance imaging [MRI] - G06T 2207/10116: X-ray image - G06T 2207/30068: Mammography; Breast - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract A system to collect and analyze medical image data is applicable for multi-modality medical imaging systems, such as x-ray, MRI, and the like. Medical image data is collected and analyzed to determine one or more regions of interest. A selected region of interest is further analyzed to determine morphological characteristics. A feature library, which may be in the form of a data base, is used to analyze the image on a pixel-by-pixel basis to determine the degree to which the region of interest matches selected morphological characteristics, such as shape or margin. The resultant data is used to generate a map indicating a continuum over which the region of interest matches the morphological characteristics. A display receives the map data and applies it to the video image to thereby provide the user with a visualization of the degree to which the region of interest matches the morphological characteristics. ## Claims ### Claim 1 A system comprising: an input configured to receive medical image data, the medical image data including a region of interest; a data storage structure to store the received medical image data; a feature mapping processor configured to analyze the region of interest with respect to a plurality of morphological characteristics in each of a plurality of morphological categories, and to generate a morphological score along a continuum that maps substantially the entire region of interest to a score range indicative of a degree to which the region of interest matches the plurality of morphological characteristics in each of the plurality of morphological categories from a lesser degree of match to a greater degree of match; and a display to display the medical image data, including the region of interest, the display including visual data indicative of the morphological score range across the continuum from less suspicious to more suspicious. ### Claim 2 (depends on 1) The system of claim 1 wherein the feature mapping processor is further configured to analyze the region of interest with respect to one of the plurality of morphological characteristics and to generate a morphological score on a continuum indicating the degree to which the region of interest matches the plurality of morphological characteristics from a lesser degree of match to a greater degree of match, the display being configured to provide visual data indicative of the continuum of morphological scores. ### Claim 3 (depends on 1) The system of claim 1 wherein the medical image data is a two-dimensional image represented by a plurality of pixels and the feature mapping processor is further configured generate a map having map elements corresponding to the pixels of at least a portion of the medical image data with each of the map elements having a data value representative of the morphological score for the corresponding pixel, the display being configured to display visual data based on the generated map. ### Claim 4 (depends on 1) The system of claim 1 wherein the medical image data is a three-dimensional image represented by a plurality of voxels and the feature mapping processor is further configured generate a map having map elements corresponding to the voxels of at least a portion of the medical image data with each of the map elements having a data value representative of the morphological score for the corresponding voxel, the display being configured to display visual data based on the generated map. ### Claim 5 (depends on 1) The system of claim 1 wherein the region of interest has a border portion and the feature mapping processor is further configured generate morphological score for the border portion. ### Claim 6 (depends on 1) The system of claim 1 wherein the region of interest has a two-dimensional area and the feature mapping processor is further configured generate morphological score for the region area. ### Claim 7 (depends on 1) The system of claim 1 wherein the region of interest has a three-dimensional volume and the feature mapping processor is further configured generate morphological score for the region volume. ### Claim 8 (depends on 1) The system of claim 1 wherein the region of interest comprises a portion of the medical image data less than the entire medical image and the feature mapping processor is further configured generate the morphological score for the entire medical image. ### Claim 9 (depends on 1) The system of claim 1 wherein the display is configured to show at least a portion of the visual data in color with different colors indicating the morphological score. ### Claim 10 (depends on 1) The system of claim 1 wherein the display is configured to show at least a portion of the visual data in color with different color intensity indicating the morphological score. ### Claim 11 (depends on 1) The system of claim 1 wherein the display is configured to show at least a portion of the visual data with a time-varying display brightness indicating the morphological score. ### Claim 12 (depends on 1) The system of claim 1, further comprising an input device operable by a user to select one of the plurality of morphological categories, the feature mapping processor being further configured to analyze the region of interest with respect to the plurality of morphological characteristics for the selected morphological category wherein the display displays the medical image data, including the region of interest, the display including visual data indicative of the morphological score for the selected morphological category. ### Claim 13 (depends on 1) The system of claim 1, further comprising a library of morphological characteristics wherein the feature mapping processor is further configured to for pattern recognition using the library of morphological characteristics to generate the morphological score. ### Claim 14 (depends on 1) The system of claim 1 wherein the medical image data is breast image data and the morphological characteristics correspond to ACR BI-RADS classifications. ### Claim 15 (depends on 1) The system of claim 1 wherein the morphological characteristics correspond to ACR classifications corresponding a tissue type for the region of interest. ### Claim 16 A method for scoring features in medical image data comprising: receiving medical image data, the medical image data including a region of interest; analyzing the region of interest with respect to a plurality of morphological characteristics in each of a plurality of morphological categories; generating a morphological score along a continuum that maps substantially the entire region of interest to a score range indicative of a degree to which the region of interest matches the plurality of morphological characteristics in each of the plurality of morphological categories from a lesser degree of match to a greater degree of match; and displaying the medical image data, including visual data indicative of the morphological score range across the continuum from less suspicious to more suspicious. ### Claim 17 (depends on 16) The method of claim 16 wherein generating a morphological score comprises generating a morphological score on a continuum indicating the degree to which the region of interest matches the plurality of morphological characteristics from a lesser degree of match to a greater degree of match, wherein displaying the medical image data comprises generating visual data indicative of the continuum of morphological scores. ### Claim 18 (depends on 16) The method of claim 16 wherein the medical image data is a two-dimensional image represented by a plurality of pixels and generating a morphological score comprises generating a map having map elements corresponding to the pixels of at least a portion of the medical image data with each of the map elements having a data value representative of the morphological score for the corresponding pixel. ### Claim 19 (depends on 16) The method of claim 16 wherein the medical image data is a three-dimensional image represented by a plurality of voxels and generating a morphological score comprises generating a map having map elements corresponding to the voxels of at least a portion of the medical image data with each of the map elements having a data value representative of the morphological score for the corresponding voxel. ### Claim 20 (depends on 16) The method of claim 16 wherein the region of interest has a border portion and generating a morphological score comprises generating a morphological score for the border portion. ### Claim 21 (depends on 16) The method of claim 16 wherein the region of interest has a two-dimensional area and generating a morphological score comprises generating a morphological score for the region area. ### Claim 22 (depends on 16) The method of claim 16 wherein the region of interest has a three-dimensional volume and generating a morphological score comprises generating a morphological score for the region volume. ### Claim 23 (depends on 16) The method of claim 16 wherein the region of interest comprises a portion of the medical image data less than the entire medical image and generating a morphological score comprises generating a morphological score for the entire medical image. ### Claim 24 (depends on 16) The method of claim 16 wherein generating a morphological score comprises using pattern recognition to compare the region of interest to a feature library of morphological characteristics. ### Claim 25 (depends on 16) The method of claim 16 wherein the medical image data is breast image data and the morphological characteristics correspond to ACR BI-RADS classifications. ### Claim 26 (depends on 16) The method of claim 16 wherein the morphological characteristics correspond to industry-standard classifications corresponding a tissue type for the region of interest. ### Claim 27 (depends on 16) The method of claim 16 wherein the morphological characteristics correspond to user-selectable classifications corresponding a tissue type for the region of interest. ### Claim 28 A non-transitory computer-readable medium containing instructions for scoring features in medical image data by causing a computer system to: receive medical image data, the medical image data including a region of interest; analyze the region of interest with respect to a plurality of morphological characteristics in each of a plurality of morphological categories; generate a morphological score along a continuum that maps substantially the entire region of interest to a score range indicative of a degree to which the region of interest matches the plurality of morphological characteristics in each of the plurality of morphological categories from a lesser degree of match to a greater degree of match; and display the medical image data, including visual data indicative of the morphological score range across the continuum from less suspicious to more suspicious. ### Claim 29 (depends on 28) The computer-readable medium of claim 28 wherein instructions to generate a morphological score comprises generating a morphological score on a continuum indicating the degree to which the region of interest matches the plurality of morphological characteristics from a lesser degree of match to a greater degree of match, and displaying the medical image data comprises instructions to generate visual data indicative of the continuum of morphological scores. ### Claim 30 (depends on 28) The computer-readable medium of claim 28 wherein the medical image data is a two-dimensional image represented by a plurality of pixels and instructions to generate a morphological score comprises generating a map having map elements corresponding to the pixels of at least a portion of the medical image data with each of the map elements having a data value representative of the morphological score for the corresponding pixel. ### Claim 31 (depends on 28) The computer-readable medium of claim 28 wherein the medical image data is a three-dimensional image represented by a plurality of voxels and instructions to generate a morphological score comprises generating a map having map elements corresponding to the voxels of at least a portion of the medical image data with each of the map elements having a data value representative of the morphological score for the corresponding voxel. ### Claim 32 (depends on 28) The computer-readable medium of claim 28 wherein the region of interest has a border portion and instructions to generate a morphological score comprises generating a morphological score for the border portion. ### Claim 33 (depends on 28) The computer-readable medium of claim 28 wherein the region of interest has a two-dimensional area and instructions to generate a morphological score comprises generating a morphological score for the region area. ### Claim 34 (depends on 28) The computer-readable medium of claim 28 wherein the region of interest has a three-dimensional volume and instructions to generate a morphological score comprises generating a morphological score for the region volume. ### Claim 35 (depends on 28) The computer-readable medium of claim 28 wherein the region of interest comprises a portion of the medical image data less than the entire medical image and instructions to generate a morphological score comprises generating a morphological score for the entire medical image. ### Claim 36 (depends on 28) The computer-readable medium of claim 28 wherein instructions to generate a morphological score comprises using pattern recognition to compare the region of interest to a feature library of morphological characteristics. ### Claim 37 (depends on 28) The computer-readable medium of claim 28 wherein the medical image data is breast image data and the morphological characteristics correspond to ACR BI-RADS classifications. ### Claim 38 (depends on 28) The computer-readable medium of claim 28 wherein the morphological characteristics correspond to industry-standard classifications corresponding a tissue type for the region of interest. ### Claim 39 (depends on 28) The computer-readable medium of claim 28 wherein the morphological characteristics correspond to user-selectable classifications corresponding a tissue type for the region of interest.