# US 10,307,098 B2 · System and method for optical detection of skin disease > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,307,098 B2 - Document ID: US10307098B2 - Status: Granted - Kind: B2 - Application number: 14/907,208 - Filed: 2014-07-22 - Published: 2016-06-16 - Granted: 2019-06-04 - Earliest claimed: 2013-07-22 - Assignees: The Rockefeller University - Applicants: The Rockefeller University - Inventors: Daniel Gareau - Web page: https://patentgrep.com/patent/US10307098B2 ## CPC - A61B 5/444: {Evaluating skin marks, e.g. mole, nevi, tumour, scar} - A61B 5/0075: {by spectroscopy, i.e. measuring spectra, e.g. Raman spectroscopy, infrared absorption spectroscopy (A61B5/0071 takes precedence)} - A61B 5/14546: {for measuring analytes not otherwise provided for, e.g. ions, cytochromes} - A61B 5/14551: {for measuring blood gases} - A61B 5/14552: {Details of sensors specially adapted therefor} - A61B 5/441: {Skin evaluation, e.g. for skin disorder diagnosis} - A61B 5/443: {Evaluating skin constituents, e.g. elastin, melanin, water} - A61B 5/445: {Evaluating skin irritation or skin trauma, e.g. rash, eczema, wound, bed sore} - A61B 5/6898: {Portable consumer electronic devices, e.g. music players, telephones, tablet computers} - A61B 5/0077: {Devices for viewing the surface of the body, e.g. camera, magnifying lens} - A61B 2560/0431: Portable apparatus, e.g. comprising a handle or case - A61B 2562/0238: Optical sensor arrangements for performing transmission measurements on body tissue - A61B 2576/00: Medical imaging apparatus involving image processing or analysis (A61B1/00009, A61B6/52 and A61B8/52 take precedence) - A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D) ## Abstract An optical system for the detection of skin disease, such as melanoma, acquires images of a lesion on a subject's skin at different wavelengths and utilizes a sweeping arm rotating about the lesion in a clock-like sweep to produce diagnostically relevant metrics and classifiers from the image data so as to enhance detection of the skin disease. ## Claims ### Claim 1 A method of diagnostically imaging at least one skin lesion on a subject's skin, comprising the steps of: illuminating with a first illumination system a first area on the subject's skin; obtaining wide field image data from the illuminated skin using a first camera having a first lens with a first wide field of view; processing the wide field image data to identify a target area within the first area on the subject's skin, the first area including a potential skin lesion; illuminating the target area with a second illumination system; obtaining second narrow field image data from the illuminated target area with a second camera having a second lens with a second narrow field of view narrower than the first wide field of view, the light of the second illumination system being set at one or more wavelengths, different from those of the first illumination system, for the second narrow field of view; processing the second narrow field image data to locate a center and border of the potential skin lesion and determine that the potential skin lesion is in fact in the target area; creating a line segment extending out from the center to the border; rotating the line segment about the center at a plurality of angles; sampling the brightness of the narrow field image data at a plurality of pixels along the line segment at said angles; and processing the brightness samples to obtain one or more metrics and/or classifiers for use in a diagnosis of the potential skin lesion. ### Claim 2 (depends on 1) The method according to claim 1, further comprising obtaining third narrow field image data from the target area with a third camera having a third narrow field of view narrower than the second narrow field of view, said third narrow field of view being the field of view of a confocal microscope. ### Claim 3 (depends on 2) The method according to claim 2, further comprising obtaining fourth narrow field image data from the target area with a fourth camera having a fourth narrow field of view narrower than the third field of view, said fourth narrow field of view being determined by Raman spectrometer. ### Claim 4 (depends on 1) The method according to claim 1, wherein processing the wide field image data includes statistical evaluation of the size and irregularity of lesions in the first area. ### Claim 5 (depends on 1) The method according to claim 1, wherein the one or more metrics and/or classifiers define the rotational distribution of one or more properties selected from the group consisting of [a] spatial texture features; [b] brightness features; [c] features of a lesion image edge/border, including the sharpness with which the lesion borders normal skin; [d] color variation of a lesion image; [e] variations in the features of the pigmented network including the length, shape, brightness and organization of pigmented network segments; and [f] oxygen saturation tissue as defined by an amount and ratio of oxyhemoglobin and deoxyhemoglobin said metrics and/or one or more classifiers being used to provide the diagnosis. ### Claim 6 (depends on 1) The method according to claim 1, wherein the wide field image data is red-green-blue image data. ### Claim 7 (depends on 6) The method according to claim 6, wherein the wide field image data is obtained with a camera integrated with a cellular phone. ### Claim 8 (depends on 1) The method according to claim 1, wherein the wide field image data is obtained with a camera worn on a user's body, capable of projecting images to the wearer, and having interactive processing capability. ### Claim 9 (depends on 1) The method according to claim 1, wherein the wide field image data is hyperspectral image data. ### Claim 10 (depends on 1) The method according to claim 1, wherein the second narrow field image data is red-green-blue image data. ### Claim 11 (depends on 1) The method according to claim 1, wherein the second narrow field image data is hyperspectral image data. ### Claim 12 (depends on 1) The method according to claim 1, wherein the first and second cameras, first and second lens, and first and second illumination systems are in a single camera unit, further comprising the step of respectively switching the first and second lenses and the first and second illumination systems to obtain the wide field image data and second narrow field image data. ### Claim 13 (depends on 1) The method according to claim 1, comprising successively processing meter scale image data, centimeter scale image data, millimeter scale image data and micrometer scale image data with respective scale focal length focusing systems to obtain diagnostic information at each respective focal length. ### Claim 14 A system of diagnostic imaging of one or more skin lesions on a subject's skin, comprising: a wide field camera having a first lens with a wide field of view and a first illumination system adapted to illuminate a first area on the subject's skin corresponding to the first field of view; a narrow field camera having a second lens with a narrow field of view and a second illumination system at one or more wavelengths, different from those of the first illumination system, adapted to illuminate a target area of a potential skin lesion within the first area; and a processor operatively connected to the wide field camera and the narrow field camera adapted to obtain and process image data from the wide field camera and the narrow field camera, wherein the processor: (1) processes image data from the wide field camera to identify the target area, (2) processes the image data from the narrow field camera to locate a center and border of the potential skin lesion and determine that the potential skin lesion is in fact in the target area, (3) creates a line segment extending out from the center to the border, (4) rotates the line segment about the center at a plurality of angles, (5) samples the brightness of the image data from the narrow field camera at a plurality of pixels along the line segment at said angles, and (6) processes the brightness samples to provide one or more metrics and/or classifiers for use in a diagnosis of said potential skin lesion. ### Claim 15 (depends on 14) The system according to claim 14, wherein the first lens and second lens are incorporated in a single camera unit switchable from a wide field of view to a narrow field of view, the first lens having a longer focal length than the second lens. ### Claim 16 (depends on 15) The system according to claim 15, wherein the single camera unit further comprises the first illumination system and the second illumination system. ### Claim 17 (depends on 15) The system according to claim 15, wherein the first camera includes at least one Charged Coupled Device (CCD) sensor or Complementary Metal Oxide Semiconductor (CMOS) sensor detecting Red Green and Blue (RGB) light. ### Claim 18 (depends on 15) The system according to claim 15, wherein the first camera includes at least one Charged Coupled Device (CCD) sensor or Complementary Metal Oxide Semiconductor (CMOS) sensor detecting hyperspectral wavelengths of light. ### Claim 19 (depends on 14) The system according to claim 14, wherein the processor the one or more metrics and/or classifiers define the rotational distribution of properties selected from the group consisting of [a] spatial texture features; [b] brightness features or [c] features of the lesion image edge/border, including the sharpness with which the lesion borders normal skin; [d] color variation of a lesion on the subject's skin; [e] variations in features of a pigmented network including the length, shape, brightness and organization of pigmented network segments; and [f] oxygen saturation of tissue as defined by the amount and ratio of oxyhemoglobin and deoxyhemoglobin said metrics and/or one or more classifiers being used to provide the diagnosis. ### Claim 20 (depends on 14) The system according to claim 14, wherein one of the first illumination system and the second illumination system provides illumination at RGB wavelengths of light, and the other illumination system provides illumination at hyperspectral wavelengths of light.