# US 11,026,624 B2 · Measuring and monitoring skin feature colors, form and size

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,026,624 B2
- Document ID: US11026624B2
- Status: Granted
- Kind: B2
- Application number: 16/438,649
- Filed: 2019-06-12
- Published: 2019-09-26
- Granted: 2021-06-08
- Earliest claimed: 2015-01-27
- Assignees: Healthy.Io Ltd.
- Applicants: Healthy.Io Ltd.
- Inventors: Yonatan Adiri; Ido Omer; Shachar Mendelowitz; Roee Salomon
- Web page: https://patentgrep.com/patent/US11026624B2

## CPC

- A61B 5/444: {Evaluating skin marks, e.g. mole, nevi, tumour, scar}
- A61B 5/0077: {Devices for viewing the surface of the body, e.g. camera, magnifying lens}
- A61B 5/1032: {Determining colour of tissue for diagnostic purposes}
- A61B 5/1034: {by means of colour cards}
- A61B 5/1077: {Measuring of profiles}
- A61B 5/1079: {using optical or photographic means}
- G06T 7/0016: {involving temporal comparison}
- G06T 7/90: Determination of colour characteristics
- G06V 10/17: {using hand-held instruments}
- G06V 10/56: relating to colour
- G06V 20/00: Scenes; Scene-specific elements (control of digital cameras H04N23/60)
- G06V 20/64: Three-dimensional [3D] objects
- H04N 1/6033: {using test pattern analysis (H04N1/6055 takes precedence)}
- H04N 1/628: {Memory colours, e.g. skin or sky}
- A61B 5/7264: {Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems}
- A61B 5/743: {Displaying an image simultaneously with additional graphical information, e.g. symbols, charts, function plots}
- A61B 2560/0233: Optical standards
- A61B 2576/02: specially adapted for a particular organ or body part
- G06T 2207/10024: Color image
- G06T 2207/30088: Skin; Dermal
- G06T 2207/30096: Tumor; Lesion
- G06V 2201/03: Recognition of patterns in medical or anatomical images
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Kits, diagnostic systems and methods are provided, which measure the distribution of colors of skin features by comparison to calibrated colors which are co-imaged with the skin feature. The colors on the calibration template (calibrator) are selected to represent the expected range of feature colors under various illumination and capturing conditions. The calibrator may also comprise features with different forms and size for calibrating geometric parameters of the skin features in the captured images. Measurements may be enhanced by monitoring over time changes in the distribution of colors, by measuring two and three dimensional geometrical parameters of the skin feature and by associating the data with medical diagnostic parameters. Thus, simple means for skin diagnosis and monitoring are provided which simplify and improve current dermatologic diagnostic procedures.

## Claims

### Claim 1

A non-transitory computer readable storage medium storing instructions that, when executed by a processor, cause the processor to perform a method for three-dimensional image skin diagnosis, the method comprising:
receiving a group of images of a skin feature next to a calibrator having a plurality of colored areas thereon, wherein the skin feature has multiple segments of differing colors;
identifying, using the group of images, a three-dimensional structure of the skin feature;
identifying, using the plurality of colored areas of the calibrator, the differing colors of the multiple segments of the skin feature, wherein the identification includes determining actual colors of the multiple segments of the skin feature by comparison of the colors of the multiple segments of the skin feature to the plurality of colored areas of the calibrator commonly captured on at least one image; and
based on the identified three-dimensional structure of the skin feature and the differing colors of the multiple segments of the skin feature, determining an indication of a medical condition associated with the skin feature.

### Claim 2 (depends on 1)

The non-transitory computer readable storage medium of claim 1, wherein identifying the three-dimensional structure of the skin feature includes determining at least one three-dimensional geometrical parameter of the skin feature.

### Claim 3 (depends on 1)

The non-transitory computer readable storage medium of claim 1, wherein determining the indication of the medical condition is based on a rate of change of at least one skin feature parameter selected from a group including: a distribution of colors, a three-dimensional geometrical parameter, and dimensions of at least one segment of the skin feature.

### Claim 4 (depends on 3)

The non-transitory computer readable storage medium of claim 3, wherein the method further comprises:
tracking the medical condition over time using comparisons from multiple groups of images received periodically.

### Claim 5 (depends on 1)

The non-transitory computer readable storage medium of claim 1, wherein the method further comprises:
monitoring temporal changes of at least one skin feature parameter selected from a group including: a distribution of colors, a three-dimensional geometrical parameter, and dimensions of at least one segment of the skin feature to track a healing progress of a skin feature.

### Claim 6 (depends on 1)

The non-transitory computer readable storage medium of claim 1, wherein the plurality of colored areas are associated with an expected range of colors of the skin feature under various illumination and capturing conditions.

### Claim 7 (depends on 1)

The non-transitory computer readable storage medium of claim 1, wherein the method further comprises:
determining distribution of colors in the three-dimensional structure of the skin feature; and
determining the indication of the medical condition based on the distribution of colors in the three-dimensional structure.

### Claim 8 (depends on 1)

The non-transitory computer readable storage medium of claim 1, wherein the method further comprises:
determining a height of the three-dimensional structure of the skin feature; and
determining the indication of the medical condition based on the height of the three-dimensional structure.

### Claim 9

A method for three-dimensional image skin diagnosis, the method comprising:
receiving a group of images of a skin feature next to a calibrator having a plurality of colored areas thereon, wherein the skin feature has multiple segments of differing colors;
identifying, using the group of images, a three-dimensional structure of the skin feature;
identifying, using the plurality of colored areas of the calibrator, the differing colors of the multiple segments of the skin feature, wherein the identification includes determining actual colors of the multiple segments of the skin feature by comparison of the colors of the multiple segments of the skin feature to the plurality of colored areas of the calibrator commonly captured on at least one image; and
based on the identified three-dimensional structure of the skin feature and the differing colors of the multiple segments of the skin feature, determining an indication of a medical condition associated with the skin feature.

### Claim 10 (depends on 9)

The method of claim 9, wherein the plurality of colored areas on the calibrator have different sizes.

### Claim 11 (depends on 9)

The method of claim 9, wherein the calibrator includes a first set of colors expected to be found in the skin feature.

### Claim 12 (depends on 11)

The method of claim 11, wherein the calibrator includes a second set of colors different from the first set for calibrating illumination conditions.

### Claim 13 (depends on 11)

The method of claim 11, further comprising:
determining a skin color of a patient; and
considering the skin color when identify the differing colors of the multiple segments of the skin feature.

### Claim 14 (depends on 11)

The method of claim 11, further comprising:
identifying at least one illumination condition associated with the group of images; and
reducing the effect of the at least one illumination condition on the differing colors of the multiple segments of the skin feature.

### Claim 15 (depends on 14)

The method of claim 14, further comprising:
generating an alert when at least one illumination condition is inappropriate for accurate color detection; and
suggesting a modification to the identified at least one illumination condition.

### Claim 16 (depends on 9)

The method of claim 9, wherein the calibrator includes one or more holes to accommodate the skin feature.

### Claim 17 (depends on 9)

The method of claim 9, further comprising:
identifying at least one capturing condition associated with the group of images; and
reducing the effect of the at least one capturing condition on the differing colors of the multiple segments of the skin feature.

### Claim 18 (depends on 9)

The method of claim 9, further comprising:
generating an alert when at least one capturing condition is inappropriate for accurate color detection; and
suggesting a modification to the identified at least one capturing condition.

### Claim 19

A system for three-dimensional image skin diagnosis, the system comprising:
at least one processing device configured to;
receive a group of images of a skin feature next to a calibrator having a plurality of colored areas thereon, wherein the skin feature has multiple segments of differing colors;
identify, using the group of images, a three-dimensional structure of the skin feature;
identify, using the plurality of colored areas of the calibrator, the differing colors of the multiple segments of the skin feature, wherein the identification includes determining actual colors of the multiple segments of the skin feature by comparison of the colors of the multiple segments of the skin feature to the plurality of colored areas of the calibrator commonly captured on at least one image; and
based on the identified three-dimensional structure of the skin feature and the differing colors of the multiple segments of the skin feature, determine an indication of a medical condition associated with the skin feature.