# US 11,896,345 B2 · Device for producing an image of depth-dependent morphological structures of skin lesions

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,896,345 B2
- Document ID: US11896345B2
- Status: Granted
- Kind: B2
- Application number: 17/637,873
- Filed: 2020-05-13
- Published: 2022-09-22
- Granted: 2024-02-13
- Earliest claimed: 2019-08-26
- Assignees: Fotofinder Systems GmbH
- Applicants: Fotofinder Systems GmbH
- Inventors: Andreas Mayer
- Web page: https://patentgrep.com/patent/US11896345B2

## CPC

- A61B 5/0077: {Devices for viewing the surface of the body, e.g. camera, magnifying lens}
- A61B 5/0068: {Confocal scanning}
- A61B 5/444: {Evaluating skin marks, e.g. mole, nevi, tumour, scar}
- A61B 5/445: {Evaluating skin irritation or skin trauma, e.g. rash, eczema, wound, bed sore}
- A61B 5/7425: {Displaying combinations of multiple images regardless of image source, e.g. displaying a reference anatomical image with a live image}
- A61B 5/743: {Displaying an image simultaneously with additional graphical information, e.g. symbols, charts, function plots}
- G03B 13/36: Autofocus systems
- G06F 18/24143: {Distances to neighbourhood prototypes, e.g. restricted Coulomb energy networks [RCEN]}
- G06V 10/454: {Integrating the filters into a hierarchical structure, e.g. convolutional neural networks [CNN]}
- G06V 10/82: using neural networks
- H04N 7/183: {for receiving images from a single remote source}
- H04N 23/55: Optical parts specially adapted for electronic image sensors; Mounting thereof
- H04N 23/56: provided with illuminating means
- H04N 23/635: {Region indicators; Field of view indicators}
- H04N 23/69: Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
- H04N 23/959: by adjusting depth of field during image capture, e.g. maximising or setting range based on scene characteristics
- A61B 5/4842: {Monitoring progression or stage of a disease}
- A61B 5/7264: {Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems}
- A61B 5/7475: {User input or interface means, e.g. keyboard, pointing device, joystick}
- G06V 2201/03: Recognition of patterns in medical or anatomical images
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G03B: APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR (optical parts of such apparatus G02B; photosensitive materials or processes for photographic purposes G03C; apparatus for processing exposed photographic materials G03D)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A device for producing a plurality of images for assisting in characterizing skin lesions, the device includes a capturing unit for selectively illuminating and capturing recordings of an area of skin presenting a skin lesion, the capturing unit comprising magnifying optics providing at least 160× optical magnification of the area of skin for capturing morphological structures of the skin lesion; a focusing unit associated with the magnifying optics and configured to place a focal plane of the magnifying optics in a plurality of different depth planes below a skin surface of the area of skin starting from the skin surface; a control unit configured to control the focusing unit or the capturing unit and preferably controlling them in such a manner that the capturing unit captures a recording when the focal plane is located in a respective depth plane; and a processing and output unit for image production based on the image information provided by the capturing unit.

## Claims

### Claim 1

A device (10) for producing a plurality of images for assisting in characterizing skin lesions, the device comprising:
a capturing unit (1) configured to selectively illuminate and capture recordings of an area of skin (11) presenting a skin lesion (12), the capturing unit (1) comprising a camera and magnifying optics (2) providing at least 160× optical magnification of the area of skin (11) for capturing morphological structures of the skin lesion (12);
a focusing unit (3) comprising manual or automatic adjusting means associated with the magnifying optics (2) and configured to place a focal plane (F) of the magnifying optics (2) in a plurality of different depth planes (t1, . . . , tn) below a skin surface (t0) of the area of skin (11) starting from the skin surface;
a computing unit (4) comprising at least one processor and at least one memory, the computing unit configured to control the focusing unit (3) or the capturing unit (1) in such a manner that the capturing unit (1) captures a recording when the focal plane (F) is located in a respective depth plane (t1, . . . , tn), and the computing unit is configured for image production based on the image information provided by the capturing unit (1), wherein the computing unit (4) is configured to display a respective detail image (13) of morphological structures of the skin lesion (12) in a respective depth plane (t1, . . . , tn) as a live video image and as an individual image in combination with a variable control element (15) for displaying and adapting the respective depth plane (t1, . . . , tn) and in combination with a captured reference image (14) of the skin lesion (12).

### Claim 2 (depends on 1)

The device according to claim 1, wherein the magnifying optics (2) allows 250× to 400× optical magnification of the area of skin (11).

### Claim 3 (depends on 1)

The device according to claim 1, wherein the focusing unit (3) is configured to automatically or manually place the focal plane (F) in a depth plane (t1, . . . , tn) of 1 to 50 μm below the skin surface (t0).

### Claim 4 (depends on 1)

The device according to claim 1, wherein the focusing unit (3) is configured to automatically or manually vary the focal plane (F) in steps of 1 to 7 μm.

### Claim 5 (depends on 1)

The device according to claim 1, wherein the computing unit (4) is configured to control the focusing unit (3) or the capturing unit (1) in such a manner that a plurality of predefined depth planes (t1, . . . , tn) are focused one after the other in one sequence and at least one recording is captured in each depth plane.

### Claim 6 (depends on 1)

The device according to claim 1, wherein the magnifying optics (2) and the associated focusing unit (3) are integrated in an exchangeable front-end module (1b) for a camera module (1a) of the capturing unit (1).

### Claim 7 (depends on 1)

The device according to claim 1, wherein the capturing unit (1) comprises illuminating means (6) for reflected-light illumination (6a) or direct coupling in of light (6b) into the area of skin (2), the illuminating means (6) being integrated in or connectable to the capturing unit (1).

### Claim 8 (depends on 1)

The device according to claim 1, wherein the device (10) comprises a positioning unit (7) configured to selectively project a marking onto the area of skin.

### Claim 9 (depends on 1)

The device according to claim 1, wherein the computing unit (5) is configured to display an indicator (14a) for the respective current position of the displayed detail image (13) of the skin lesion (12) in the reference image (14).

### Claim 10 (depends on 1)

The device according to claim 1,
wherein the computing unit (5) is configured to display a clinical overview image (16) of a patient (P) in combination with the respective detail image (13) of the skin lesion (12) or a captured reference image (14) of the skin lesion (12), the clinical overview image (16) containing an indicator (16a) for the respective position of the displayed skin lesion (12) in the clinical overview image (16).

### Claim 11 (depends on 1)

The device according to claim 1, further comprising a processor and memory unit (8) configured to pre-characterize or assess the captured detail image (13) of morphological structures of the area of skin, and to output an associated information based thereon, by means of the processing and output unit (5).

### Claim 12 (depends on 1)

A method for producing a plurality of images for assisting in characterizing skin lesions, using the device (10) according to claim 1, the method comprising the following steps:
illuminating an area of skin (11) to be examined by means of illuminating means (6);
selectively focusing an optical capturing unit (1) with associated magnifying optics (2) on a plurality of different depth planes (t1, . . . , tn) below a skin surface (H) stating from the skin surface (H), the magnifying optics (2) allowing at least 160× optical magnification of the area of skin (11) for capturing morphological structures of a skin lesion (12) in the area of skin (11);
capturing at least one recording of the skin lesion (12) in a respective depth plane (t1, . . . , tn) by means of a capturing unit (1);
producing at least one detail image (13) of morphological structures of the skin lesion (12) based on the image information provided by the capturing unit (1);
displaying, with a computing unit, a respective detail image (13) of morphological structures of the skin lesion (12) in a respective depth plane (t1, . . . , tn) as a live video image and as an individual image; and
displaying and adapting, with a variable control element (15), the respective depth plane (t1, . . . , tn) and in combination with a captured reference image (14) of the skin lesion (12).

### Claim 13 (depends on 12)

The method according to claim 12, wherein the focusing into the respective depth planes takes place automatically and in steps at predefined intervals.

### Claim 14 (depends on 12)

The method according to claim 12, wherein predefined depth planes (t1, . . . , tn) are focused one after the other in one sequence and at least one recording is captured and stored after the respective focusing.

### Claim 15 (depends on 12)

The method according to claim 12, the method comprising the following further steps:
capturing a skin lesion (12) to be examined; and displaying the reference image (14) of the skin lesion (12) in combination with the associated detail image (13) of the skin lesion (12) on a display (5a) of the computing unit (4).

### Claim 16 (depends on 15)

The method according to claim 15, the method comprising the further step of displaying an indicator (14a) for marking a current position of the displayed detail image (13) in the skin lesion (12).