# US 2024/0005447 A1 · Method and apparatus for image generation for facial disease detection model

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0005447 A1
- Document ID: US20240005447A1
- Status: Published application
- Kind: A1
- Application number: 17/855,798
- Filed: 2022-07-01
- Published: 2024-01-04
- Earliest claimed: 2022-07-01
- Assignees: Konica Minolta Business Solutions U.S.A., Inc.
- Applicants: Konica Minolta Business Solutions U.S.A., Inc.
- Inventors: Hajar EMAMI; Junchao WEI
- Web page: https://patentgrep.com/patent/US20240005447A1

## CPC

- G06T 3/14: Transformations for image registration, e.g. adjusting or mapping for alignment of images
- G06T 7/0012: {Biomedical image inspection}
- G06T 7/11: Region-based segmentation
- G06T 11/00: Two-dimensional [2D] image generation
- G06T 2207/20081: Training; Learning
- G06T 2207/20084: Artificial neural networks [ANN]
- G06T 2207/30201: Face
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Synthetic disease face image and disease facemask generation can provide training data for supervised learning of a variety of machine learning systems, including neural networks, which serve as detection models to detect disease or disorder affecting part or all of a person's face and/or cranium. Geometric transformations can be applied to facial images to generate the synthetic disease face images and disease facemasks.

## Claims

### Claim 1

A computer-implemented method comprising:
a. performing image segmentation on a facial image to identify discrete portions of a face;
b. generating a mask comprising said discrete portions;
c. modifying one or more of said discrete portions in said mask using a transformation to modify said one or more of said discrete portions to generate a mask simulating a medical condition;
d. applying said mask to said facial image to simulate said medical condition in said facial image;
e. repeating c. and d. while varying said transformation to simulate different degrees of said medical condition;
f. repeating a. to e. for each of a plurality of facial images to produce a simulated training set to train a deep learning system.

### Claim 2 (depends on 1)

The method of claim 1, wherein said medical condition is selected from the group consisting of ischemic stroke, hemorrhagic stroke, transient ischemic attack (mini-stroke or TIA), brain stem stroke, and cryptogenic stroke.

### Claim 3 (depends on 1)

The method of claim 1, wherein said medical condition is selected from the group consisting of trigeminal neuralgia, Bell's palsy, Ramsay Hunt syndrome, Treacher Collins syndrome, Jacobsen syndrome, and Crouzon syndrome.

### Claim 4 (depends on 1)

The method of claim 1, wherein said medical condition is moon face.

### Claim 5 (depends on 1)

The method of claim 1, wherein said transformation is a geometric transformation.

### Claim 6 (depends on 1)

The method of claim 1, wherein said image segmentation is performed in a machine learning system selected from the group consisting of fully convolutional neural networks and convolutional neural networks.

### Claim 7 (depends on 1)

The method of claim 1, wherein said applying comprises inputting said mask and said facial image to a generative adversarial network.

### Claim 8 (depends on 1)

The method of claim 1, further comprising training said deep learning system using said simulated training set.

### Claim 9 (depends on 8)

The method of claim 8, further comprising training said deep learning system using said simulated training set and actual disease face images.

### Claim 10 (depends on 1)

The method of claim 1, wherein said deep learning system comprises a neural network selected from the group consisting of convolutional neural networks, fully convolutional neural networks, and recurrent neural networks.

### Claim 11

A system comprising:
a processor; and
a non-transitory memory storing instructions which, when performed by the processor, perform a method comprising:
a. performing image segmentation on a facial image to identify discrete portions of a face;
b. generating a mask comprising said discrete portions;
c. modifying one or more of said discrete portions in said mask using a transformation to modify said one or more of said discrete portions to simulate a medical condition;
d. applying said modifying to said facial image to simulate said medical condition in said facial image;
e. repeating c. and d. while varying said transformation to simulate different degrees of said medical condition;
f. repeating a. to e. for each of a plurality of facial images to produce a simulated training set to train a deep learning system.

### Claim 12 (depends on 11)

The system of claim 11, wherein said medical condition is selected from the group consisting of ischemic stroke, hemorrhagic stroke, transient ischemic attack (mini-stroke or TIA), brain stem stroke, and cryptogenic stroke.

### Claim 13 (depends on 11)

The system of claim 11, wherein said medical condition is selected from the group consisting of trigeminal neuralgia, Bell's palsy, Ramsay Hunt syndrome, Treacher Collins syndrome, Jacobsen syndrome, and Crouzon syndrome.

### Claim 14 (depends on 11)

The system of claim 11, wherein said medical condition is moon face.

### Claim 15 (depends on 11)

The system of claim 11, wherein said transformation is a geometric transformation.

### Claim 16 (depends on 11)

The system of claim 11, wherein said image segmentation is performed in a machine learning system selected from the group consisting of fully convolutional neural networks and convolutional neural networks.

### Claim 17 (depends on 11)

The system of claim 11, wherein said applying comprises inputting said mask and said facial image to a generative adversarial network.

### Claim 18 (depends on 11)

The system of claim 11, further comprising training said deep learning system using said simulated training set.

### Claim 19 (depends on 18)

The system of claim 18, further comprising training said deep learning system using said simulated training set and actual disease face images.

### Claim 20 (depends on 11)

The system of claim 11, wherein said deep learning system comprises a neural network selected from the group consisting of convolutional neural networks, fully convolutional neural networks, and recurrent neural networks.
