# US 2026/0073594 A1 · Image augmentation device and method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0073594 A1
- Document ID: US20260073594A1
- Status: Published application
- Kind: A1
- Application number: 19/319,759
- Filed: 2025-09-05
- Published: 2026-03-12
- Earliest claimed: 2024-09-12
- Assignees: Hon Hai Precision Industry Co., Ltd.; Foxconn Technology Group Co., Ltd.
- Applicants: Hon Hai Precision Industry Co., Ltd.; Foxconn Technology Group Co., Ltd.
- Inventors: Yung-Hui LI; Nien-Yi JAN; Kai-Lin YANG; Yi-Rong LIN; Yudong MAO; Xing TIAN; Yibing LIU
- Web page: https://patentgrep.com/patent/US20260073594A1

## CPC

- G06T 11/60: Creating or editing images; Combining images with text
- G06T 5/60: using machine learning, e.g. neural networks
- G06T 5/70: Denoising; Smoothing
- G06T 11/00: Two-dimensional [2D] image generation
- G06T 2207/20084: Artificial neural networks [ANN]
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

An image augmentation device and method are provided. The image augmentation device inputs a noise image corresponding to an original image and semantic information and a text vector corresponding to the original image into a diffusion model to generate a generated image, and the generated image includes a partial contour of the original image. The image augmentation device composites the generated image and a plurality of guide images to generate an augmented image.

## Claims

### Claim 1

An image augmentation device, comprising:
a storage, configured to store a diffusion model; and
a processor, electrically connected to the storage and performing the following operations:
inputting a noise image corresponding to an original image and semantic information and a text vector corresponding to the original image into the diffusion model to generate a generated image, wherein the generated image comprises a partial contour of the original image, and the semantic information comprises a plurality of semantic categories and a plurality of semantic ranges corresponding to the semantic categories; and
compositing the generated image and a plurality of guide images to generate an augmented image, wherein the guide images are generated by segmenting the original image based on the semantic ranges.

### Claim 2 (depends on 1)

The image augmentation device according to claim 1, wherein the noise image corresponding to the original image is generated based on the following operation:
performing a noise addition operation on the original image to generate the noise image corresponding to the original image.

### Claim 3 (depends on 1)

The image augmentation device according to claim 1, wherein the text vector is generated based on the following operation:
performing a coding operation on a text to generate the text vector, wherein the text is used to indicate the semantic categories.

### Claim 4 (depends on 3)

The image augmentation device according to claim 3, wherein the text is further used to indicate an augmentation type corresponding to each of the semantic categories.

### Claim 5 (depends on 1)

The image augmentation device according to claim 1, wherein an operation of inputting the noise image, the semantic information, and the text vector corresponding to the original image into the diffusion model to generate the generated image further comprises the following operations:
generating a plurality of attention matrices corresponding to the semantic categories based on the noise image and the text vector;
generating a plurality of mask attention matrices corresponding to the semantic categories based on the semantic ranges corresponding to the semantic categories; and
generating the generated image based on the mask attention matrices and the text vector.

### Claim 6 (depends on 5)

The image augmentation device according to claim 5, wherein the attention matrices comprise at least a first attention matrix and a second attention matrix, the semantic categories comprise at least a first semantic category and a second semantic category, and the semantic ranges comprise at least a first semantic range and a second semantic range.

### Claim 7 (depends on 6)

The image augmentation device according to claim 6, wherein the processor further performs the following operations:
performing a mask operation on the first attention matrix based on the first semantic range corresponding to the first semantic category to generate a first mask attention matrix; and
performing the mask operation on the second attention matrix based on the second semantic range corresponding to the second semantic category to generate a second mask attention matrix.

### Claim 8 (depends on 1)

The image augmentation device according to claim 1, wherein the guide images comprise at least a first guide image and a second guide image, and the first guide image and the second guide image are generated based on the following operations:
segmenting, based on a first semantic range corresponding to a first semantic category, the first guide image corresponding to the first semantic category from the original image, wherein the first semantic category is one of the semantic categories, and the first semantic range is one of the semantic ranges; and
segmenting, based on a second semantic range corresponding to a second semantic category, the second guide image corresponding to the second semantic category from the original image, wherein the second semantic category is one of the semantic categories, and the second semantic range is one of the semantic ranges.

### Claim 9 (depends on 8)

The image augmentation device according to claim 8, wherein an operation of compositing the generated image and the guide images to generate the augmented image further comprises the following operations:
compositing the generated image and the first guide image based on a guided filter and the first semantic range to generate a first augmented image;
compositing the generated image and the second guide image based on the guided filter and the second semantic range to generate a second augmented image; and
combining the first augmented image and the second augmented image to generate the augmented image.

### Claim 10 (depends on 9)

The image augmentation device according to claim 9, wherein an operation of combining the first augmented image and the second augmented image to generate the augmented image further comprises the following operation:
combining the first augmented image and the second augmented image based on a first weight corresponding to the first augmented image and a second weight corresponding to the second augmented image to generate the augmented image.

### Claim 11

An image augmentation method, applied to an electronic device, wherein the electronic device comprises a storage and a processor, the storage is configured to store a diffusion model, and the image augmentation method comprises the following steps:
inputting a noise image corresponding to an original image and semantic information and a text vector corresponding to the original image into the diffusion model to generate a generated image, wherein the generated image comprises a partial contour of the original image, and the semantic information comprises a plurality of semantic categories and a plurality of semantic ranges corresponding to the semantic categories; and
compositing the generated image and a plurality of guide images to generate an augmented image, wherein the guide images are generated by segmenting the original image based on the semantic ranges.

### Claim 12 (depends on 11)

The image augmentation method according to claim 11, wherein the noise image corresponding to the original image is generated based on the following step:
performing a noise addition operation on the original image to generate the noise image corresponding to the original image.

### Claim 13 (depends on 11)

The image augmentation method according to claim 11, wherein the text vector is generated based on the following step:
performing a coding operation on a text to generate the text vector, wherein the text is used to indicate the semantic categories.

### Claim 14 (depends on 13)

The image augmentation method according to claim 13, wherein the text is further used to indicate an augmentation type corresponding to each of the semantic categories.

### Claim 15 (depends on 11)

The image augmentation method according to claim 11, wherein a step of inputting the noise image, the semantic information, and the text vector corresponding to the original image into the diffusion model to generate the generated image further comprises the following steps:
generating a plurality of attention matrices corresponding to the semantic categories based on the noise image and the text vector;
generating a plurality of mask attention matrices corresponding to the semantic categories based on the semantic ranges corresponding to the semantic categories; and
generating the generated image based on the mask attention matrices and the text vector.

### Claim 16 (depends on 15)

The image augmentation method according to claim 15, wherein the attention matrices comprise at least a first attention matrix and a second attention matrix, the semantic categories comprise at least a first semantic category and a second semantic category, and the semantic ranges comprise at least a first semantic range and a second semantic range.

### Claim 17 (depends on 16)

The image augmentation method according to claim 16, further comprising the following steps:
performing a mask operation on the first attention matrix based on the first semantic range corresponding to the first semantic category to generate a first mask attention matrix; and
performing the mask operation on the second attention matrix based on the second semantic range corresponding to the second semantic category to generate a second mask attention matrix.

### Claim 18 (depends on 11)

The image augmentation method according to claim 11, wherein the guide images comprise at least a first guide image and a second guide image, and the first guide image and the second guide image are generated based on the following steps:
segmenting, based on a first semantic range corresponding to a first semantic category, the first guide image corresponding to the first semantic category from the original image, wherein the first semantic category is one of the semantic categories, and the first semantic range is one of the semantic ranges; and
segmenting, based on a second semantic range corresponding to a second semantic category, the second guide image corresponding to the second semantic category from the original image, wherein the second semantic category is one of the semantic categories, and the second semantic range is one of the semantic ranges.

### Claim 19 (depends on 18)

The image augmentation method according to claim 18, wherein a step of compositing the generated image and the guide images to generate the augmented image further comprises the following steps:
compositing the generated image and the first guide image based on a guided filter and the first semantic range to generate a first augmented image;
compositing the generated image and the second guide image based on the guided filter and the second semantic range to generate a second augmented image; and
combining the first augmented image and the second augmented image to generate the augmented image.

### Claim 20 (depends on 19)

The image augmentation method according to claim 19, wherein a step of combining the first augmented image and the second augmented image to generate the augmented image further comprises the following step:
combining the first augmented image and the second augmented image based on a first weight corresponding to the first augmented image and a second weight corresponding to the second augmented image to generate the augmented image.
