# US 12,112,559 B2 · Image processing method, image processing apparatus, and image processing system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,112,559 B2
- Document ID: US12112559B2
- Status: Granted
- Kind: B2
- Application number: 17/840,635
- Filed: 2022-06-15
- Published: 2023-09-28
- Granted: 2024-10-08
- Earliest claimed: 2022-03-24
- Assignees: Wistron Corporation
- Applicants: Wistron Corporation
- Inventors: Yin-Zong Chen
- Web page: https://patentgrep.com/patent/US12112559B2

## CPC

- G06F 16/538: Presentation of query results
- G06V 20/70: Labelling scene content, e.g. deriving syntactic or semantic representations
- G06F 16/51: Indexing; Data structures therefor; Storage structures
- G06T 3/40: Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G06V 10/22: by selection of a specific region containing or referencing a pattern; Locating or processing of specific regions to guide the detection or recognition
- G06V 10/25: Determination of region of interest [ROI] or a volume of interest [VOI]
- G06V 10/82: using neural networks
- G06V 20/60: Type of objects
- G06T 2200/24: involving graphical user interfaces [GUIs]
- G06T 2207/20212: Image combination
- G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69)
- G06V 2201/03: Recognition of patterns in medical or anatomical images
- G06V 2201/07: Target detection
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

An image processing method, an image processing apparatus, and an image processing system are provided. In the method, a target object is determined in an original image to generate a labeling result. The labeling result includes a position of the target object in the original image. Multiple target images of the target object are generated according to the labeling result. The target images are generated by extracting image of the target object from the original image and changing an image size of the image of the target object. A corresponding target image is combined with the original image according to a zoom operation. The zoom operation is configured to change an image size for displaying the original image.

## Claims

### Claim 1

An image processing method comprising:
determining a target object in an original image to generate a labeling result, wherein the labeling result comprises a position of the target object in the original image;
generating a plurality of target images of the target object according to the labeling result, wherein the target images are generated by extracting an image of the target object from the original image and changing an image size of the image of the target object; and
combining a corresponding one of the target images with the original image according to a zoom operation, wherein the zoom operation is configured to change an image size for displaying the original image.

### Claim 2 (depends on 1)

The image processing method according to claim 1, further comprising:
providing a viewer to display the original image; and
receiving the zoom operation on the original image displayed by the viewer.

### Claim 3 (depends on 1)

The image processing method according to claim 1, wherein the labeling result comprises a mask array, the mask array records the position of the target object in the original image, the mask array comprises a first value and a second value, an element having the first value in the mask array indicates that the target object is present in a region in the original image corresponding to the element having the first value, and another element having the second value in the mask array indicates that the target object is not present in a region in the original image corresponding to the element having the second value, and wherein generating the target images of the target object according to the labeling result comprises:
extracting the region in the original image corresponding to the element having the first value in the mask array; and
generating the target images according to the region that is extracted.

### Claim 4 (depends on 3)

The image processing method according to claim 3, wherein generating the target images comprises:
removing the region in the original image corresponding to the element having the second value in the mask array.

### Claim 5 (depends on 1)

The image processing method according to claim 1, wherein generating the target images of the target object according to the labeling result comprises:
extracting the image of the target object from the original image of an initial image size to serve as a first image among the target images; and
changing the first image from the initial image size into a changed image size to generate a second image among the target images.

### Claim 6 (depends on 5)

The image processing method according to claim 5, wherein the initial image size is a multiple of the changed image size.

### Claim 7 (depends on 1)

The image processing method according to claim 1, wherein generating the target images of the target object according to the labeling result comprises:
determining file locations of the target images according to image sizes of the target images.

### Claim 8 (depends on 7)

The image processing method according to claim 7, wherein combining the corresponding one of the target images with the original image according to the zoom operation comprises:
converting a ratio corresponding to the zoom operation into an identification code;
obtaining the file location corresponding to one of the target images according to the identification code; and
obtaining the one of the target images according to the file location that is obtained.

### Claim 9 (depends on 7)

The image processing method according to claim 7, wherein determining the file locations of the target images according to the image sizes of the target images comprises:
determining filenames of the target images according to the image sizes of the target images; and
storing the target images to a folder.

### Claim 10

An image processing apparatus comprising:
a storage device configured to store a programming code; and
a processor coupled to the storage device and configured to load and execute the programming code to:
determine a target object in an original image to generate a labeling result, wherein the labeling result comprises a position of the target object in the original image;
generate a plurality of target images of the target object according to the labeling result, wherein the target images are generated by extracting an image of the target object from the original image and changing an image size of the image of the target object; and
combine a corresponding one of the target images with the original image according to a zoom operation, wherein the zoom operation is configured to change an image size for displaying the original image.

### Claim 11 (depends on 10)

The image processing apparatus according to claim 10, wherein the processor is further configured to:
provide a viewer to display the original image; and
receive the zoom operation on the original image displayed by the viewer.

### Claim 12 (depends on 10)

The image processing apparatus according to claim 10, wherein the labeling result comprises a mask array, the mask array records the position of the target object in the original image, the mask array comprises a first value and a second value, an element having the first value in the mask array indicates that the target object is present in a region in the original image corresponding to the element having the first value, and another element having the second value in the mask array indicates that the target object is not present in a region in the original image corresponding to the element having the second value, and wherein the processor is further configured to:
extract the region in the original image corresponding to the element having the first value in the mask array; and
generate the target images according to the region that is extracted.

### Claim 13 (depends on 12)

The image processing apparatus according to claim 12, wherein the processor is further configured to:
remove the region in the original image corresponding to the element having the second value in the mask array.

### Claim 14 (depends on 10)

The image processing apparatus according to claim 10, wherein the processor is further configured to:
extract the image of the target object from the original image of an initial image size to serve as a first image among the target images; and
change the first image from the initial image size into a changed image size to generate a second image among the target images.

### Claim 15 (depends on 14)

The image processing apparatus according to claim 14, wherein the initial image size is a multiple of the changed image size.

### Claim 16 (depends on 10)

The image processing apparatus according to claim 10, wherein the processor is further configured to:
determine file locations of the target images according to image sizes of the target images.

### Claim 17 (depends on 16)

The image processing apparatus according to claim 16, wherein the processor is further configured to:
convert a ratio corresponding to the zoom operation into an identification code;
obtain the file location corresponding to one of the target images according to the identification code; and
obtain the one of the target images according to the file location that is obtained.

### Claim 18 (depends on 16)

The image processing apparatus according to claim 16, wherein the processor is further configured to:
determine filenames of the target images according to the image sizes of the target images; and
store the target images to a folder.

### Claim 19

An image processing system comprising:
a viewer server; and
an inference server, wherein
the inference server determines a target object in an original image to generate a labeling result, wherein the labeling result comprises a position of the target object in the original image;
the inference server generates a plurality of target images of the target object according to the labeling result, wherein the target images are generated by extracting an image of the target object from the original image and changing an image size of the image of the target object; and
the viewer server combines a corresponding one of the target images with the original image according to a zoom operation, wherein the zoom operation is configured to change an image size for displaying the original image.

### Claim 20 (depends on 19)

The image processing system according to claim 19, further comprising:
an image server storing the target images generated by the inference server, wherein
the inference server determines file locations of the target images in the image server according to image sizes of the target images;
the viewer server converts a ratio corresponding to the zoom operation into an identification code;
the viewer server obtains the file location corresponding to one of the target images according to the identification code; and
the viewer server obtains the one of the target images according to the file location that is obtained.
