# US 2024/0005468 A1 · Image distortion evaluation method and apparatus, and computer device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0005468 A1
- Document ID: US20240005468A1
- Status: Published application
- Kind: A1
- Application number: 18/034,631
- Filed: 2021-11-04
- Published: 2024-01-04
- Earliest claimed: 2020-11-11
- Assignees: Beijing Bytedance Network Technology Co., Ltd.
- Applicants: Beijing Bytedance Network Technology Co., Ltd.
- Inventors: Yao XIAO; Yang ZHANG
- Web page: https://patentgrep.com/patent/US20240005468A1

## CPC

- G06T 7/0002: {Inspection of images, e.g. flaw detection}
- G06T 5/00: Image enhancement or restoration
- G06T 7/41: based on statistical description of texture
- G06T 2207/20016: Hierarchical, coarse-to-fine, multiscale or multiresolution image processing; Pyramid transform
- G06T 2207/20021: Dividing image into blocks, subimages or windows
- G06T 2207/30168: Image quality inspection
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

An image distortion evaluation method and apparatus, and a computer device. The method comprises: acquiring an original image and an enhanced image; respectively performing partitioning processing on the original image and the enhanced image, so as to obtain a plurality of first blocks of the original image and a plurality of second blocks of the enhanced image; acquiring a preset proportionate window size that accords with the characteristics of human eye vision, and according to the proportionate window size, respectively compiling statistics on first proportion information entropies respectively corresponding to the plurality of first blocks of the original image and second proportion information entropies respectively corresponding to the plurality of second blocks of the enhanced image; determining a visual texture loss degree of the enhanced image according to the first proportion information entropies corresponding to the first blocks and the second proportion information entropies corresponding to the second blocks.

## Claims

### Claim 1

An image distortion evaluation method, comprising:
obtaining an original image and an enhanced image, wherein the enhanced image is generated by image enhancement on the original image;
performing block processing on the original image and the enhanced image separately to obtain a plurality of first blocks of the original image and a plurality of second blocks of the enhanced image;
obtaining a preset scale window size that conforms to human visual characteristics, and collecting statistics on a first scale information entropy corresponding to each of the plurality of first blocks of the original image and a second scale information entropy corresponding to each of the plurality of second blocks of the enhanced image according to the scale window size; and
determining a degree of visual texture loss of the enhanced image according to the first scale information entropy corresponding to each first block and the second scale information entropy corresponding to each second block.

### Claim 2 (depends on 1)

The method according to claim 1, wherein the collecting statistics on a first scale information entropy corresponding to each of the plurality of first blocks of the original image and a second scale information entropy corresponding to each of the plurality of second blocks of the enhanced image according to the scale window size comprises:
determining adjusted gray value distribution information corresponding to each of the plurality of first blocks of the original image based on initial gray value distribution information corresponding to each of the plurality of first blocks of the original image and the scale window size, and determining the first scale information entropy corresponding to each of the plurality of first blocks based on the adjusted gray value distribution information corresponding to each of the plurality of first blocks; and
determining adjusted gray value distribution information corresponding to each of the plurality of second blocks of the enhanced image based on initial gray value distribution information corresponding to each of the plurality of second blocks of the enhanced image and the scale window size, and determining the second scale information entropy corresponding to each of the plurality of second blocks based on the adjusted gray value distribution information corresponding to each of the plurality of second blocks, wherein
the number of pixels corresponding to each gray value in the adjusted gray value distribution information is a sum of pixels of each gray value in a target scale window corresponding to the gray value in the initial gray value distribution information; and a size of the target scale window matches the scale window size that conforms to human visual characteristics.

### Claim 3 (depends on 1)

The method according to claim 1, wherein the determining a degree of visual texture loss of the enhanced image according to the first scale information entropy corresponding to each first block and the second scale information entropy corresponding to each second block comprises:
determining a first information entropy difference between the original image and the enhanced image according to the first scale information entropy corresponding to each first block and the second scale information entropy corresponding to each second block; and
determining the degree of visual texture loss of the enhanced image based on the first information entropy difference.

### Claim 4 (depends on 3)

The method according to claim 3, wherein the method further comprises:
determining, based on initial gray value distribution information corresponding to each of the plurality of first blocks of the original image, a first initial information entropy corresponding to each first block, and determining, based on initial gray value distribution information corresponding to each of the plurality of second blocks of the enhanced image, a second initial information entropy corresponding to each second block; and
determining a second information entropy difference between the original image and the enhanced image according to the first initial information entropy corresponding to each first block and the second initial information entropy corresponding to each second block;
wherein the determining the degree of visual texture loss of the enhanced image based on the first information entropy comprises:
determining the degree of visual texture loss of the enhanced image based on the first information entropy difference and the second information entropy difference.

### Claim 5 (depends on 2)

The method according to claim 2, wherein the initial gray value distribution information and the adjusted gray value distribution information are used as target gray value distribution information separately, and a target information entropy is determined according to the following steps, wherein the target information entropy is the first scale information entropy, the second scale information entropy, the first initial information entropy, or the second initial information entropy:
using the first blocks and the second blocks as target blocks separately, and for each target block, determining the target information entropy corresponding to the target block based on the number of pixels, indicated by the target gray value distribution information, corresponding to each gray value of the target block, and the total number of pixels corresponding to the target block.

### Claim 6 (depends on 3)

The method according to claim 3, wherein a target information entropy difference is determined according to the following steps, wherein the target information entropy difference is the first information entropy difference or the second information entropy difference:
dividing differences of information entropies between corresponding blocks of the enhanced image and the original image into a first class and a second class, wherein the differences of information entropies in the first class are greater than or equal to 0, and the differences of information entropies in the second class are less than 0;
setting the differences of information entropies in the first class to 0, computing a standard deviation of the differences of information entropies in the second class, and determining, based on the standard deviation and the difference of information entropies corresponding to any block in the second class, a standardized difference of information entropies corresponding to the block; and
determining the target information entropy difference based on the processed difference of information entropies between the corresponding blocks of the enhanced image and the original image.

### Claim 7 (depends on 4)

The method according to claim 4, wherein the determining the degree of visual texture loss of the enhanced image based on the first information entropy difference and the second information entropy difference comprises:
determining a union information entropy difference between the corresponding blocks of the enhanced image and the original image based on the first information entropy difference and the second information entropy difference between the corresponding blocks of the enhanced image and the original image; and
using a sum of union information entropy differences between the respective corresponding blocks of the enhanced image and the original image as a value to measure the degree of texture loss of the enhanced image.

### Claim 8 (depends on 7)

The method according to claim 7, wherein the determining a union information entropy difference between the corresponding blocks of the enhanced image and the original image based on the first information entropy difference and the second information entropy difference between the corresponding blocks of the enhanced image and the original image comprises:
computing a square root of a sum of squares of the first information entropy difference and the second information entropy difference, and using a value of the square root as the union information entropy difference.

### Claim 9

(canceled)

### Claim 10

A computer device, comprising a processor, a memory, and a bus, wherein the memory stores machine-readable instructions executable by the processor; when the computer device is running, the processor communicates with the memory through the bus; and when the machine-readable instructions are executed by the processor, operations are executed, the operations comprising:
obtaining an original image and an enhanced image, wherein the enhanced image is generated by image enhancement on the original image;
performing block processing on the original image and the enhanced image separately to obtain a plurality of first blocks of the original image and a plurality of second blocks of the enhanced image;
obtaining a preset scale window size that conforms to human visual characteristics, and collecting statistics on a first scale information entropy corresponding to each of the plurality of first blocks of the original image and a second scale information entropy corresponding to each of the plurality of second blocks of the enhanced image according to the scale window size; and
determining a degree of visual texture loss of the enhanced image according to the first scale information entropy corresponding to each first block and the second scale information entropy corresponding to each second block.

### Claim 11

A non-transitory computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and the computer program is run by a processor to execute operations comprising:
obtaining an original image and an enhanced image, wherein the enhanced image is generated by image enhancement on the original image;
performing block processing on the original image and the enhanced image separately to obtain a plurality of first blocks of the original image and a plurality of second blocks of the enhanced image;
obtaining a preset scale window size that conforms to human visual characteristics, and collecting statistics on a first scale information entropy corresponding to each of the plurality of first blocks of the original image and a second scale information entropy corresponding to each of the plurality of second blocks of the enhanced image according to the scale window size; and
determining a degree of visual texture loss of the enhanced image according to the first scale information entropy corresponding to each first block and the second scale information entropy corresponding to each second block.

### Claim 12 (depends on 4)

The method according to claim 4, wherein the initial gray value distribution information and the adjusted gray value distribution information are used as target gray value distribution information separately, and a target information entropy is determined according to the following steps, wherein the target information entropy is the first scale information entropy, the second scale information entropy, the first initial information entropy, or the second initial information entropy:
using the first blocks and the second blocks as target blocks separately, and for each target block, determining the target information entropy corresponding to the target block based on the number of pixels, indicated by the target gray value distribution information, corresponding to each gray value of the target block, and the total number of pixels corresponding to the target block.

### Claim 13 (depends on 4)

The method according to claim 4, wherein a target information entropy difference is determined according to the following steps, wherein the target information entropy difference is the first information entropy difference or the second information entropy difference:
dividing differences of information entropies between corresponding blocks of the enhanced image and the original image into a first class and a second class, wherein the differences of information entropies in the first class are greater than or equal to 0, and the differences of information entropies in the second class are less than 0;
setting the differences of information entropies in the first class to 0, computing a standard deviation of the differences of information entropies in the second class, and determining, based on the standard deviation and the difference of information entropies corresponding to any block in the second class, a standardized difference of information entropies corresponding to the block; and
determining the target information entropy difference based on the processed difference of information entropies between the corresponding blocks of the enhanced image and the original image.

### Claim 14 (depends on 10)

The computer device according to claim 10, wherein the collecting statistics on a first scale information entropy corresponding to each of the plurality of first blocks of the original image and a second scale information entropy corresponding to each of the plurality of second blocks of the enhanced image according to the scale window size comprises:
determining adjusted gray value distribution information corresponding to each of the plurality of first blocks of the original image based on initial gray value distribution information corresponding to each of the plurality of first blocks of the original image and the scale window size, and determining the first scale information entropy corresponding to each of the plurality of first blocks based on the adjusted gray value distribution information corresponding to each of the plurality of first blocks; and
determining adjusted gray value distribution information corresponding to each of the plurality of second blocks of the enhanced image based on initial gray value distribution information corresponding to each of the plurality of second blocks of the enhanced image and the scale window size, and determining the second scale information entropy corresponding to each of the plurality of second blocks based on the adjusted gray value distribution information corresponding to each of the plurality of second blocks, wherein
the number of pixels corresponding to each gray value in the adjusted gray value distribution information is a sum of pixels of each gray value in a target scale window corresponding to the gray value in the initial gray value distribution information; and a size of the target scale window matches the scale window size that conforms to human visual characteristics.

### Claim 15 (depends on 10)

The computer device according to claim 10, wherein the determining a degree of visual texture loss of the enhanced image according to the first scale information entropy corresponding to each first block and the second scale information entropy corresponding to each second block comprises:
determining a first information entropy difference between the original image and the enhanced image according to the first scale information entropy corresponding to each first block and the second scale information entropy corresponding to each second block; and
determining the degree of visual texture loss of the enhanced image based on the first information entropy difference.

### Claim 16 (depends on 15)

The computer device according to claim 15, the image distortion evaluation method further comprises:
determining, based on initial gray value distribution information corresponding to each of the plurality of first blocks of the original image, a first initial information entropy corresponding to each first block, and determining, based on initial gray value distribution information corresponding to each of the plurality of second blocks of the enhanced image, a second initial information entropy corresponding to each second block; and
determining a second information entropy difference between the original image and the enhanced image according to the first initial information entropy corresponding to each first block and the second initial information entropy corresponding to each second block;
wherein the determining the degree of visual texture loss of the enhanced image based on the first information entropy comprises:
determining the degree of visual texture loss of the enhanced image based on the first information entropy difference and the second information entropy difference.

### Claim 17 (depends on 14)

The computer device according to claim 14, wherein the initial gray value distribution information and the adjusted gray value distribution information are used as target gray value distribution information separately, and a target information entropy is determined according to the following steps, wherein the target information entropy is the first scale information entropy, the second scale information entropy, the first initial information entropy, or the second initial information entropy:
using the first blocks and the second blocks as target blocks separately, and for each target block, determining the target information entropy corresponding to the target block based on the number of pixels, indicated by the target gray value distribution information, corresponding to each gray value of the target block, and the total number of pixels corresponding to the target block.

### Claim 18 (depends on 15)

The computer device according to claim 15, wherein a target information entropy difference is determined according to the following steps, wherein the target information entropy difference is the first information entropy difference or the second information entropy difference:
dividing differences of information entropies between corresponding blocks of the enhanced image and the original image into a first class and a second class, wherein the differences of information entropies in the first class are greater than or equal to 0, and the differences of information entropies in the second class are less than 0;
setting the differences of information entropies in the first class to 0, computing a standard deviation of the differences of information entropies in the second class, and determining, based on the standard deviation and the difference of information entropies corresponding to any block in the second class, a standardized difference of information entropies corresponding to the block; and
determining the target information entropy difference based on the processed difference of information entropies between the corresponding blocks of the enhanced image and the original image.

### Claim 19 (depends on 16)

The computer device according to claim 16, wherein the determining the degree of visual texture loss of the enhanced image based on the first information entropy difference and the second information entropy difference comprises:
determining a union information entropy difference between the corresponding blocks of the enhanced image and the original image based on the first information entropy difference and the second information entropy difference between the corresponding blocks of the enhanced image and the original image; and
using a sum of union information entropy differences between the respective corresponding blocks of the enhanced image and the original image as a value to measure the degree of texture loss of the enhanced image.

### Claim 20 (depends on 19)

The computer device according to claim 19, wherein the determining a union information entropy difference between the corresponding blocks of the enhanced image and the original image based on the first information entropy difference and the second information entropy difference between the corresponding blocks of the enhanced image and the original image comprises:
computing a square root of a sum of squares of the first information entropy difference and the second information entropy difference, and using a value of the square root as the union information entropy difference.
