# US 2023/0056564 A1 · Image authenticity detection method and apparatus

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0056564 A1
- Document ID: US20230056564A1
- Status: Published application
- Kind: A1
- Application number: 17/979,883
- Filed: 2022-11-03
- Published: 2023-02-23
- Earliest claimed: 2021-05-11
- Assignees: Tencent Technology (Shenzhen) Company Limited
- Applicants: Tencent Technology (Shenzhen) Company Limited
- Inventors: Zhou HAN; Zhuang ZHANG; Zhiqiang DONG
- Web page: https://patentgrep.com/patent/US20230056564A1

## CPC

- G06V 10/431: {Frequency domain transformation; Autocorrelation}
- G06V 10/771: Feature selection, e.g. selecting representative features from a multi-dimensional feature space
- G06F 21/30: Authentication, i.e. establishing the identity or authorisation of security principals
- G06F 21/64: Protecting data integrity, e.g. using checksums, certificates or signatures
- G06T 5/70: Denoising; Smoothing
- G06V 10/30: Noise filtering
- G06V 10/761: {Proximity, similarity or dissimilarity measures}
- G06V 40/40: Spoof detection, e.g. liveness detection
- G06V 10/82: using neural networks
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

This disclosure is directed to an image authenticity detection method and apparatus. The method includes: obtaining an image; removing low-frequency information from the image to obtain first image information of the image; denoising the first image information to obtain second image information; determining, based on a difference between the first image information and the second image information, a fixed pattern noise feature map corresponding to the image; analyzing distribution of fixed pattern noise in the fixed pattern noise feature map, the fixed pattern noise being inherent noise from a camera sensor and not interfered by image content; and detecting, based on the distribution, authenticity of the image to obtain an authenticity detection result of the image.

## Claims

### Claim 1

An image authenticity detection method, performed by a computer device, comprising:
obtaining an image;
removing low-frequency information from the image to obtain first image information of the image;
denoising the first image information to obtain second image information;
determining, based on a difference between the first image information and the second image information, a fixed pattern noise feature map corresponding to the image;
analyzing distribution of fixed pattern noise in the fixed pattern noise feature map, the fixed pattern noise being inherent noise from a camera sensor and not interfered by image content; and
detecting, based on the distribution, authenticity of the image to obtain an authenticity detection result of the image.

### Claim 2 (depends on 1)

The method according to claim 1, wherein the first image information comprises wavelet coefficients of high-frequency components in a plurality of directions of the image in wavelet domain, and the removing the low-frequency information from the image to obtain the first image information comprises:
performing wavelet transform on the image in spatial domain to decompose the image into a low-frequency component and high-frequency components in a plurality of directions in the wavelet domain; and
setting a wavelet coefficient of the low-frequency component to zero to obtain wavelet coefficients of the high-frequency components in the plurality of directions.

### Claim 3 (depends on 2)

The method according to claim 2, wherein the second image information comprises denoised high-frequency wavelet coefficients corresponding to the high-frequency components in the plurality of directions of the image in the wavelet domain, and the denoising the first image information to obtain denoised second image information comprises:
denoising the wavelet coefficients of the high-frequency components in the plurality of directions to obtain the denoised high-frequency wavelet coefficients corresponding to the high-frequency components in the plurality of directions.

### Claim 4 (depends on 3)

The method according to claim 3, wherein the obtaining the fixed pattern noise feature map corresponding to the image comprises:
obtaining high-frequency noise wavelet coefficients corresponding to the high-frequency components in the plurality of directions based on a difference between the wavelet coefficients of the high-frequency components and the denoised high-frequency wavelet coefficients of the high-frequency components that correspond to a same direction; and
performing inverse wavelet transform based on the wavelet coefficient of the low-frequency component that is set to zero and the high-frequency noise wavelet coefficients corresponding to the high-frequency components in the plurality of directions, to obtain the fixed pattern noise feature map corresponding to the image.

### Claim 5 (depends on 4)

The method according to claim 4, wherein the performing the wavelet transform on the image in spatial domain comprises:
performing multi-scale wavelet transform on the image in the spatial domain to decompose the image into a low-frequency component, and high-frequency components at a plurality of scales, high-frequency components at a same scale comprising high-frequency components in a plurality of directions.

### Claim 6 (depends on 4)

The method according to claim 4, wherein the performing the inverse wavelet transform to obtain the fixed pattern noise feature map corresponding to the image comprises:
performing inverse wavelet transform based on the wavelet coefficient of the low-frequency component that is set to zero and the high-frequency noise wavelet coefficients corresponding to the high-frequency components in the plurality of directions at the plurality of scales, to obtain the fixed pattern noise feature map corresponding to the image.

### Claim 7 (depends on 3)

The method according to claim 3, wherein the denoising the wavelet coefficients of the high-frequency components in the plurality of directions to obtain the denoised high-frequency wavelet coefficients corresponding to the high-frequency components in the plurality of directions comprises:
estimating local variances of non-noise information in the high-frequency components in the plurality of directions; and
for each of the high-frequency components in each of the the plurality of directions, performing noise filtering on a wavelet coefficient of the high-frequency component based on a local variance of non-noise information in the high-frequency component, to obtain the denoised high-frequency wavelet coefficients corresponding to the high-frequency components in the plurality of directions.

### Claim 8 (depends on 7)

The method according to claim 7, wherein the estimating the local variances of non-noise information in the high-frequency components in the plurality of directions comprises:
for each of the high-frequency components in each of the plurality of directions, using a plurality of windows of different sizes to perform filtering based on the high-frequency component to obtain a filtering result corresponding to the high-frequency component in each of the windows;
determining an initial local variance corresponding to the non-noise information in the high-frequency component in each of the windows based on a difference between a filtering result and a preset noise variance that correspond to a same window; and
selecting a final local variance of the non-noise information in the high-frequency components from the initial local variances.

### Claim 9 (depends on 1)

The method according to claim 1, wherein the analyzing the distribution of the fixed pattern noise in the fixed pattern noise feature map comprises:
inputting the fixed pattern noise feature map into a pre-trained authenticity detection model;
analyzing, with the authenticity detection model, the distribution of fixed pattern noise in the fixed pattern noise feature map; and
detecting, based on the distribution, the authenticity of the image to obtain an authenticity detection result of the image.

### Claim 10 (depends on 1)

The method according to claim 1, wherein the detecting the authenticity of the image to obtain an authenticity detection result of the image comprises:
determining the image as an authentic image in response to the distribution matching distribution of fixed pattern noise of an authentic image.

### Claim 11 (depends on 1)

The method according to claim 1, wherein the detecting the authenticity of the image to obtain the authenticity detection result of the image comprises:
in response to the distribution matching distribution of fixed pattern noise of a preset forgery type, determining the image to be a forged image of the forgery type based on the forgery type corresponding to the matched distribution of the fixed pattern noise.

### Claim 12

An image authenticity detection apparatus, comprising:
a memory operable to store computer-readable instructions; and
a processor circuitry operable to read the computer-readable instructions, the processor circuitry when executing the computer-readable instructions is configured to:
obtain an image;
remove low-frequency information from the image to obtain first image information of the image;
denoise the first image information to obtain second image information;
determine, based on a difference between the first image information and the second image information, a fixed pattern noise feature map corresponding to the image;
analyze distribution of fixed pattern noise in the fixed pattern noise feature map, the fixed pattern noise being inherent noise from a camera sensor and not interfered by image content; and
detect, based on the distribution, authenticity of the image to obtain an authenticity detection result of the image.

### Claim 13 (depends on 12)

The apparatus according to claim 12, wherein the first image information comprises wavelet coefficients of high-frequency components in a plurality of directions of the image in wavelet domain, and the processor circuitry is configured to:
perform wavelet transform on the image in spatial domain to decompose the image into a low-frequency component and high-frequency components in a plurality of directions in the wavelet domain; and
set a wavelet coefficient of the low-frequency component to zero to obtain wavelet coefficients of the high-frequency components in the plurality of directions.

### Claim 14 (depends on 13)

The apparatus according to claim 13, wherein the second image information comprises denoised high-frequency wavelet coefficients corresponding to the high-frequency components in the plurality of directions of the image in the wavelet domain, and the processor circuitry is configured to:
denoise the wavelet coefficients of the high-frequency components in the plurality of directions to obtain the denoised high-frequency wavelet coefficients corresponding to the high-frequency components in the plurality of directions.

### Claim 15 (depends on 14)

The apparatus according to claim 14, wherein the processor circuitry is configured to:
obtain high-frequency noise wavelet coefficients corresponding to the high-frequency components in the plurality of directions based on a difference between the wavelet coefficients of the high-frequency components and the denoised high-frequency wavelet coefficients of the high-frequency components that correspond to a same direction; and
perform inverse wavelet transform based on the wavelet coefficient of the low-frequency component that is set to zero and the high-frequency noise wavelet coefficients corresponding to the high-frequency components in the plurality of directions, to obtain the fixed pattern noise feature map corresponding to the image.

### Claim 16 (depends on 15)

The apparatus according to claim 15, wherein the processor circuitry is configured to:
perform multi-scale wavelet transform on the image in the spatial domain to decompose the image into a low-frequency component, and high-frequency components at a plurality of scales, high-frequency components at a same scale comprising high-frequency components in a plurality of directions.

### Claim 17 (depends on 16)

The apparatus according to claim 16, wherein the processor circuitry is configured to:
perform inverse wavelet transform based on the wavelet coefficient of the low-frequency component that is set to zero and the high-frequency noise wavelet coefficients corresponding to the high-frequency components in the plurality of directions at the plurality of scales, to obtain the fixed pattern noise feature map corresponding to the image.

### Claim 18 (depends on 14)

The apparatus according to claim 14, wherein the processor circuitry is configured to:
estimate local variances of non-noise information in the high-frequency components in the plurality of directions; and
for each of the high-frequency components in each of the plurality of directions, perform noise filtering on a wavelet coefficient of the high-frequency component based on a local variance of non-noise information in the high-frequency component, to obtain the denoised high-frequency wavelet coefficients corresponding to the high-frequency components in the plurality of directions.

### Claim 19 (depends on 12)

The apparatus according to claim 12, wherein the processor circuitry is configured to:
input the fixed pattern noise feature map into a pre-trained authenticity detection model;
analyze, with the authenticity detection model, the distribution of fixed pattern noise in the fixed pattern noise feature map; and
detect, based on the distribution, the authenticity of the image to obtain an authenticity detection result of the image.

### Claim 20

A non-transitory machine-readable media, having instructions stored on the machine-readable media, the instructions configured to, when executed, cause a machine to:
obtain an image;
remove low-frequency information from the image to obtain first image information of the image;
denoise the first image information to obtain second image information;
determine, based on a difference between the first image information and the second image information, a fixed pattern noise feature map corresponding to the image;
analyze distribution of fixed pattern noise in the fixed pattern noise feature map, the fixed pattern noise being inherent noise from a camera sensor and not interfered by image content; and
detect, based on the distribution, authenticity of the image to obtain an authenticity detection result of the image.
