# US 2015/0104100 A1 · Image Processing Method and Apparatus, and Shooting Terminal

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2015/0104100 A1
- Document ID: US20150104100A1
- Status: Published application
- Kind: A1
- Application number: 14/575,703
- Filed: 2014-12-18
- Published: 2015-04-16
- Earliest claimed: 2013-01-07
- Assignees: Huawei Device Co., Ltd.
- Applicants: Huawei Device Co., Ltd.
- Inventors: Congchao Zhu; Gang Chen; Hao Wang; Jia Qi; Wei Luo; Cheng Du; Bin Deng
- Web page: https://patentgrep.com/patent/US20150104100A1

## CPC

- G06T 5/70: Denoising; Smoothing
- G06T 5/20: using local operators
- G06T 5/73: Deblurring; Sharpening
- G06T 5/90: Dynamic range modification of images or parts thereof
- H04N 23/60: Control of cameras or camera modules
- H04N 23/81: for suppressing or minimising disturbance in the image signal generation
- G06T 2207/10004: Still image; Photographic image
- G06T 2207/10024: Color image
- G06T 2207/20024: Filtering details
- G06T 2207/20182: Noise reduction or smoothing in the temporal domain; Spatio-temporal filtering
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An image processing method and apparatus, and a shooting terminal, where the method includes acquiring a to-be-processed image that is shot but is not image-processed; extracting shooting characteristic information of the to-be-processed image; performing image processing on the to-be-processed image according to the shooting characteristic information. In this way, after acquiring a to-be-processed image that is shot, a shooting terminal uses shooting characteristic information of the to-be-processed image as a basis of adaptive processing of the image, and performs processing on each to-be-processed image according to shooting characteristic information of each to-be-processed image, so that the quality of an image that is obtained after being processed by the shooting terminal can be adaptively improved.

## Claims

### Claim 1

An image processing method comprising:
acquiring a to-be-processed image that is shot but is not image-processed;
extracting shooting characteristic information of the to-be-processed image; and
performing image processing on the to-be-processed image according to the shooting characteristic information.

### Claim 2 (depends on 1)

The method according to claim 1, wherein the performing image processing on the to-be-processed image according to the shooting characteristic information comprises performing noise reduction and enhancement processing on the to-be-processed image according to shooting scene information and shooting metadata of the to-be-processed image.

### Claim 3 (depends on 2)

The method according to claim 2, wherein performing noise reduction and enhancement processing on the to-be-processed image according to the shooting scene information and the shooting metadata of the to-be-processed image comprises:
performing noise reduction and enhancement processing on luminance information of the to-be-processed image according to the shooting scene information and the shooting metadata; and
performing noise reduction and enhancement processing on chrominance information of the to-be-processed image according to the shooting scene information and the shooting metadata.

### Claim 4 (depends on 3)

The method according to claim 3, wherein performing noise reduction processing on the luminance information of the to-be-processed image according to the shooting scene information and the shooting metadata comprises:
performing local absolute difference calculation on the luminance information to acquire a sum of absolute difference (SAD) of neighborhood luminance values of the luminance information;
obtaining a first Gaussian noise reduction filter kernel according to the SAD of neighborhood luminance values, the shooting scene information, and the shooting metadata; and
performing Gaussian noise reduction processing on the luminance information according to the first Gaussian noise reduction filter kernel, and wherein performing enhancement processing on the luminance information of the to-be-processed image comprises:
performing edge-preserving-based filtering decomposition on the luminance information to obtain luminance information of a base layer and luminance information of at least one detail layer;
performing contrast enhancement processing on the luminance information of the base layer according to the shooting scene information and the shooting metadata;
determining at least one gain according to the SAD of neighborhood luminance values, the shooting scene information, and the shooting metadata;
performing detail enhancement processing on the luminance information of the detail layer using the gain; and
performing summation on the luminance information that is of the base layer and has undergone contrast enhancement processing and the luminance information that is of the detail layer and has undergone detail enhancement processing, so as to obtain the luminance information that has undergone enhancement processing.

### Claim 5 (depends on 4)

The method according to claim 4, wherein, before performing enhancement processing on the luminance information of the to-be-processed image, the method further comprises:
multiplying the luminance information that has undergone Gaussian noise reduction processing by a first coefficient α1 to obtain α1 times the luminance information that has undergone Gaussian noise reduction processing, wherein α1 is a numerical value ranging from 0 to 1;
multiplying the luminance information that has not undergone Gaussian noise reduction processing by (1−α1) to obtain (1−α1) times the luminance information that has not undergone Gaussian noise reduction processing; and
performing summation on the α1 times the luminance information that has undergone Gaussian noise reduction processing and the (1−α1) times the luminance information that has not undergone Gaussian noise reduction processing, so as to obtain first luminance information, and wherein performing enhancement processing on luminance information of the to-be-processed image comprises performing enhancement processing on the first luminance information.

### Claim 6 (depends on 3)

The method according to claim 3, wherein performing noise reduction and enhancement processing on the luminance information of the to-be-processed image according to the shooting scene information and the shooting metadata comprises:
performing local absolute difference calculation on the luminance information to acquire a SAD of neighborhood luminance values of the luminance information;
obtaining a first Gaussian noise reduction filter kernel according to the SAD of neighborhood luminance values, the shooting scene information and the shooting metadata;
performing convolution on a high-pass filter kernel and the first Gaussian noise reduction filter kernel to acquire a convolution filter kernel;
determining a weight of the convolution filter kernel according to the SAD of neighborhood luminance values, the shooting scene information and the shooting metadata;
multiplying the convolution filter kernel by the weight to acquire a sharpness enhancement filter kernel;
performing summation on the first Gaussian noise reduction filter kernel and the sharpness enhancement filter kernel to obtain a Gaussian noise reduction sharpening filter kernel; and
performing Gaussian noise reduction processing and sharpness enhancement processing on the luminance information according to the Gaussian noise reduction sharpening filter kernel.

### Claim 7 (depends on 6)

The method according to claim 6, wherein, before performing local absolute difference calculation on the luminance information to acquire the SAD of the neighborhood luminance values of the luminance information, the method further comprises performing salt and pepper noise reduction processing on the luminance information according to the shooting scene information and the shooting metadata.

### Claim 8 (depends on 7)

The method according to claim 7, wherein performing noise reduction processing on the chrominance information of the to-be-processed image according to the shooting scene information and the shooting metadata comprises:
performing local absolute difference calculation according to the chrominance information to acquire a SAD of neighborhood chrominance values of the chrominance information;
acquiring a second Gaussian noise reduction filter kernel according to the SAD of neighborhood chrominance values, the shooting scene information and the shooting metadata; and
performing Gaussian noise reduction processing on the chrominance information according to the second Gaussian noise reduction filter kernel, and wherein performing enhancement processing on the chrominance information of the to-be-processed image according to the shooting scene information and the shooting metadata comprises:
combining the chrominance information and the luminance information to obtain composite image information;
acquiring color saturation of the composite image information; and
adjusting the color saturation according to the shooting scene information and the shooting metadata.

### Claim 9 (depends on 8)

The method according to claim 8, wherein, before combining the chrominance information and the luminance information to obtain the composite image information, the method further comprises:
multiplying the luminance information that has undergone enhancement processing by a second coefficient α2 to obtain α2 times the luminance information that has undergone enhancement processing, wherein α2 is a numerical value ranging from 0 to 1;
multiplying the luminance information that has undergone noise reduction processing by (1−α2) to obtain (1−α2) times the luminance information that has undergone noise reduction processing; and
performing summation on the α2 times the luminance information that has undergone enhancement processing and the (1−α2) times the luminance information that has undergone noise reduction processing, so as to obtain second luminance information, and wherein combining the chrominance information and the luminance information to obtain composite image information comprises combining the chrominance information and the second luminance information to obtain the composite image information.

### Claim 10 (depends on 9)

The method according to claim 9, wherein, before performing the local absolute difference calculation according to the chrominance information to acquire the SAD of neighborhood chrominance values of the chrominance information, the method further comprises performing salt and pepper noise reduction processing on the chrominance information according to the shooting scene information and the shooting metadata.

### Claim 11

An image processing apparatus comprising:
a shooting module configured to acquire a to-be-processed image that is shot but is not image-processed;
an extracting module configured to extract shooting characteristic information of the to-be-processed image; and
a processing module configured to perform image processing on the to-be-processed image according to the shooting characteristic information.

### Claim 12 (depends on 11)

The apparatus according to claim 11, wherein the processing module is further configured to perform noise reduction and enhancement processing on the to-be-processed image according to shooting scene information and shooting metadata of the to-be-processed image.

### Claim 13 (depends on 12)

The apparatus according to claim 12, wherein the processing module is further configured to:
perform noise reduction and enhancement processing on luminance information of the to-be-processed image according to the shooting scene information and the shooting metadata; and
perform noise reduction and enhancement processing on chrominance information of the to-be-processed image according to the shooting scene information and the shooting metadata.

### Claim 14 (depends on 13)

The apparatus according to claim 13, wherein the processing module comprises a first Gaussian noise reducing unit and/a first enhancing unit, wherein the first Gaussian noise reducing unit is configured to:
perform local absolute difference calculation on the luminance information to acquire a sum of absolute difference (SAD) of neighborhood luminance values of the luminance information;
obtain a first Gaussian noise reduction filter kernel according to the SAD of neighborhood luminance values, the shooting scene information and the shooting metadata; and
perform Gaussian noise reduction processing on the luminance information according to the first Gaussian noise reduction filter kernel, and wherein the first enhancing unit is configured to:
perform edge-preserving-based filtering decomposition on the luminance information to obtain luminance information of a base layer and luminance information of at least one detail layer;
perform contrast enhancement processing on the luminance information of the base layer according to the shooting scene information and the shooting metadata;
determine at least one gain according to the SAD of neighborhood luminance values, the shooting scene information and the shooting metadata;
perform detail enhancement processing on the luminance information of the detail layer using the gain; and
perform summation on the luminance information that is of the base layer and has undergone contrast enhancement processing and the luminance information that is of the detail layer and has undergone detail enhancement processing, so as to obtain the luminance information that has undergone enhancement processing.

### Claim 15 (depends on 14)

The apparatus according to claim 14, wherein the processing module further comprises a first acquiring unit configured to:
multiply the luminance information that has undergone Gaussian noise reduction processing by a first coefficient α1 to obtain α1 times the luminance information that has undergone Gaussian noise reduction processing, wherein α1 is a numerical value ranging from 0 to 1;
multiply the luminance information that has not undergone Gaussian noise reduction processing by (1−α1) to obtain (1−α1) times the luminance information that has not undergone Gaussian noise reduction processing; and
perform summation on the α1 times the luminance information that has undergone Gaussian noise reduction processing and the (1−α1) times the luminance information that has not undergone Gaussian noise reduction processing, so as to obtain first luminance information, wherein the first enhancing unit is further configured to perform enhancement processing on the first luminance information.

### Claim 16 (depends on 13)

The apparatus according to claim 13, wherein the processing module comprises a noise reduction enhancing unit configured to:
perform local absolute difference calculation on the luminance information to acquire a SAD of neighborhood luminance values of the luminance information;
obtain a first Gaussian noise reduction filter kernel according to the SAD of neighborhood luminance values, the shooting scene information and the shooting metadata;
perform convolution on a high-pass filter kernel and the first Gaussian noise reduction filter kernel to acquire a convolution filter kernel;
determine a weight of the convolution filter kernel according to the SAD of neighborhood luminance values, the shooting scene information and the shooting metadata;
multiply the convolution filter kernel by the weight to acquire a sharpness enhancement filter kernel;
perform summation on the first Gaussian noise reduction filter kernel and the sharpness enhancement filter kernel to obtain a Gaussian noise reduction sharpening filter kernel; and
perform Gaussian noise reduction processing and sharpness enhancement processing on the luminance information according to the Gaussian noise reduction sharpening filter kernel.

### Claim 17 (depends on 16)

The apparatus according to claim 16, wherein the processing module further comprises a first salt and pepper noise reducing unit configured to perform salt and pepper noise reduction processing on the luminance information according to the shooting scene information and the shooting metadata.

### Claim 18 (depends on 17)

The apparatus according to claim 17, wherein the processing module further comprises a second Gaussian noise reducing unit and a second enhancing unit, wherein the second Gaussian noise reducing unit is configured to:
perform local absolute difference calculation according to the chrominance information to acquire a SAD of neighborhood chrominance values of the chrominance information;
acquire a second Gaussian noise reduction filter kernel according to the SAD of neighborhood chrominance values, the shooting scene information and the shooting metadata; and
perform Gaussian noise reduction processing on the chrominance information according to the second Gaussian noise reduction filter kernel, and wherein the second enhancing unit is configured to:
combine the chrominance information and the luminance information to obtain composite image information; acquire color saturation of the composite image information; and
adjust the color saturation according to the shooting scene information and the shooting metadata.

### Claim 19 (depends on 18)

The apparatus according to claim 18, wherein the processing module further comprises a second acquiring unit configured to:
multiply the luminance information that has undergone enhancement processing by a second coefficient α2 to obtain α2 times the luminance information that has undergone enhancement processing before the second enhancing unit combines the chrominance information and the luminance information to obtain the composite image information, wherein α2 is a numerical value ranging from 0 to 1;
multiply the luminance information that has undergone noise reduction processing by (1−α2) to obtain (1−α2) times the luminance information that has undergone noise reduction processing; and
perform summation on the α2 times the luminance information that has undergone enhancement processing and the (1−α2) times the luminance information that has undergone noise reduction processing, so as to obtain second luminance information, wherein the second enhancing unit is further configured to:
combine the chrominance information and the second luminance information to obtain the composite image information;
acquire the color saturation of the composite image information; and
adjust the color saturation according to the shooting scene information and the shooting metadata.

### Claim 20 (depends on 19)

The apparatus according to claim 19, wherein the processing module further comprises a second salt and pepper noise reducing unit configured to perform salt and pepper noise reduction processing on the chrominance information according to the shooting scene information and the shooting metadata before the second Gaussian noise reducing unit performs local absolute difference calculation according to the chrominance information to acquire the SAD of neighborhood chrominance values of the chrominance information.
