# US 2019/0318457 A1 · Image processing methods and apparatuses, computer readable storage media and electronic devices

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0318457 A1
- Document ID: US20190318457A1
- Status: Published application
- Kind: A1
- Application number: 16/456,169
- Filed: 2019-06-28
- Published: 2019-10-17
- Earliest claimed: 2017-12-20
- Assignees: Shenzhen Sensetime Technology Co., Ltd.
- Applicants: Shenzhen Sensetime Technology Co., Ltd
- Inventors: Xiangyu MAO; Qiong YAN; Wenxiu SUN; Sijie REN
- Web page: https://patentgrep.com/patent/US20190318457A1

## CPC

- G06T 5/70: Denoising; Smoothing
- G06T 3/18: Image warping, e.g. rearranging pixels individually
- G06T 5/20: using local operators
- G06T 5/50: using two or more images, e.g. averaging or subtraction
- H04N 5/262: Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects {; Cameras specially adapted for the electronic generation of special effects}
- H04N 5/265: Mixing
- H04N 23/80: Camera processing pipelines; Components thereof
- H04N 23/958: for extended depth of field imaging
- G06T 2207/10004: Still image; Photographic image
- G06T 2207/10028: Range image; Depth image; 3D point clouds
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An image processing method includes: obtaining an original photographed image and original depth information of at least one pixel point in the original photographed image; determining blurring degree data of each of the at least one pixel point in the original photographed image according to blurring parameter data and the original depth information of the at least one pixel point; and performing blurring processing on the original photographed image according to the blurring degree data of the at least one pixel point to generate a post-processing result image.

## Claims

### Claim 1

An image processing method, comprising:
obtaining an original photographed image and a depth image corresponding to the original photographed image;
storing the original photographed image and the depth image; and
performing blurring processing on the original photographed image by using the stored depth image to generate a post-processing result image.

### Claim 2 (depends on 1)

The method according to claim 1, wherein the depth image comprises original depth information of at least one pixel point in the original photographed image; and the performing blurring processing on the original photographed image by using the depth image to generate a post-processing result image comprises:
determining blurring degree data of each of the at least one pixel point in the original photographed image according to blurring parameter data and the original depth information of the at least one pixel point; and
performing blurring processing on the original photographed image according to the blurring degree data of the at least one pixel point to generate a post-processing result image.

### Claim 3 (depends on 2)

The method according to claim 2, wherein the blurring parameter data comprises focus data and blurring intensity data; and the determining blurring degree data of each of the at least one pixel point in the original photographed image according to blurring parameter data and the original depth information of the at least one pixel point comprises:
performing, according to the focus data, adjustment processing on an original depth value corresponding to the original depth information of the at least one pixel point to obtain an adjusted depth value of each of the at least one pixel point; and
obtaining the blurring degree data of each pixel point according to the blurring intensity data and the adjusted depth value of the pixel point.

### Claim 4 (depends on 3)

The method according to claim 3, wherein the performing, according to the focus data, adjustment processing on an original depth value corresponding to the original depth information of the at least one pixel point to obtain an adjusted depth value of each of the at least one pixel point comprises:
setting an adjusted depth value of a first pixel point of the at least one pixel point to a difference between an original depth value of the first pixel point and a depth value of a focus point corresponding to the focus data, and setting an adjusted depth value of a second pixel point of the at least one pixel point to 0, wherein the original depth value of the first pixel point is greater than the depth value of the focus point, and the original depth value of the second pixel point is less than the depth value of the focus point.

### Claim 5 (depends on 3)

The method according to claim 3, wherein the performing, according to the focus data, adjustment processing on an original depth value corresponding to the original depth information of the at least one pixel point to obtain an adjusted depth value of each of the at least one pixel point comprises:
setting the adjusted depth value of each pixel point as an absolute difference value between an original depth value of the pixel point and a depth value of a focus point corresponding to the focus data.

### Claim 6 (depends on 5)

The method according to claim 5, wherein the blurring degree data comprises blurring radius data; and
the performing blurring processing on the original photographed image according to the blurring degree data of the at least one pixel point to generate a post-processing result image comprises:
using the blurring radius data of the at least one pixel point as a parameter value of a Gaussian kernel function, and performing blurring processing on the at least one pixel point of the original photographed image by using a Gaussian blur method to generate the post-processing result image; or
determining an average kernel width of each of the at least one pixel point according to the blurring radius data of the at least one pixel point, and performing blurring processing on the at least one pixel point of the original photographed image by using an average blur method to generate the post-processing result image; or
using the blurring radius data of the at least one pixel point as a circle radius value, and performing blurring processing on the at least one pixel point of the original photographed image by using a circular blur method to generate the post-processing result image.

### Claim 7 (depends on 1)

The method according to claim 1, further comprising at least one of:
displaying the post-processing result image, or storing the post-processing result image.

### Claim 8 (depends on 3)

The method according to claim 3, wherein before performing adjustment processing on an original depth value of at least one pixel point in the original photographed image indicated by the depth image, the method further comprises at least one of:
obtaining the focus data specified by a user, or obtaining the blurring intensity data specified by the user.

### Claim 9 (depends on 8)

The method according to claim 8, wherein the storing the original photographed image and the depth image comprises:
associatively storing the original photographed image and the depth image in an image library.

### Claim 10 (depends on 9)

The method according to claim 9, wherein the associatively storing the original photographed image and the depth image in an image library comprises:
associatively storing the original photographed image and the depth image in the image library as separate image files; or
storing the original photographed image and the depth image in a first merged image file of the image library.

### Claim 11 (depends on 9)

The method according to claim 9, wherein the storing the original photographed image and the depth image comprises:
associatively storing the original photographed image, the depth image, and an original photographed effect image in the image library as separate image files.

### Claim 12 (depends on 9)

The method according to claim 9, wherein the storing the original photographed image and the depth image comprises:
storing the original photographed image, the depth image, and an original photographed effect image in a second merged image file.

### Claim 13 (depends on 12)

The method according to claim 12, wherein the storing the original photographed image, the depth image, and an original photographed effect image in a second merged image file comprises:
writing the original photographed image and the depth image behind the original photographed effect image.

### Claim 14 (depends on 12)

The method according to claim 12, wherein a file header of the second merged image file comprises information indicating a length of at least one of the original photographed effect image or the original photographed image.

### Claim 15 (depends on 12)

The method according to claim 12, further comprising:
in response to an image display command, extracting the original photographed effect image from the second merged image file according to a size of the original photographed effect image, and displaying the original photographed effect image.

### Claim 16

An image processing method, comprising:
obtaining an original photographed image and original depth information of at least one pixel point in the original photographed image;
determining blurring degree data of each of the at least one pixel point in the original photographed image according to blurring parameter data and the original depth information of the at least one pixel point; and
performing blurring processing on the original photographed image according to the blurring degree data of the at least one pixel point to generate a post-processing result image.

### Claim 17 (depends on 16)

The method according to claim 16, wherein the blurring parameter data comprises focus data and blurring intensity data; and the determining blurring degree data of each of the at least one pixel point in the original photographed image according to blurring parameter data and the original depth information of the at least one pixel point comprises:
performing, according to the focus data, adjustment processing on an original depth value corresponding to the original depth information of the at least one pixel point to obtain an adjusted depth value of each of the at least one pixel point; and
obtaining the blurring degree data of each pixel point according to the blurring intensity data and the adjusted depth value of the pixel point.

### Claim 18 (depends on 17)

The method according to claim 17, wherein the carrying out, according to the focus data, adjustment processing on an original depth value corresponding to the original depth information of the at least one pixel point to obtain an adjusted depth value of each of the at least one pixel point comprises:
setting an adjusted depth value of a first pixel point of the at least one pixel point to a difference between an original depth value of the first pixel point and a depth value of a focus point corresponding to the focus data, and setting an adjusted depth value of a second pixel point of the at least one pixel point to 0, wherein the original depth value of the first pixel point is greater than the depth value of the focus point, and the original depth value of the second pixel point is less than the depth value of the focus point.

### Claim 19 (depends on 17)

The method according to claim 17, wherein the carrying out, according to the focus data, adjustment processing on an original depth value corresponding to the original depth information of the at least one pixel point to obtain an adjusted depth value of each of the at least one pixel point comprises: setting the adjusted depth value of each pixel point as an absolute difference value between an original depth value of the pixel point and a depth value of a focus point corresponding to the focus data.

### Claim 20

An image processing apparatus, comprising:
a memory storing processor-executable instructions; and
a processor, configured to execute the stored processor-executable instructions to perform operations of:
obtaining an original photographed image and a depth image corresponding to the original photographed image;
storing the original photographed image and the depth image; and
performing blurring processing on the original photographed image by using the stored depth image to generate a post-processing result image.

### Claim 21 (depends on 16)

An image processing apparatus, comprising:
a memory storing processor-executable instructions; and
a processor, configured to execute the stored processor-executable instructions to perform operations of the image processing method according to claim 16.

### Claim 22 (depends on 1)

A non-transitory computer readable storage medium having stored thereon instructions that, when executed by a processor, cause the processor to implement the image processing method according to claim 1.

### Claim 23 (depends on 16)

A non-transitory computer readable storage medium having stored thereon instructions that, when executed by a processor, cause the processor to implement the image processing method according to claim 16.
