# US 12,602,744 B2 · Image processing method and apparatus, electronic device and medium > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,602,744 B2 - Document ID: US12602744B2 - Status: Granted - Kind: B2 - Application number: 18/274,928 - Filed: 2021-11-25 - Published: 2024-03-21 - Granted: 2026-04-14 - Earliest claimed: 2021-01-29 - Assignees: Beijing Bytedance Network Technology Co., Ltd. - Applicants: Beijing Bytedance Network Technology Co., Ltd. - Inventors: Yitian Xu - Web page: https://patentgrep.com/patent/US12602744B2 ## CPC - G06T 5/50: using two or more images, e.g. averaging or subtraction - G06T 5/90: Dynamic range modification of images or parts thereof - H04N 23/71: Circuitry for evaluating the brightness variation - H04N 23/741: by increasing the dynamic range of the image compared to the dynamic range of the electronic image sensors - H04N 23/76: by influencing the image signals - G06T 2207/10144: Varying exposure - G06T 2207/20208: High dynamic range [HDR] image processing - G06T 2207/20221: Image fusion; Image merging - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract Provided are image processing method and apparatus, an electronic device, and a computer-readable storage medium. The image processing method includes: obtaining at least two to-be-synthesized images, in which the at least two to-be-synthesized images are images of an object captured at different exposures; determining an image luminance value of each of the at least two to-be-synthesized images; determining, for each of the at least two to-be-synthesized images, a luminance weight of each pixel of the to-be-synthesized image based on the image luminance value of the to-be-synthesized image and a luminance value of each pixel of the to-be-synthesized image; and obtaining a target image by performing image synthesis processing based on the luminance value of each pixel of the at least two to-be-synthesized images and the luminance weight of each pixel of the at least two to-be-synthesized images. The method can improve quality of the synthesized image and user experience. ## Claims ### Claim 1 An image processing method, comprising: obtaining at least two to-be-synthesized images, the at least two to-be-synthesized images being images of an object captured at different exposures; determining an image luminance value of each of the at least two to-be-synthesized images; determining, for each of the at least two to-be-synthesized images, a luminance weight of each pixel of the to-be-synthesized image based on the image luminance value of the to-be-synthesized image and a luminance value of each pixel of the to-be-synthesized image; and obtaining a target image by performing image synthesis processing based on the luminance value of each pixel of the at least two to-be-synthesized images and the luminance weight of each pixel of the at least two to-be-synthesized images, wherein said determining the luminance weight of each pixel of the to-be-synthesized image based on the image luminance value of the to-be-synthesized image and the luminance value of each pixel of the to-be-synthesized image comprises: determining a first association image of the to-be-synthesized image, the first association image being a to-be-synthesized image having an image luminance value adjacent to the image luminance value of the to-be-synthesized image; and determining the luminance weight of each pixel of the to-be-synthesized image based on the image luminance value of the to-be-synthesized image, the image luminance value of the first association image, and the luminance value of each pixel of the to-be-synthesized image. ### Claim 2 (depends on 1) The method according to claim 1, wherein said determining the luminance weight of each pixel of the to-be-synthesized image based on the image luminance value of the to-be-synthesized image, the image luminance value of the first association image, and the luminance value of each pixel of the to-be-synthesized image comprises: determining a luminance value interval of each target pixel of the to-be-synthesized image based on the image luminance value of the to-be-synthesized image and the image luminance value of the first association image; determining, when a luminance value of one of pixels of the to-be-synthesized image is within the luminance value interval, a luminance weight of the pixel based on the image luminance value of the to-be-synthesized image, the image luminance value of the first association image, and the luminance value of the pixel; and determining, when the luminance value of the pixel is beyond the luminance value interval, the luminance weight of the pixel to be a first predetermined value. ### Claim 3 (depends on 2) The method according to claim 2, wherein said determining the luminance value interval of each target pixel of the to-be-synthesized image based on the image luminance value of the to-be-synthesized image and the image luminance value of the first association image comprises: determining, as the luminance value interval of each target pixel of the to-be-synthesized image, an interval defined by the image luminance value of the to-be-synthesized image and the image luminance value of the first association image. ### Claim 4 (depends on 2) The method according to claim 2, wherein for the luminance value interval of each target pixel of the to-be-synthesized image: a maximum luminance value in the luminance value interval is equal to or smaller than a maximum one of the image luminance values of the at least two to-be-synthesized images; and a minimum luminance value in the luminance value interval is equal to or greater than a minimum one of the image luminance values of the at least two to-be-synthesized images. ### Claim 5 (depends on 1) The method according to claim 1, wherein said determining the luminance weight of each pixel of the to-be-synthesized image based on the image luminance value of the to-be-synthesized image, the image luminance value of the first association image, and the luminance value of each pixel of the to-be-synthesized image comprises: determining a luminance value interval of each target pixel of the to-be-synthesized image based on the image luminance value of the to-be-synthesized image, the image luminance value of the first association image, and an image luminance value of a second association image of the to-be-synthesized image; determining, in response to determining that a luminance value of one of pixels of the to-be-synthesized image is within the luminance value interval, a luminance weight of the pixel based on the image luminance value of the to-be-synthesized image, the image luminance value of the first association image, the image luminance value of the second association image, and the luminance value of the pixel; and determining, in response to determining that the luminance value of the pixel is beyond the luminance value interval, the luminance weight of the pixel to be a second predetermined value, wherein the second association image is a to-be-synthesized image other than the to-be-synthesized image and having an image luminance value adjacent to the image luminance value of the first association image. ### Claim 6 (depends on 5) The method according to claim 5, wherein said determining the luminance value interval of each target pixel of the to-be-synthesized image based on the image luminance value of the to-be-synthesized image, the image luminance value of the first association image, and the image luminance value of the second association image of the to-be-synthesized image comprises: determining an initial luminance interval of each target pixel of the to-be-synthesized image based on the image luminance value of the to-be-synthesized image and the image luminance value of the first association image; determining an extended luminance interval of the initial luminance interval based on the image luminance value of the first association image and the image luminance value of the second association image of the to-be-synthesized image; and obtaining the luminance value interval of each target pixel of the to-be-synthesized image by stitching the initial luminance interval and the extended luminance interval. ### Claim 7 (depends on 6) The method according to claim 6, wherein said determining the extended luminance interval of the initial luminance interval based on the image luminance value of the first association image and the image luminance value of the second association image of the to-be-synthesized image comprises: determining a difference between the image luminance value of the first association image and the image luminance value of the second association image of the to-be-synthesized image; and determining the extended luminance interval of the initial luminance interval based on the difference and a third predetermined value. ### Claim 8 An electronic device, comprising: one or more processors; a memory; and one or more applications, wherein the one or more applications are stored in the memory, and configured to be executed by the one or more processors to cause the one or more processor to: obtain at least two to-be-synthesized images, the at least two to-be-synthesized images being images of an object captured at different exposures; determine an image luminance value of each of the at least two to-be-synthesized images; determine, for each of the at least two to-be-synthesized images, a luminance weight of each pixel of the to-be-synthesized image based on the image luminance value of the to-be-synthesized image and a luminance value of each pixel of the to-be-synthesized image; and obtain a target image by performing image synthesis processing based on the luminance value of each pixel of the at least two to-be-synthesized images and the luminance weight of each pixel of the at least two to-be-synthesized images, wherein said determining the luminance weight of each pixel of the to-be-synthesized image based on the image luminance value of the to-be-synthesized image and the luminance value of each pixel of the to-be-synthesized image comprises: determining a first association image of the to-be-synthesized image, the first association image being a to-be-synthesized image having an image luminance value adjacent to the image luminance value of the to-be-synthesized image; and determining the luminance weight of each pixel of the to-be-synthesized image based on the image luminance value of the to-be-synthesized image, the image luminance value of the first association image, and the luminance value of each pixel of the to-be-synthesized image. ### Claim 9 (depends on 8) The electronic device according to claim 8, wherein said determining the luminance weight of each pixel of the to-be-synthesized image based on the image luminance value of the to-be-synthesized image, the image luminance value of the first association image, and the luminance value of each pixel of the to-be-synthesized image comprises: determining a luminance value interval of each target pixel of the to-be-synthesized image based on the image luminance value of the to-be-synthesized image and the image luminance value of the first association image; determining, when a luminance value of one of pixels of the to-be-synthesized image is within the luminance value interval, a luminance weight of the pixel based on the image luminance value of the to-be-synthesized image, the image luminance value of the first association image, and the luminance value of the pixel; and determining, when the luminance value of the pixel is beyond the luminance value interval, the luminance weight of the pixel—to be a first predetermined value. ### Claim 10 (depends on 9) The electronic device according to claim 9, wherein said determining the luminance value interval of each target pixel of the to-be-synthesized image based on the image luminance value of the to-be-synthesized image and the image luminance value of the first association image comprises: determining, as the luminance value interval of each target pixel of the to-be-synthesized image, an interval defined by the image luminance value of the to-be-synthesized image and the image luminance value of the first association image. ### Claim 11 (depends on 8) The electronic device according to claim 8, wherein said determining the luminance weight of each pixel of the to-be-synthesized image based on the image luminance value of the to-be-synthesized image, the image luminance value of the first association image, and the luminance value of each pixel of the to-be-synthesized image comprises: determining a luminance value interval of each target pixel of the to-be-synthesized image based on the image luminance value of the to-be-synthesized image, the image luminance value of the first association image, and an image luminance value of a second association image of the to-be-synthesized image; determining, in response to determining that a luminance value of one of pixels of the to-be-synthesized image is within the luminance value interval, a luminance weight of the pixel based on the image luminance value of the to-be-synthesized image, the image luminance value of the first association image, the image luminance value of the second association image, and the luminance value of the pixel; and determining, in response to determining that the luminance value of the pixel is beyond the luminance value interval, the luminance weight of the pixel to be a second predetermined value, wherein the second association image is a to-be-synthesized image other than the to-be-synthesized image and having an image luminance value adjacent to the image luminance value of the first association image. ### Claim 12 (depends on 11) The electronic device according to claim 11, wherein said determining the luminance value interval of each target pixel of the to-be-synthesized image based on the image luminance value of the to-be-synthesized image, the image luminance value of the first association image, and the image luminance value of the second association image of the to-be-synthesized image comprises: determining an initial luminance interval of each target pixel of the to-be-synthesized image based on the image luminance value of the to-be-synthesized image and the image luminance value of the first association image; determining an extended luminance interval of the initial luminance interval based on the image luminance value of the first association image and the image luminance value of the second association image of the to-be-synthesized image; and obtaining the luminance value interval of each target pixel of the to-be-synthesized image by stitching the initial luminance interval and the extended luminance interval. ### Claim 13 (depends on 12) The electronic device according to claim 12, wherein said determining the extended luminance interval of the initial luminance interval based on the image luminance value of the first association image and the image luminance value of the second association image of the to-be-synthesized image comprises: determining a difference between the image luminance value of the first association image and the image luminance value of the second association image of the to-be-synthesized image; and determining the extended luminance interval of the initial luminance interval based on the difference and a third predetermined value. ### Claim 14 (depends on 9) The electronic device according to claim 9, wherein for the luminance value interval of each target pixel of the to-be-synthesized image: a maximum luminance value in the luminance value interval is equal to or smaller than a maximum one of the image luminance values of the at least two to-be-synthesized images; and a minimum luminance value in the luminance value interval is equal to or greater than a minimum one of the image luminance values of the at least two to-be-synthesized images. ### Claim 15 A non-transitory computer-readable medium, having a computer program stored thereon, wherein the computer program, when executed by a processor, causes the processor to: obtain at least two to-be-synthesized images, the at least two to-be-synthesized images being images of an object captured at different exposures; determine an image luminance value of each of the at least two to-be-synthesized images; determine, for each of the at least two to-be-synthesized images, a luminance weight of each pixel of the to-be-synthesized image based on the image luminance value of the to-be-synthesized image and a luminance value of each pixel of the to-be-synthesized image; and obtain a target image by performing image synthesis processing based on the luminance value of each pixel of the at least two to-be-synthesized images and the luminance weight of each pixel of the at least two to-be-synthesized images, wherein the computer program, when executed by the processor, further causes the processor to: determine a first association image of the to-be-synthesized image, the first association image being a to-be-synthesized image having an image luminance value adjacent to the image luminance value of the to-be-synthesized image; and determine the luminance weight of each pixel of the to-be-synthesized image based on the image luminance value of the to-be-synthesized image, the image luminance value of the first association image, and the luminance value of each pixel of the to-be-synthesized image. ### Claim 16 (depends on 15) The non-transitory computer-readable medium according to claim 15, wherein the computer program, when executed by the processor, further causes the processor to: determine a luminance value interval of each target pixel of the to-be-synthesized image based on the image luminance value of the to-be-synthesized image and the image luminance value of the first association image; determine, when a luminance value of one of pixels of the to-be-synthesized image is within the luminance value interval, a luminance weight of the pixel based on the image luminance value of the to-be-synthesized image, the image luminance value of the first association image, and the luminance value of the pixel; and determine, when the luminance value of the pixel is beyond the luminance value interval, the luminance weight of the pixel—to be a first predetermined value. ### Claim 17 (depends on 16) The non-transitory computer-readable medium according to claim 16, wherein the computer program, when executed by the processor, further causes the processor to: determine, as the luminance value interval of each target pixel of the to-be-synthesized image, an interval defined by the image luminance value of the to-be-synthesized image and the image luminance value of the first association image.