# US 11,308,593 B2 · Electronic device for generating composite image and method thereof

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,308,593 B2
- Document ID: US11308593B2
- Status: Granted
- Kind: B2
- Application number: 16/823,795
- Filed: 2020-03-19
- Published: 2020-09-24
- Granted: 2022-04-19
- Earliest claimed: 2019-03-19
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Changsu Han; Sungoh Kim; Youngjo Kim; Hyunhee Park; Jungeun Lee; Sungjun Lim; Hyungju Chun; Jongbum Choi; Jonghun Won; Arang Lee
- Web page: https://patentgrep.com/patent/US11308593B2

## CPC

- G06T 3/4038: Image mosaicing, e.g. composing plane images from plane sub-images
- G06T 5/50: using two or more images, e.g. averaging or subtraction
- G06T 3/40: Scaling of whole images or parts thereof, e.g. expanding or contracting
- H04N 5/265: Mixing
- H04N 23/62: Control of parameters via user interfaces
- H04N 23/661: Transmitting camera control signals through networks, e.g. control via the Internet
- H04N 23/72: Combination of two or more compensation controls
- H04N 23/73: by influencing the exposure time
- H04N 23/80: Camera processing pipelines; Components thereof
- H04N 23/88: for colour balance, e.g. white-balance circuits or colour temperature control
- G06T 2207/10028: Range image; Depth image; 3D point clouds
- G06T 2207/20104: Interactive definition of region of interest [ROI]
- G06T 2207/20221: Image fusion; Image merging
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An electronic device, a method and a storage medium are disclosed. The electronic device includes a processor and a memory operatively coupled to the processor. The processor is configured to receive a user input from an external electronic device. The processor is also configured to synthesize a first region that is a first partial region of a first raw image and a second partial region of a second raw image based on the user input to generate a composite raw image. The processor is further configured to modify at least one of a first attribute of the first raw image and a second attribute of the second raw image to generate a third attribute. Additionally, the processor is configured to calibrate the composite raw image using the third attribute to generate a composite image.

## Claims

### Claim 1

An electronic device, comprising:
a processor; and
a memory operatively coupled to the processor,
wherein the processor is configured to:
receive a user input from an external electronic device;
synthesize a first region that is a first partial region of a first raw image and a second partial region of a second raw image based on the user input to generate a composite raw image;
based on at least one of a first attribute of the first raw image and a second attribute of the second raw image, identify a third attribute; and
calibrate the composite raw image using the third attribute to generate a composite image from the composite raw image,
wherein the first attribute includes at least one of a first brightness value, a first exposure time, a first white balance value, and a first depth map of the first region, and
wherein the second attribute includes at least one of a second brightness, a second exposure time, a second white balance value, and a second depth map of the second partial region of the second raw image.

### Claim 2 (depends on 1)

The electronic device of claim 1, wherein the processor is further configured to:
when a first area where the first region is occupied in the composite raw image is greater than or equal to a reference area, modify the second attribute based on the first attribute to identify the third attribute; and
when the first area is less than the reference area, modify the first attribute based on the second attribute to identify the third attribute.

### Claim 3 (depends on 2)

The electronic device of claim 2, wherein
the processor is further configured to:
when the first area is greater than or equal to the reference area, modify the second white balance value of the second partial region of the second raw image to the first white balance value of the first region based on the third attribute to generate the composite image; and
when the first area is less than the reference area, modify the first white balance value of the first region to the second white balance value of the second partial region of the second raw image based on the third attribute to generate the composite image.

### Claim 4 (depends on 1)

The electronic device of claim 1, wherein the processor is further configured to:
compare a first area where the first region is occupied in the composite raw image with a second area where the second partial region of the second raw image is occupied in the composite raw image to identify a large area and a small area between the first area and the second area;
when the identified large area is the first area, modify the second attribute based on the first attribute to identify the third attribute; and
when the identified large area is the second area, modify the first attribute based on the second attribute to identify the third attribute.

### Claim 5 (depends on 1)

The electronic device of claim 1, wherein:
the user input includes first information about a location where the first region is placed in the second partial region of the second raw image and second information about a size of the first region that is occupied in the second partial region of the second raw image, and
the processor is further configured to:
place the first region based on the first information about the location on the second partial region of the second raw image; and
adjust the size of the first region based on the second information about the size to generate the composite raw image.

### Claim 6 (depends on 1)

The electronic device of claim 1, wherein the processor is further configured to:
extract a second region from the first raw image; and
synthesize the first region, the second region, and the second partial region of the second raw image to generate the composite raw image.

### Claim 7 (depends on 1)

The electronic device of claim 1, wherein the processor is further configured to:
when a reference image is the first raw image based on the user input associated with the reference image, modify the second attribute based on the first attribute to identify the third attribute; and
when the reference image is the second raw image, modify the first attribute based on the second attribute to identify the third attribute.

### Claim 8 (depends on 7)

The electronic device of claim 7, wherein
the processor is further configured to:
when the reference image is the first raw image, modify the second white balance value of the second partial region of the second raw image to the first white balance value of the first region based on the third attribute to generate the composite image; and
when the reference image is the second raw image, modify the first white balance value of the first region to the second white balance value of the second partial region of the second raw image based on the third attribute to generate the composite image.

### Claim 9 (depends on 1)

The electronic device of claim 1, wherein the processor is further configured to:
identify the third attribute based on an average value of the first attribute and the second attribute.

### Claim 10 (depends on 9)

The electronic device of claim 9, wherein
the processor is further configured to:
identify the third attribute based on an average value of the first white balance value of the first partial region of the first raw image and the second white balance value of the second partial region of the second raw image.

### Claim 11

A method for generating a composite image in an electronic device, the method comprising:
receiving a user input;
synthesizing a first region that is a first partial region of a first raw image and a second partial region of a second raw image based on the user input to generate a composite raw image;
based on at least one of a first attribute of the first raw image and a second attribute of the second raw image, identifying a third attribute; and
calibrating the composite raw image using the third attribute to generate the composite image from the composite raw image,
wherein the first attribute includes at least one of a first brightness value, a first exposure time, a first white balance value, and a first depth map of the first region, and
wherein the second attribute includes at least one of a second brightness, a second exposure time, a second white balance value, and a second depth map of the second partial region of the second raw image.

### Claim 12 (depends on 11)

The method of claim 11, wherein identifying the third attribute includes:
when a first area where the first region is occupied in the composite raw image is greater than or equal to a reference area, modifying the second attribute based on the first attribute to identify the third attribute; and
when the first area is less than the reference area, modifying the first attribute based on the second attribute to identify the third attribute.

### Claim 13 (depends on 11)

The method of claim 11, wherein identifying the third attribute includes:
comparing a first area where the first region is occupied in the composite raw image with a second area where the second partial region of the second raw image is occupied in the composite raw image to identify a large area and a small area between the first area and the second area;
when the identified large area is the first area, modifying the second attribute based on the first attribute to identify the third attribute; and
when the identified large area is the second area, modifying the first attribute based on the second attribute to identify the third attribute.

### Claim 14 (depends on 11)

The method of claim 11, wherein:
the user input includes first information about a location where the first region is placed in the second partial region of the second raw image and second information about a size of the first region that is occupied in the second partial region of the second raw image, and
generating the composite raw image includes:
placing the first region based on the first information about the location on the second partial region of the second raw image; and
adjusting the size of the first region based on the second information about the size to generate the composite raw image.

### Claim 15 (depends on 11)

The method of claim 11, wherein:
the user input includes information about a reference image, and
identifying the third attribute includes:
when the reference image is the first raw image, modifying the second attribute based on the first attribute to identify the third attribute; and
when the reference image is the second raw image, modifying the first attribute based on the second attribute to identify the third attribute.

### Claim 16

A non-transitory computer-readable storage medium storing computer-readable instructions that, when executed, cause a processor of an electronic device to:
receive a user input;
synthesize a first region that is a first partial region of a first raw image and a second partial region of a second raw image based on the user input to generate a composite raw image;
based on at least one of a first attribute of the first raw image and a second attribute of the second raw image, identify a third attribute; and
calibrate the composite raw image using the third attribute to generate a composite image from the composite raw image,
wherein the first attribute includes at least one of a first brightness value, a first exposure time, a first white balance value, and a first depth map of the first region, and
wherein the second attribute includes at least one of a second brightness, a second exposure time, a second white balance value, and a second depth map of the second partial region of the second raw image.

### Claim 17 (depends on 16)

The non-transitory computer-readable storage medium of claim 16, wherein the computer-readable instructions that, when executed, cause the processor to identify the third attribute include computer-readable instructions that, when executed, cause the processor to:
when a first area where the first region is occupied in the composite raw image is greater than or equal to a reference area, modify the second attribute based on the first attribute to identify the third attribute; and
when the first area is less than the reference area, modify the first attribute based on the second attribute to identify the third attribute.

### Claim 18 (depends on 16)

The non-transitory computer-readable storage medium of claim 16, wherein the computer-readable instructions that, when executed, cause the processor to identify the third attribute include computer-readable instructions that, when executed, cause the processor to:
compare a first area where the first region is occupied in the composite raw image with a second area where the second partial region of the second raw image is occupied in the composite raw image to identify a large area and a small area between the first area and the second area;
when the identified large area is the first area, modify the second attribute based on the first attribute to identify the third attribute; and
when the identified large area is the second area, modify the first attribute based on the second attribute to identify the third attribute.

### Claim 19 (depends on 16)

The non-transitory computer-readable storage medium of claim 16, wherein:
the user input includes first information about a location where the first region is placed in the second partial region of the second raw image and second information about a size of the first region that is occupied in the second partial region of the second raw image, and
the computer-readable instructions that, when executed, cause the processor to generate the composite raw image include computer-readable instructions that, when executed, cause the processor to:
place the first region based on the first information about the location on the second partial region of the second raw image; and
adjust the size of the first region based on the second information about the size to generate the composite raw image.

### Claim 20 (depends on 16)

The non-transitory computer-readable storage medium of claim 16, wherein:
the user input includes information about a reference image, and
the computer-readable instructions that, when executed, cause the processor to identify the third attribute include computer-readable instructions that, when executed, cause the processor to:
when the reference image is the first raw image, modify the second attribute based on the first attribute to identify the third attribute; and
when the reference image is the second raw image, modify the first attribute based on the second attribute to identify the third attribute.