# US 2025/0168314 A1 · Electronic device and method for acquiring depth map

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0168314 A1
- Document ID: US20250168314A1
- Status: Published application
- Kind: A1
- Application number: 19/034,074
- Filed: 2025-01-22
- Published: 2025-05-22
- Earliest claimed: 2022-08-09
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Jongmin HYUN; Seunghan LEE; Jonghyeok CHUN; Cheolhee CHOI; Daeyoung HYUN
- Web page: https://patentgrep.com/patent/US20250168314A1

## CPC

- H04N 13/271: wherein the generated image signals comprise depth maps or disparity maps
- G01B 11/22: for measuring depth
- G06T 7/579: from motion
- G06T 7/593: from stereo images
- H04N 5/2621: {Cameras specially adapted for the electronic generation of special effects during image pickup, e.g. digital cameras, camcorders, video cameras having integrated special effects capability}
- H04N 13/128: Adjusting depth or disparity
- H04N 13/239: using two two-dimensional [2D] image sensors having a relative position equal to or related to the interocular distance (H04N13/243 takes precedence)
- H04N 23/45: for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
- H04N 23/61: based on recognised objects
- H04N 23/71: Circuitry for evaluating the brightness variation
- G06T 2207/10016: Video; Image sequence
- H04N 23/741: by increasing the dynamic range of the image compared to the dynamic range of the electronic image sensors
- H04N 2013/0081: {Depth or disparity estimation from stereoscopic image signals}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G01B: MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

An electronic device is provided. The electronic device includes at least one sensors, a plurality of cameras, a display, memory storing one or more computer programs, and one or more processors communicatively coupled to the at least one sensor, the plurality of cameras, the display, and the memory, wherein the one or more computer programs include computer-executable instructions that, when executed by the one or more processors individually or collectively, cause the electronic device to obtain first image information on a frame, using a first camera among the plurality of cameras, obtain second image information on the frame, using a second camera among the plurality of cameras, determine a depth map calculation scheme, based on at least one matching condition, related to at least of a difference between the first image information and the second image information, a brightness value of the frame, or an object detected from the frame, obtain depth map information, based on at least one camera identified according to the depth map calculation method, and display, through the display, an image in which a designated processing is applied to a background area based on the depth map information, wherein the depth map calculation scheme is determined based at least in part on a first scheme for determining a depth map through the plurality of cameras and a second scheme for determining the depth map through a single camera among the plurality of cameras.

## Claims

### Claim 1

An electronic device comprising:
at least one sensor;
a plurality of cameras;
a display;
memory storing one or more computer programs; and
one or more processors communicatively coupled to the at least one sensor, the plurality of cameras, the display, and the memory,
wherein, the one or more computer programs include computer-executable instructions that, when executed by the one or more processors individually or collectively, cause the electronic device to:
obtain first image information on a frame, using a first camera among the plurality of cameras,
obtain second image information on the frame, using a second camera among the plurality of cameras,
determine a depth map calculation scheme, based on at least one matching condition, related to at least one of a difference between the first image information and the second image information, a brightness value of the frame, or an object detected from the frame,
obtain depth map information, based on at least one camera identified according to the depth map calculation scheme, and
display, through the display, an image in which a designated processing is applied to a background area based on the depth map information, and
wherein the depth map calculation scheme is determined based at least in part on a first scheme for determining a depth map through the plurality of cameras and a second scheme for determining the depth map through a single camera among the plurality of cameras.

### Claim 2 (depends on 1)

The electronic device of claim 1, wherein to determine the depth map calculation scheme, the one or more computer programs further include computer-executable instructions that, when executed by the one or more processors individually or collectively, cause the electronic device to:
obtain the brightness value through an illuminance sensor,
identify the first scheme as the depth map calculation scheme, when the obtained brightness value is greater than or equal to a threshold value, and
identify the second scheme as the depth map calculation scheme, when the obtained brightness value is less than the threshold value.

### Claim 3 (depends on 1)

The electronic device of claim 1, wherein to determine the depth map calculation scheme, the one or more computer programs further include computer-executable instructions that, when executed by the one or more processors individually or collectively, cause the electronic device to:
obtain a distance value from the object through a distance detection sensor,
identify the second scheme as the depth map calculation scheme, when the obtained distance value is less than a reference value, and
identify the first scheme as the depth map calculation scheme, when the obtained distance value is greater than or equal to the reference value.

### Claim 4 (depends on 1)

The electronic device of claim 1, wherein to determine the depth map calculation scheme, the one or more computer programs further include computer-executable instructions that, when executed by the one or more processors individually or collectively, cause the electronic device to:
detect the object in the frame through an object detection algorithm,
identify whether the detected object corresponds to a designated type, and
determine a scheme of applying a first weight to the first scheme and applying a second weight greater than the first weight to the second scheme, when the detected object corresponds to the designated type.

### Claim 5 (depends on 4)

The electronic device of claim 4, wherein the designated type includes an object having a repetition pattern, or an object being texture-less or including transparent material.

### Claim 6 (depends on 1)

The electronic device of claim 1, wherein to determine the depth map calculation scheme, the one or more computer programs further include computer-executable instructions that, when executed by the one or more processors individually or collectively, cause the electronic device to:
for one area among a plurality of areas of the frame, apply a first weight corresponding to the one area to first depth map information obtained through the first scheme,
apply a second weight corresponding to the one area to second depth map information obtained through the second scheme, and
obtain the depth map information, based on the first depth map information to which the first weight is applied and the second depth map information to which the second weight is applied.

### Claim 7 (depends on 1)

The electronic device of claim 1, wherein to determine the depth map calculation scheme, the one or more computer programs further include computer-executable instructions that, when executed by the one or more processors individually or collectively, cause the electronic device to:
identify a saturation area of a high dynamic range (HDR) in the frame, and
determine a depth map calculation scheme for the saturation area as the second scheme.

### Claim 8 (depends on 1)

The electronic device of claim 1, wherein to determine the depth map calculation scheme, the one or more computer programs further include computer-executable instructions that, when executed by the one or more processors individually or collectively, cause the electronic device to:
identify a moving area in the frame, based on a first frame photographed through a first exposure value and a second frame photographed through a second exposure value different from the first exposure value, and
determine a depth map calculation scheme for the moving area as the second scheme.

### Claim 9 (depends on 1)

The electronic device of claim 1, wherein to determine the depth map calculation scheme, the one or more computer programs further include computer-executable instructions that, when executed by the one or more processors individually or collectively, cause the electronic device to:
identify an area corresponding to the object in the frame, and
determine a depth map calculation scheme for the identified area as the second scheme.

### Claim 10 (depends on 1)

The electronic device of claim 1, wherein in order to display the image, the one or more computer programs further include computer-executable instructions that, when executed by the one or more processors individually or collectively, cause the electronic device to:
identify a background area and a foreground area in the frame,
apply Bokeh effect to the background area,
obtain the image by combining the background area to which the Bokeh effect is applied and the foreground area, and
display the obtained image through the display.

### Claim 11

A method performed by an electronic device, the method comprising:
obtaining first image information for a frame, using a first camera among a plurality of cameras;
obtaining second image information for the frame, using a second camera among the plurality of cameras;
determining a depth map calculation scheme, based on at least one matching condition, related to at least one of a difference between the first image information and the second image information, a brightness value of the frame, or an object detected from the frame;
obtaining depth map information for the frame, based on at least one camera identified according to the depth map calculation scheme; and
displaying, through a display, an image in which a designated processing is applied to a background area based on the depth map information,
wherein the depth map calculation scheme is determined based at least in part on a first scheme for determining a depth map through the plurality of cameras and a second scheme for determining the depth map through a single camera among the plurality of cameras.

### Claim 12 (depends on 11)

The method of claim 11, wherein the determining of the depth map calculation scheme comprises:
obtaining the brightness value through an illuminance sensor;
identifying the first scheme as the depth map calculation scheme, when the obtained brightness value is greater than or equal to a threshold value; and
identifying the second scheme as the depth map calculation scheme, when the obtained brightness value is less than the threshold value.

### Claim 13 (depends on 11)

The method of claim 11, wherein the determining of the depth map calculation scheme comprises:
obtaining a distance value from the object through a distance detection sensor;
identifying the second scheme as the depth map calculation scheme, when the obtained distance value is less than a reference value; and
identifying the first scheme as the depth map calculation scheme, when the obtained distance value is greater than or equal to the reference value.

### Claim 14 (depends on 11)

The method of claim 11, wherein the determining of the depth map calculation scheme comprises:
detecting the object in the frame through an object detection algorithm;
identifying whether the detected object corresponds to a designated type; and
determining a scheme of applying a first weight to the first scheme and applying a second weight greater than the first weight to the second scheme, when the detected object corresponds to the designated type.

### Claim 15 (depends on 14)

The method of claim 14, wherein the designated type includes an object having a repetition pattern, or an object being texture-less or including transparent material.

### Claim 16 (depends on 11)

The method of claim 11, wherein the determining of the depth map calculation scheme comprises:
for one area among a plurality of areas of the frame, applying a first weight corresponding to the one area to first depth map information obtained through the first scheme;
applying a second weight corresponding to the one area to second depth map information obtained through the second scheme; and
obtaining the depth map information, based on the first depth map information to which the first weight is applied and the second depth map information to which the second weight is applied.

### Claim 17 (depends on 11)

The method of claim 11, wherein the determining of the depth map calculation scheme comprises:
identifying a saturation area of a high dynamic range (HDR) in the frame; and
determining a depth map calculation scheme for the saturation area as the second scheme.

### Claim 18 (depends on 11)

The method of claim 11, wherein the determining of the depth map calculation scheme comprises:
identifying a moving area in the frame, based on a first frame photographed through a first exposure value and a second frame photographed through a second exposure value different from the first exposure value, and
determining a depth map calculation scheme for the moving area as the second scheme.

### Claim 19

One or more non-transitory computer-readable storage media storing one or more computer programs including computer-executable instructions that, when executed by one or more processors of an electronic device individually or collectively, cause the electronic device to perform operations, the operations comprising:
obtaining first image information for a frame, using a first camera among a plurality of cameras;
obtaining second image information for the frame, using a second camera among the plurality of cameras;
determining a depth map calculation scheme, based on at least one matching condition, related to at least one of a difference between the first image information and the second image information, a brightness value of the frame, or an object detected from the frame;
obtaining depth map information for the frame, based on at least one camera identified according to the depth map calculation scheme; and
displaying, through a display, an image in which a designated processing is applied to a background area based on the depth map information,
wherein the depth map calculation scheme is determined based at least in part on a first scheme for determining a depth map through the plurality of cameras and a second scheme for determining the depth map through a single camera among the plurality of cameras.

### Claim 20 (depends on 19)

The non-transitory computer-readable storage media of claim 19, wherein to determine the depth map calculation scheme, the operations further comprise:
obtaining the brightness value through an illuminance sensor;
identifying the first scheme as the depth map calculation scheme, when the obtained brightness value is greater than or equal to a threshold value; and
identifying the second scheme as the depth map calculation scheme, when the obtained brightness value is less than the threshold value.
