# US 11,112,838 B2 · Electronic device and method for changing location of preview image according to direction of camera

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,112,838 B2
- Document ID: US11112838B2
- Status: Granted
- Kind: B2
- Application number: 16/503,954
- Filed: 2019-07-05
- Published: 2020-01-09
- Granted: 2021-09-07
- Earliest claimed: 2018-07-06
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Wonkyu Sung; Kangmoon Kim; Sojung Kim; Dahyun Lee; Jungwon Lee; Junho Jin
- Web page: https://patentgrep.com/patent/US11112838B2

## CPC

- G06F 1/1694: {the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer}
- G06F 1/1652: {the display being flexible, e.g. mimicking a sheet of paper, or rollable}
- G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G09F 9/301: {flexible foldable or roll-able electronic displays, e.g. thin LCD, OLED}
- H04M 1/0268: {including a flexible display panel}
- G06F 1/1615: {with several enclosures having relative motions, each enclosure supporting at least one I/O or computing function (constructional details of portable telephones comprising a plurality of mechanically joined movable body parts H04M1/0206)}
- G06F 1/1643: {the display being associated to a digitizer, e.g. laptops that can be used as penpads (details related to the relative motion of the display enclosure with respect to the body enclosure, e.g. to move between laptop and tablet PC configuration G06F1/1615)}
- G06F 1/1677: {for detecting open or closed state or particular intermediate positions assumed by movable parts of the enclosure, e.g. detection of display lid position with respect to main body in a laptop, detection of opening of the cover of battery compartment}
- G06F 2200/1614: Image rotation following screen orientation, e.g. switching from landscape to portrait mode
- G06F 2200/1637: Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
- G06F 2203/04803: Split screen, i.e. subdividing the display area or the window area into separate subareas
- H04M 1/0243: {using the relative angle between housings}
- H04M 1/0264: {for a camera module assembly}
- H04M 1/72403: with means for local support of applications that increase the functionality
- H04M 2201/34: Microprocessors
- H04M 2201/36: Memories
- H04N 23/57: Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
- H04N 23/63: by using electronic viewfinders
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G09F: DISPLAYING; ADVERTISING; SIGNS; LABELS OR NAME-PLATES; SEALS
- H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An electronic device is provided. The electronic device includes a first housing including a first face and a second face, a second housing including a third face and a fourth face, a folding part rotatably connecting the first housing and the second housing, a flexible display disposed on the first face and the third face, a camera exposed through at least a portion of the fourth face, a memory configured to store instructions, and a processor configured to determine an orientation of the electronic device and a direction in which the camera is pointed while a camera application is executed, identify the first area or the second area as an area in which a preview image acquired through the camera is displayed based at least on the determined direction and the determined orientation, and display the preview image, acquired through the camera, in the identified area using the flexible display.

## Claims

### Claim 1

An electronic device comprising:
a first housing including a first face and a second face, the second face being a rear side of the first face;
a second housing including a third face and a fourth face, the fourth face being a rear side of the third face;
a folding part rotatably connecting the first housing and the second housing to each other;
a flexible display disposed on the first face and the third face across the folding part and including a first area corresponding to the first face and a second area corresponding to the third face;
at least one camera exposed through at least a portion of the fourth face;
at least one memory configured to store instructions; and
at least one processor,
wherein the at least one processor is configured, when the instructions are executed, to:
determine an orientation of the electronic device based on a first angle between the first housing and a ground,
determine a direction of the at least one camera relative to the ground in which the at least one camera is pointed while a camera application is executed based on the determined orientation and a second angle between the first housing and the second housing,
identify at least one of the first area or the second area as an area in which a preview image acquired through the at least one camera is to be displayed based at least on the determined direction and the determined orientation, and
display the preview image, acquired through the at least one camera, in the identified area using the flexible display.

### Claim 2 (depends on 1)

The electronic device of claim 1, wherein the at least one processor is further configured, when the instructions are executed, to:
display a preview image, acquired through the at least one camera, in the first area using the flexible display based on identifying that the direction of the at least one camera relative to the ground corresponds to a first direction, and
display the preview image, acquired through the at least one camera, in the second area using the flexible display based on identifying that the direction of the at least one camera relative to the ground corresponds to a second direction, which is distinct from the first direction.

### Claim 3 (depends on 2)

The electronic device of claim 2, wherein the at least one processor is further configured, when the instructions are executed, to:
display a capture icon for acquiring an image for the preview image in the second area using the flexible display while the preview image is being displayed in the first area, and
acquire the image in response to reception of input for the capture icon.

### Claim 4 (depends on 3)

The electronic device of claim 3, wherein the at least one processor is further configured, when the instructions are executed, to:
display a thumbnail image for representing the image in the second area using the flexible display in response to acquisition of the image.

### Claim 5 (depends on 3)

The electronic device of claim 3, wherein the at least one processor is further configured, when the instructions are executed, to:
display at least one of: at least one first icon for selecting a type of the image, at least one second icon for selecting an effect to be applied to the image, or at least one third icon for adjusting a magnification of the image, together with the capture icon using the flexible display.

### Claim 6 (depends on 5)

The electronic device of claim 5,
wherein the at least one second icon includes a filter option icon for selecting an image filter to be applied to the image, and
wherein the at least one processor is further configured, when the instructions are executed, to:
receive an input for the filter option icon while the preview image is being displayed in the first area,
display other multiple preview images, which are distinct from the preview image displayed in the first area, in the second area using the flexible display in response to reception of the input for the filter option icon, each of the other multiple preview images being acquired based on applying a corresponding filter effect to the image, and
display the preview image, which is being displayed in the second area, in a highlighted form using the flexible display and change the preview image, which is being displayed in the first area, to the selected preview image in response to reception of input for selecting one preview image among the other multiple preview images.

### Claim 7 (depends on 2)

The electronic device of claim 2, wherein the first direction is substantially perpendicular to the second direction.

### Claim 8 (depends on 1)

The electronic device of claim 1,
wherein the folding part includes at least one sensor configured to acquire information on the second angle between the first housing and the second housing, and
wherein the at least one processor is further configured, when the instructions are executed, to:
identify the second angle between the first housing and the second housing, which is detected using the at least one sensor, and
identify at least one of the first area or the second area as an area in which a preview image acquired through the at least one camera is displayed based at least on each of the determined direction and the determined orientation.

### Claim 9 (depends on 1)

The electronic device of claim 1, further comprising:
at least one sensor to be used for detecting an orientation of the electronic device, the at least one sensor being disposed inside at least one of the first housing or the second housing,
wherein the at least one processor is further configured, when the instructions are executed, to:
determine the orientation of the electronic device and the direction in which the at least one camera is pointed using the at least one sensor.

### Claim 10 (depends on 9)

The electronic device of claim 9, wherein the determined orientation corresponds to an orientation for acquiring an image for a landscape.

### Claim 11

A method of operating an electronic device including a flexible display extending across a first housing and a second housing, the method comprising:
determining an orientation of the electronic device based on a first angle between the first housing and a ground;
determining a direction of at least one camera relative to the ground in which the at least one camera, which is exposed through at least a portion of the first housing of the electronic device, is pointed during execution of a camera application, based on the determined orientation and a second angle between the first housing and the second housing;
identifying at least one of a first area corresponding to the first housing or a second area corresponding to the second housing as an area in which a preview image acquired through the at least one camera is to be displayed based at least on the determined direction and the determined orientation; and
displaying the preview image, acquired through the at least one camera, in the identified area.

### Claim 12 (depends on 11)

The method of claim 11, wherein the displaying of the preview image includes:
displaying a preview image, acquired through the at least one camera, in the first area using the flexible display based on identifying that the direction of the at least one camera relative to the ground corresponds to a first direction; and
displaying the preview image, acquired through the at least one camera, in the second area using the flexible display based on identifying that the direction of the at least one camera relative to the ground corresponds to a second direction, which is distinct from the first direction.

### Claim 13 (depends on 12)

The method of claim 12, further comprising:
displaying a capture icon for acquiring an image for the preview image in the second area using the flexible display while the preview image is being displayed in the first area; and
acquiring the image in response to reception of input for the capture icon.

### Claim 14 (depends on 13)

The method of claim 13, further comprising:
displaying a thumbnail image for representing the image in the second area using the flexible display in response to the acquiring of the image.

### Claim 15 (depends on 13)

The method of claim 13, further comprising:
displaying at least one of: at least one first icon for selecting a type of the image, at least one second icon for selecting an effect to be applied to the image, or at least one third icon for adjusting a magnification of the image, together with the capture icon using the flexible display.

### Claim 16 (depends on 15)

The method of claim 15,
wherein the at least one second icon includes a filter option icon for selecting an image filter to be applied to the image, and
wherein the method further comprises:
receiving an input for the filter option icon while the preview image is being displayed in the first area;
displaying other multiple preview images, which are distinct from the preview image displayed in the first area, in the second area using the flexible display in response to reception of the input for the filter option icon, each of the other multiple preview images being acquired based on applying a corresponding filter effect to the image; and
displaying the preview image, which is being displayed in the second area, in a highlighted form using the flexible display and changing the preview image, which is being displayed in the first area, to the selected preview image in response to reception of input for selecting one preview image among the other multiple preview images.

### Claim 17 (depends on 12)

The method of claim 12, wherein the first direction is substantially perpendicular to the second direction.

### Claim 18 (depends on 11)

The method of claim 11, wherein the displaying of the preview image includes:
identifying the second angle between the first housing and the second housing, which is detected using at least one sensor; and
identifying at least one of the first area or the second area as an area in which a preview image acquired through the at least one camera is displayed based at least on each of the determined direction and the determined orientation.

### Claim 19 (depends on 18)

The method of claim 18, wherein the determined orientation corresponds to an orientation for acquiring an image for a landscape.

### Claim 20

An electronic device comprising:
a first housing including a first face and a second face, the second face facing away from the first face;
a second housing including a third face and a fourth face, the fourth face facing away from the third face;
a folding part rotatably connecting a side face of the first housing and a side face of the second housing, which faces the side face of the first housing;
a flexible display disposed on the first face and the third face across the folding part and including a first area corresponding to the first face and a second area corresponding to the third face;
at least one camera exposed through at least a portion of the fourth face;
at least one memory configured to store instructions; and
at least one processor,
wherein the at least one processor is configured, when the instructions are executed, to:
identify whether a direction in which the at least one camera is pointed is changed while a preview image acquired through the at least one camera is being displayed in the second area using the flexible display, and
move the preview image from the second area to the first area using the flexible display in response to an identification result,
wherein the direction is identified based on a first angle and a second angle, and
wherein the first angle is an angle between the first housing and a ground, and the second angle is an angle between the first housing and the second housing.
