# US 11,115,591 B2 · Photographing method and mobile terminal

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,115,591 B2
- Document ID: US11115591B2
- Status: Granted
- Kind: B2
- Application number: 17/037,410
- Filed: 2020-09-29
- Published: 2021-01-14
- Granted: 2021-09-07
- Earliest claimed: 2018-04-04
- Assignees: Vivo Mobile Communication Co., Ltd.
- Applicants: Vivo Mobile Communication Co., Ltd.
- Inventors: Dong Wei
- Web page: https://patentgrep.com/patent/US11115591B2

## CPC

- H04N 5/265: Mixing
- G06F 3/0481: based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour
- G06F 3/0485: Scrolling or panning
- G06F 3/0486: Drag-and-drop
- G06F 3/04883: for inputting data by handwriting, e.g. gesture or text
- G06F 3/04886: by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
- H04N 23/45: for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
- H04N 23/62: Control of parameters via user interfaces
- H04N 23/631: {Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters}
- H04N 23/632: {for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters}
- H04N 23/80: Camera processing pipelines; Components thereof
- H04N 23/951: by using two or more images to influence resolution, frame rate or aspect ratio
- G06F 2203/04803: Split screen, i.e. subdividing the display area or the window area into separate subareas
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A photographing method and a mobile terminal are provided. The method includes: receiving a first input by a user when a current screen displays a photographing preview screen; in response to the first input, updating the photographing preview screen and displaying it as a first sub-preview-screen and a second sub-preview-screen; receiving a second input by the user; in response to the second input, controlling a first photographing identifier displayed on the first sub-preview-screen and a second photographing identifier displayed on the second sub-preview-screen to move; and when the first photographing identifier and the second photographing identifier overlap, controlling a front-facing camera and a rear-facing camera to capture a first image and a second image respectively, and displaying a composite image of the first image and the second image.

## Claims

### Claim 1

A photographing method, wherein the photographing method is applied to a mobile terminal that comprises a front-facing camera and a rear-facing camera, and the photographing method comprises:
receiving a first input by a user when a current screen displays a photographing preview screen;
in response to the first input, updating the photographing preview screen and displaying it as a first sub-preview-screen and a second sub-preview-screen;
receiving a second input by the user;
in response to the second input, controlling a first photographing identifier displayed on the first sub-preview-screen and a second photographing identifier displayed on the second sub-preview-screen to move; and
when the first photographing identifier and the second photographing identifier have an overlapping region with a preset area, controlling the front-facing camera and the rear-facing camera to capture a first image and a second image respectively, and displaying a composite image of the first image and the second image, wherein
the first sub-preview-screen displays a preview image captured by the front-facing camera, and the second sub-preview-screen displays a preview image captured by the rear-facing camera.

### Claim 2 (depends on 1)

The method according to claim 1, wherein the first input is a sliding operation performed by the user on the photographing preview screen; and
the updating the photographing preview screen and displaying it as a first sub-preview-screen and a second sub-preview-screen comprises:
obtaining a sliding trajectory of the first input; and
when the sliding trajectory satisfies a preset condition, updating the photographing preview screen and displaying it as the first sub-preview-screen and the second sub-preview-screen with a straight line on which the sliding trajectory is located as a dividing line.

### Claim 3 (depends on 2)

The method according to claim 2, wherein the when the sliding trajectory satisfies a preset condition, updating the photographing preview screen and displaying it as the first sub-preview-screen and the second sub-preview-screen with a straight line on which the sliding trajectory is located as a dividing line comprises:
obtaining N target points on the sliding trajectory;
obtaining a coordinate value of each target point in a preset coordinate system, and calculating a variance of coordinate values of the N target points; and
when the variance is less than a preset threshold and a length of the sliding trajectory is greater than a preset length, updating the photographing preview screen and displaying it as the first sub-preview-screen and the second sub-preview-screen with the straight line on which the sliding trajectory is located as the dividing line, wherein
the coordinate value of each target point is a coordinate value of the target point in an X direction or a Y direction of the preset coordinate system, and N is an integer greater than 1.

### Claim 4 (depends on 2)

The method according to claim 2, wherein after the when the sliding trajectory satisfies a preset condition, updating the photographing preview screen and displaying it as the first sub-preview-screen and the second sub-preview-screen with a straight line on which the sliding trajectory is located as a dividing line, and before the receiving a second input by the user, the method further comprises:
receiving a third input that the user drags the dividing line; and
in response to the third input, controlling the dividing line to move according to a dragging direction and a dragging distance of the third input.

### Claim 5 (depends on 1)

The method according to claim 1, wherein the mobile terminal is a mobile terminal with a flexible screen, and the first input is an operation of bending the flexible screen by the user; and
the updating the photographing preview screen and displaying it as a first sub-preview-screen and a second sub-preview-screen comprises:
obtaining a bending angle of the flexible screen;
when the bending angle is greater than a preset angle, obtaining a kink mark formed by the first input on the flexible screen; and
when a direction of the kink mark is a preset direction, updating the photographing preview screen and displaying it as the first sub-preview-screen and the second sub-preview-screen with a straight line on which the kink mark is located as a dividing line.

### Claim 6 (depends on 5)

The method according to claim 5, wherein after the when a direction of the kink mark is a preset direction, updating the photographing preview screen and displaying it as the first sub-preview-screen and the second sub-preview-screen with a straight line on which the kink mark is located as a dividing line, the method further comprises:
receiving a fourth input that the user bends the flexible screen; and
in response to the fourth input, controlling the dividing line to move according to a bending direction of the fourth input, wherein
moving of a location of the dividing line corresponds to size adjustment of screen areas of the first sub-preview-screen and the second sub-preview-screen, a first bending direction of the fourth input corresponds to a first moving direction of the dividing line, and a second bending direction of the fourth input corresponds to a second moving direction of the dividing line.

### Claim 7 (depends on 1)

The method according to claim 1, wherein the when the first photographing identifier and the second photographing identifier have an overlapping region with a preset area, controlling the front-facing camera and the rear-facing camera to capture a first image and a second image respectively, and displaying a composite image of the first image and the second image comprises:
when the first photographing identifier and the second photographing identifier have the overlapping region with the preset area, controlling the front-facing camera and the rear-facing camera to capture the first image and the second image respectively; and
when the first image comprises a face image, displaying a composite image of the face image and the second image.

### Claim 8 (depends on 7)

The method according to claim 7, wherein the when the first image comprises a face image, displaying a composite image of the face image and the second image comprises:
when the first image comprises the face image, displaying the face image at a preset location on the second image;
receiving a fifth input that the user drags the face image;
in response to the fifth input, moving the face image; and
displaying the composite image of the face image and the second image, wherein
the face image is at a dragging end location of the fifth input.

### Claim 9 (depends on 1)

The method according to claim 1, wherein before the displaying a composite image of the first image and the second image, the method further comprises:
displaying a first image edit box and a second image edit box, wherein the first image is displayed in the first image edit box, and the second image is displayed in the second image edit box;
receiving a sixth input by the user on the first image edit box or the second image edit box; and
in response to the sixth input, adjusting a size of the first image edit box or the second image edit box, wherein
the first image edit box is used to adjust a size of the first image, and the second image edit box is used to adjust a size of the second image.

### Claim 10 (depends on 1)

The method according to claim 1, wherein after the displaying a composite image of the first image and the second image, the method further comprises:
displaying a third image edit box, wherein the composite image is displayed in the third image edit box;
receiving a seventh input by the user on the third image edit box; and
in response to the seventh input, adjusting a size of the third image edit box, wherein
the third image edit box is used to adjust a size of the composite image.

### Claim 11

A mobile terminal, wherein the mobile terminal has a front-facing camera and a rear-facing camera, and the mobile terminal comprises a memory, a processor, and a program that is stored in the memory and is capable of running on the processor, when the program is executed by the processor, the processor implements steps of a photographing method, the photographing method comprising:
receiving a first input by a user when a current screen displays a photographing preview screen;
in response to the first input, updating the photographing preview screen and displaying it as a first sub-preview-screen and a second sub-preview-screen;
receiving a second input by the user;
in response to the second input, controlling a first photographing identifier displayed on the first sub-preview-screen and a second photographing identifier displayed on the second sub-preview-screen to move; and
when the first photographing identifier and the second photographing identifier have an overlapping region with a preset area, controlling the front-facing camera and the rear-facing camera to capture a first image and a second image respectively, and displaying a composite image of the first image and the second image, wherein
the first sub-preview-screen displays a preview image captured by the front-facing camera, and the second sub-preview-screen displays a preview image captured by the rear-facing camera.

### Claim 12 (depends on 11)

The mobile terminal according to claim 11, wherein the first input is a sliding operation performed by the user on the photographing preview screen; and
the updating the photographing preview screen and displaying it as a first sub-preview-screen and a second sub-preview-screen comprises:
obtaining a sliding trajectory of the first input; and
when the sliding trajectory satisfies a preset condition, updating the photographing preview screen and displaying it as the first sub-preview-screen and the second sub-preview-screen with a straight line on which the sliding trajectory is located as a dividing line.

### Claim 13 (depends on 12)

The mobile terminal according to claim 12, wherein the when the sliding trajectory satisfies a preset condition, updating the photographing preview screen and displaying it as the first sub-preview-screen and the second sub-preview-screen with a straight line on which the sliding trajectory is located as a dividing line comprises:
obtaining N target points on the sliding trajectory;
obtaining a coordinate value of each target point in a preset coordinate system, and calculating a variance of coordinate values of the N target points; and
when the variance is less than a preset threshold and a length of the sliding trajectory is greater than a preset length, updating the photographing preview screen and displaying it as the first sub-preview-screen and the second sub-preview-screen with the straight line on which the sliding trajectory is located as the dividing line, wherein
the coordinate value of each target point is a coordinate value of the target point in an X direction or a Y direction of the preset coordinate system, and N is an integer greater than 1.

### Claim 14 (depends on 12)

The mobile terminal according to claim 12, wherein after the when the sliding trajectory satisfies a preset condition, updating the photographing preview screen and displaying it as the first sub-preview-screen and the second sub-preview-screen with a straight line on which the sliding trajectory is located as a dividing line, and before the receiving a second input by the user, the photographing method further comprises:
receiving a third input that the user drags the dividing line; and
in response to the third input, controlling the dividing line to move according to a dragging direction and a dragging distance of the third input.

### Claim 15 (depends on 11)

The mobile terminal according to claim 11, wherein the mobile terminal is a mobile terminal with a flexible screen, and the first input is an operation of bending the flexible screen by the user; and
the updating the photographing preview screen and displaying it as a first sub-preview-screen and a second sub-preview-screen comprises:
obtaining a bending angle of the flexible screen;
when the bending angle is greater than a preset angle, obtaining a kink mark formed by the first input on the flexible screen; and
when a direction of the kink mark is a preset direction, updating the photographing preview screen and displaying it as the first sub-preview-screen and the second sub-preview-screen with a straight line on which the kink mark is located as a dividing line.

### Claim 16 (depends on 15)

The mobile terminal according to claim 15, wherein after the when a direction of the kink mark is a preset direction, updating the photographing preview screen and displaying it as the first sub-preview-screen and the second sub-preview-screen with a straight line on which the kink mark is located as a dividing line, the photographing method further comprises:
receiving a fourth input that the user bends the flexible screen; and
in response to the fourth input, controlling the dividing line to move according to a bending direction of the fourth input, wherein
moving of a location of the dividing line corresponds to size adjustment of screen areas of the first sub-preview-screen and the second sub-preview-screen, a first bending direction of the fourth input corresponds to a first moving direction of the dividing line, and a second bending direction of the fourth input corresponds to a second moving direction of the dividing line.

### Claim 17 (depends on 11)

The mobile terminal according to claim 11, wherein the when the first photographing identifier and the second photographing identifier have an overlapping region with a preset area, controlling the front-facing camera and the rear-facing camera to capture a first image and a second image respectively, and displaying a composite image of the first image and the second image comprises:
when the first photographing identifier and the second photographing identifier have the overlapping region with the preset area, controlling the front-facing camera and the rear-facing camera to capture the first image and the second image respectively; and
when the first image comprises a face image, displaying a composite image of the face image and the second image.

### Claim 18 (depends on 17)

The mobile terminal according to claim 17, wherein the when the first image comprises a face image, displaying a composite image of the face image and the second image comprises:
when the first image comprises the face image, displaying the face image at a preset location on the second image;
receiving a fifth input that the user drags the face image;
in response to the fifth input, moving the face image; and
displaying the composite image of the face image and the second image, wherein
the face image is at a dragging end location of the fifth input.

### Claim 19 (depends on 11)

The mobile terminal according to claim 11, wherein:
before the displaying a composite image of the first image and the second image, the photographing method further comprises:
displaying a first image edit box and a second image edit box, wherein the first image is displayed in the first image edit box, and the second image is displayed in the second image edit box;
receiving a sixth input by the user on the first image edit box or the second image edit box; and
in response to the sixth input, adjusting a size of the first image edit box or the second image edit box, wherein the first image edit box is used to adjust a size of the first image, and the second image edit box is used to adjust a size of the second image; or,
after the displaying a composite image of the first image and the second image, the photographing method further comprises:
displaying a third image edit box, wherein the composite image is displayed in the third image edit box;
receiving a seventh input by the user on the third image edit box; and
in response to the seventh input, adjusting a size of the third image edit box, wherein the third image edit box is used to adjust a size of the composite image.

### Claim 20 (depends on 1)

A computer-readable storage medium, wherein the computer-readable storage medium stores a program, and when the program is executed by a processor, the steps of the photographing method according to claim 1 are implemented.