# US 10,771,686 B2 · Method and terminal for acquire panoramic image

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,771,686 B2
- Document ID: US10771686B2
- Status: Granted
- Kind: B2
- Application number: 16/379,001
- Filed: 2019-04-09
- Published: 2019-08-01
- Granted: 2020-09-08
- Earliest claimed: 2013-12-13
- Assignees: Huawei Device Co., Ltd.
- Applicants: Huawei Device Co., Ltd.
- Inventors: Cheng Du; Wei Su; Wei Luo; Bin Deng; Landi Li
- Web page: https://patentgrep.com/patent/US10771686B2

## CPC

- G03B 37/02: with scanning movement of lens or cameras
- G06F 18/22: Matching criteria, e.g. proximity measures
- G06T 7/74: {involving reference images or patches}
- G06T 7/80: Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
- H04N 23/64: {Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image}
- H04N 23/69: Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
- H04N 23/698: for achieving an enlarged field of view, e.g. panoramic image capture
- G06T 2207/10016: Video; Image sequence
- G06T 2207/30244: Camera pose
- G03B: APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR (optical parts of such apparatus G02B; photosensitive materials or processes for photographic purposes G03C; apparatus for processing exposed photographic materials G03D)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A method includes: after a panorama shooting instruction triggered by a user is acquired, shooting a first image, and acquiring a shooting parameter of the first image; determining move guiding information according to a preset move guiding policy, and displaying the move guiding information on a terminal, so as to instruct the user to move the terminal according to the move guiding information; shooting a preset quantity of images according to the shooting parameter of the first image after it is detected that the terminal moves, where the preset quantity of images are background images on both the left and right sides of a background corresponding to the first image; and performing, by using the first image as a center and by using a preset splicing scheme, seamless splicing on the first image and the preset quantity of images, to obtain a panoramic image.

## Claims

### Claim 1

A method for acquiring a panoramic image of a user by a mobile terminal having a front camera and a display on a front side of the mobile terminal, the method comprising:
receiving a user instruction to take a panoramic image from the user;
shooting, with the front camera, a center image including the user while the front camera is facing the user;
after shooting the center image, displaying a shooting instruction on the display to instruct the user to rotate the mobile terminal to a first side of the user;
detecting that the mobile terminal is rotated toward the first side of the user;
shooting, with the front camera, a first side image when the front camera faces the background on the first side of the user, wherein the user is not in a center portion of the first side image;
after shooting the first side image, displaying the shooting instruction on the display to instruct the user to rotate the mobile terminal to a second side of the user, the second side being opposite to the first side;
detecting that the mobile terminal is rotated toward the second side of the user;
shooting, with the front camera, a second side image when the front camera faces the background on the second side of the user, wherein the user is not in a center portion of the second side image; and
splicing the center image, the first side image, and the second side image to obtain a panoramic image with the user at a center of the panoramic image.

### Claim 2 (depends on 1)

The method according to claim 1, wherein the shooting instruction comprises a graphical indicator to instruct the user to rotate the mobile terminal toward the first side or second side of the user.

### Claim 3 (depends on 1)

The method according to claim 1, further comprising:
displaying a preview window showing a current view captured by the front camera, wherein the current view displayed in the preview window is updated as the mobile terminal is rotated.

### Claim 4 (depends on 3)

The method according to claim 3, further comprising:
displaying a second preview window of a reduced size, the second preview window being positioned to overlap with the preview window.

### Claim 5 (depends on 4)

The method according to claim 4, wherein the shooting instruction comprises a textual indicator overlapped with the preview window to instruct the user to rotate the mobile terminal.

### Claim 6 (depends on 1)

The method according to claim 1, further comprising:
detecting a face of the user in the center image;
wherein the splicing of the center image, the first side image, and the second side image is based on overlapping regions located outside the face of the user in the center image.

### Claim 7 (depends on 1)

The method according to claim 1, wherein after shooting the center image and before shooting the first side image, the method further comprises:
locking an automatic white balance (AWB) or automatic exposure (AE) of the center image for shooting the first side and second side images.

### Claim 8

A mobile terminal, comprising:
a display on a front side of the mobile terminal;
a front camera on the front side of the mobile terminal;
a memory storing executable instructions; and
a processor;
the processor being configured to execute the executable instructions to:
receive an instruction from a user to take a panoramic image;
shoot, with the front camera, a center image of the user while the front camera is facing the user;
after shooting the center image, display a shooting instruction on the display to instruct the user to rotate the mobile terminal to a first side of the user;
detect that the mobile terminal is rotated toward the first side of the user;
shoot, with the front camera, a first side image when the front camera faces the background on the first side of the user, wherein the user is not in a center portion of the first side image;
after shooting the first side image, display the shooting instruction on the display to instruct the user to rotate the mobile terminal to a second side of the user, the second side being opposite to the first side;
detect that the mobile terminal is rotated toward the second side of the user;
shoot, with the front camera, a second side image when the front camera faces the background on the second side of the user, wherein the user is not in a center portion of the second side image; and
splice the center image, the first side image, and the second side image to obtain a panoramic image with the user at a center of the panoramic image.

### Claim 9 (depends on 8)

The mobile terminal according to claim 8, wherein the shooting instruction comprises a graphical indicator to instruct the user to rotate the mobile terminal toward the first side or the second side of the user.

### Claim 10 (depends on 8)

The mobile terminal according to claim 8, wherein the processor is further configured to:
display a preview window showing a current view captured by the front camera, wherein the current view displayed in the preview window is updated as the mobile terminal is rotated.

### Claim 11 (depends on 10)

The mobile terminal according to claim 10, wherein the processor is further configured to:
display a second preview window of a reduced size, the second preview window being positioned to overlap with the preview window.

### Claim 12 (depends on 11)

The mobile terminal according to claim 11, wherein the shooting instruction comprises a textual indicator overlapped with the preview window to instruct the user to rotate the mobile terminal.

### Claim 13 (depends on 8)

The mobile terminal according to claim 8, wherein the processor is further configured to:
detect a face of the user in the center image, wherein the splicing of the center image, the first side image, and the second side image are based on overlapping regions located outside the face of the user in the center image.

### Claim 14 (depends on 8)

The mobile terminal according to claim 8, wherein after shooting the center image, and before shooting the first side image, the processor is further configured to:
lock at an automatic white balance (AWB) or automatic exposure (AE) of the center image for shooting the first side and second side images.

### Claim 15

A non-transitory computer-readable medium having stored thereon computer-executable instructions that when executed by a processor of a mobile terminal causes the mobile terminal to perform operations of:
receiving an instruction from a user to take a panoramic image;
shooting, with a front camera of the mobile terminal, a center image of the user while the front camera is facing the user;
after shooting the center image, displaying a shooting instruction on the display to instruct the user to rotate the mobile terminal to a first side of the user;
detecting that the mobile terminal is rotated toward the first side of the user;
shooting, with the front camera, a first side image when the front camera faces the background on the first side of the user, wherein the user is not in a center portion of the first side image;
after shooting the first side image, displaying the shooting instruction on the display to instruct the user to rotate the mobile terminal to a second side of the user, the second side being opposite to the first side;
detecting that the mobile terminal is rotated toward the second side of the user;
shooting, with the front camera, a second side image when the front camera faces the background on the second side of the user, wherein the user is not in a center portion of the second side image; and
splicing the center image, the first side image, and the second side image to obtain a panoramic image with the user at a center of the panoramic image.