# US 12,223,653 B2 · Panorama rendering method, electronic device and storage medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,223,653 B2
- Document ID: US12223653B2
- Status: Granted
- Kind: B2
- Application number: 17/685,055
- Filed: 2022-03-02
- Published: 2022-06-16
- Granted: 2025-02-11
- Earliest claimed: 2021-06-30
- Assignees: Beijing Baidu Netcom Science Technology Co., Ltd.
- Applicants: Beijing Baidu Netcom Science Technology Co., Ltd.
- Inventors: Da Qu
- Web page: https://patentgrep.com/patent/US12223653B2

## CPC

- G06T 11/60: Creating or editing images; Combining images with text
- G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
- G06T 7/10: Segmentation; Edge detection (motion-based segmentation G06T7/215)
- G09G 5/34: for rolling or scrolling
- G09G 5/393: Arrangements for updating the contents of the bit-mapped memory
- G09G 5/395: Arrangements specially adapted for transferring the contents of the bit-mapped memory to the screen (G09G5/399 takes precedence)
- G09G 2340/04: Changes in size, position or resolution of an image
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)

## Abstract

A panorama rendering method, an electronic device and a storage medium are provided, and relates to the field of panoramic technology. The method includes: segmenting a panoramic picture to obtain segmented panoramic tile pictures; determining a target tile picture under a current screen and a target spherical patch in a panoramic picture sphere model, according to the panoramic picture sphere model and the segmented panoramic tile pictures; and pelfonning drawing on the target spherical patch by using the target tile picture, to obtain a target scene. In this way, time consumption of panorama loading can be reduced and loading performance can be improved.

## Claims

### Claim 1

A panorama rendering method, comprising:
segmenting a panoramic picture to obtain segmented panoramic tile pictures;
determining a target tile picture under a current screen and a target spherical patch in a panoramic picture sphere model, according to the panoramic picture sphere model and the segmented panoramic tile pictures; and
performing drawing on the target spherical patch by using the target tile picture, to obtain a target scene,
wherein the panoramic picture sphere model is a sphere composed of a plurality of spherical patches,
wherein the segmenting the panoramic picture to obtain the segmented panoramic tile pictures, comprises:
acquiring a reference size and a segmentation level of a single panoramic tile picture, wherein the segmentation level is a level describing a resolution of a picture; and
segmenting the panoramic picture according to the reference size and the segmentation level, to obtain the segmented panoramic tile pictures.

### Claim 2 (depends on 1)

The method of claim 1, wherein before performing drawing on the target spherical patch by using the target tile picture, to obtain the target scene, the method further comprises:
segmenting the panoramic picture according to a set segmentation level, to obtain a target thumbnail; and
performing drawing on all spherical patches of the panoranlle panoramic picture sphere model by using the target thumbnail, to obtain a transition scene.

### Claim 3 (depends on 2)

The method of claim 2, wherein the determining the target tile picture under the current screen and the target spherical patch in the panoramic picture sphere model, according to the panoramic picture sphere model and the segmented panoramic tile pictures, comprises:
acquiring a plurality of panoramic picture sphere model coordinates corresponding to a plurality of screen boundary points of the current screen;
determining a plurality of spherical patches corresponding to the plurality of screen boundary points according to the plurality of panoramic picture sphere model coordinates, to obtain the target spherical patch; and
determining a target tile picture corresponding to the target spherical patch according to a corresponding relationship between the segmented panoramic tile pictures and the panoramic picture sphere model.

### Claim 4 (depends on 1)

The method of claim 1, wherein the determining the target tile picture under the current screen and the target spherical patch in the panoramic picture sphere model, according to the panoramic picture sphere model and the segmented panoramic tile pictures, comprises:
acquiring a plurality of panoramic picture sphere model coordinates corresponding to a plurality of screen boundary points of the current screen;
determining a plurality of spherical patches corresponding to the plurality of screen boundary points according to the plurality of panoramic picture sphere model coordinates, to obtain the target spherical patch; and
determining a target tile picture corresponding to the target spherical patch according to a corresponding relationship between the segmented panoramic tile pictures and the panoramic picture sphere model.

### Claim 5 (depends on 1)

The method of claim 1, further comprising: updating the target scene in response to detection of a movement or rotation of the current screen.

### Claim 6

An electronic device, comprising:
at least one processor; and
a memory communicatively connected with the at least one processor, wherein the memory stores instructions executable by the at least one processor, and the instructions, when executed by the at least one processor, enable the at least one processor to perform operations of:
segmenting a panoramic picture to obtain segmented panoramic tile pictures;
determining a target tile picture under a current screen and a target spherical patch in a panoramic picture sphere model, according to the panoramic picture sphere model and the segmented panoramic tile pictures; and
performing drawing on the target spherical patch by using the target tile picture, to obtain a target scene,
wherein the panoramic picture sphere model is a sphere composed of a plurality of spherical patches,
wherein the segmenting the panoramic picture to obtain the segmented panoramic tile pictures, comprises:
acquiring a reference size and a segmentation level of a single panoramic tile picture, wherein the segmentation level is a level describing a resolution of a picture; and
segmenting the panoramic picture according to the reference size and the segmentation level, to obtain the segmented panoramic tile pictures.

### Claim 7 (depends on 6)

The electronic device of claim 6, wherein the instructions,
when executed by the at least one processor, enable the at least one processor to further perform operations of:
before performing drawing on the target spherical patch by using the target tile picture, to obtain the target scene,
segmenting the panoramic picture according to a set segmentation level, to obtain a target thumbnail; and
performing drawing on all spherical patches of the panoramic picture sphere model by using the target thumbnail, to obtain a transition scene.

### Claim 8 (depends on 6)

The electronic device of claim 6, wherein the determining the target tile picture under the current screen and the target spherical patch in the panoramic picture sphere model, according to the panoramic picture sphere model and the segmented panoramic tile pictures, comprises:
acquiring a plurality of panoramic picture sphere model coordinates cones ponding to a plurality of screen boundary points of the current screen;
determining a plurality of spherical patches corresponding to the plurality of screen boundary points according to the plurality of panoramic picture sphere model coordinates, to obtain the target spherical patch; and
determining a target tile picture corresponding to the target spherical patch according to a corresponding relationship between the segmented panoramic tile pictures and the panoramic picture sphere model.

### Claim 9 (depends on 7)

The electronic device of claim 7, wherein the determining the target tile picture under the current screen and the target spherical patch in the panoramic picture sphere model, according to the panoramic picture sphere model and the segmented panoramic tile pictures, comprises:
acquiring a plurality of panoramic picture sphere model coordinates corresponding to a plurality of screen boundary points of the current screen;
determining a plurality of spherical patches corresponding to the plurality of screen boundary points according to the plurality of panoramic picture sphere model coordinates, to obtain the target spherical patch; and
determining a target tile picture corresponding to the target spherical patch according to a corresponding relationship between the segmented panoramic tile pictures and the panoramic picture sphere model.

### Claim 10 (depends on 6)

The electronic device of claim 6, wherein the instructions, when executed by the at least one processor, enable the at least one processor to further perform an operation of:
updating the target scene in response to detection of a movement or rotation of the current screen.

### Claim 11

A non-transitory computer-readable storage medium storing computer instructions, wherein the computer instructions, when executed by a computer, cause the computer to perform operations of:
segmenting a panoramic picture to obtain segmented panoramic tile pictures;
determining a target tile picture under a current screen and a target spherical patch in a panoramic picture sphere model, according to the panoramic picture sphere model and the segmented panoramic tile pictures; and
performing drawing on the target spherical patch by using the target tile picture, to obtain a target scene,
wherein the panoramic picture sphere model is a sphere composed of a plurality of spherical patches,
wherein the segmenting the panoramic picture to obtain the segmented panoramic tile pictures, comprises:
acquiring a reference size and a segmentation level of a single panoramic tile picture, wherein the segmentation level is a level describing a resolution of a picture; and
segmenting the panoramic picture according to the reference size and the segmentation level, to obtain the segmented panoramic tile pictures.

### Claim 12 (depends on 11)

The non-transitory computer-readable storage medium of claim 11, wherein the computer instructions, when executed by the computer, cause the computer to further perform operations of:
before performing drawing on the target spherical patch by using the target tile picture, to obtain the target scene,
segmenting the panoramic picture according to a set segmentation level, to obtain a target thumbnail; and
performing drawing on all spherical patches of the panoramic picture sphere model by using the target thumbnail, to obtain a transition scene.

### Claim 13 (depends on 11)

The non-transitory computer-readable storage medium of claim 11, wherein the determining the target tile picture under the current screen and the target spherical patch in the panoramic picture sphere model, according to the panoramic picture sphere model and the segmented panoramic tile pictures, comprises:
acquiring a plurality of panoramic picture sphere model coordinates corresponding to a plurality of screen boundary points of the current screen;
determining a plurality of spherical patches corresponding to the plurality of screen boundary points according to the plurality of panoramic picture sphere model coordinates, to obtain the target spherical patch; and
determining a target tile picture corresponding to the target spherical patch according to a corresponding relationship between the segmented panoramic tile pictures and the picture sphere model.

### Claim 14 (depends on 11)

The non-transitory computer-readable storage medium of claim 11, wherein the computer instructions, when executed by the computer, cause the computer to further perform an operation of:
updating the target scene in response to detection of a movement or rotation of the current screen.