# US 2026/0245292 A1 · Apparatus for generating 360-degree panoramic image and method thereof

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0245292 A1
- Document ID: US20260245292A1
- Status: Published application
- Kind: A1
- Application number: 19/449,529
- Filed: 2026-01-15
- Published: 2026-08-20
- Earliest claimed: 2025-02-14
- Assignees: Bucketplace Co., Ltd.
- Applicants: Bucketplace Co., Ltd.
- Inventors: Hyo Won HA; Jae Heung SURH; Hyun Su KIM
- Web page: https://patentgrep.com/patent/US20260245292A1

## CPC

- G06T 3/4038: Image mosaicing, e.g. composing plane images from plane sub-images
- G06T 15/20: Perspective computation
- G06T 3/16: Spatio-temporal transformations, e.g. video cubism
- G06T 3/20: Linear translation of whole images or parts thereof, e.g. panning
- G06T 3/60: Rotation of whole images or parts thereof
- G06T 5/77: Retouching; Inpainting; Scratch removal
- G06T 5/80: Geometric correction
- G06T 7/30: Determination of transform parameters for the alignment of images, i.e. image registration
- G06T 7/80: Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
- G06T 7/90: Determination of colour characteristics
- G06T 15/04: Texture mapping
- G06T 17/00: Three-dimensional [3D] modelling for computer graphics
- G06T 2207/10024: Color image
- G06T 2207/10028: Range image; Depth image; 3D point clouds
- G06T 2207/20081: Training; Learning
- G06T 2210/04: Architectural design, interior design
- G06T 2215/16: Using real world measurements to influence rendering
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Disclosed are an apparatus for generating a 360-degree panoramic image and a method thereof. More particularly, an apparatus for generating a 360-degree panoramic image according to an embodiment of the present disclosure includes: a depth data processor configured to process resolution-related sampling using a color image for depth data of images acquired from a single camera stream through a camera, and construct a depth map based on a deep learning model; an error correction processor configured to determine a virtual panoramic viewpoint considering different camera poses of the images, splat the images into a panoramic image space based on the depth map of each of the images, derive a Global Color Correction (GCC) parameter, related to color value correction of the splatted images, and a residual pose parameter related to a pose variation amount, and correct the GCC parameter and the residual pose parameter by calculating at least one loss function for the splatted images; and a panorama processor configured to re-splat images, to which corrected GCC parameter and the corrected residual pose parameter are applied, into the panoramic image space; stitch the re-splatted images, perform local color correction on overlapping regions in the stitched images, and perform seam blending to generate a panoramic image.

## Claims

### Claim 1

An apparatus for generating a 360-degree panoramic image, the apparatus comprising:
a depth data processor configured to process resolution-related sampling using a color image for depth data of images acquired from a single camera stream through a camera, and construct a depth map based on a deep learning model;
an error correction processor configured to determine a virtual panoramic viewpoint considering different camera poses of the images, splat the images into a panoramic image space based on the depth map of each of the images, derive a Global Color Correction (GCC) parameter, related to color value correction of the splatted images, and a residual pose parameter related to a pose variation amount, and correct the GCC parameter and the residual pose parameter by calculating at least one loss function for the splatted images; and
a panorama processor configured to re-splat images, to which corrected GCC parameter and the corrected residual pose parameter are applied, into the panoramic image space; stitch the re-splatted images, perform local color correction on overlapping regions in the stitched images, and perform seam blending to generate a panoramic image.

### Claim 2 (depends on 1)

The apparatus according to claim 1, wherein the error correction processor back-projects a pixel of each of the images into a 3D point based on the depth map, transforms the 3D point from an image coordinate system to a world coordinate system and from the world coordinate system to a panoramic coordinate system, projects the 3D point into the panoramic image space to calculate coordinates, maps the pixel to a panorama pixel, and splats the images into the panoramic image space based on the calculated pixel mapping.

### Claim 3 (depends on 1)

The apparatus according to claim 1, wherein the error correction processor calculates at least one loss function among a photometric consistency loss, a gradient consistency loss, a depth consistency loss, and a feature anchoring loss in relation to the GCC parameter with respect to the splatted images, and calculates at least one loss function among a rotation regularizer loss, a translation regularizer loss, and a GCC regularizer loss in relation to the residual pose parameter.

### Claim 4 (depends on 3)

The apparatus according to claim 3, wherein the error correction processor calculates a total loss based on a sum of the at least one loss function, and corrects the GCC parameter and the residual pose parameter by setting a weight for each of the at least one loss function such that the calculated total loss is minimized.

### Claim 5 (depends on 3)

The apparatus according to claim 3, wherein the error correction processor calculates the photometric consistency loss based on a sum of losses relative to individual color values after calculating an average color value for all pixels where the splatted images overlap each other on the panoramic image space; calculates the gradient consistency loss based on a sum of losses relative to individual gradient values after deriving gradient images for the images to splat the gradient images, and then calculating an average gradient value for all pixels overlapping each other; calculates the depth consistency loss based on a sum of losses relative to individual values after calculating an average depth value using a reciprocal of a distance calculated when projecting back-projected 3D points into the panoramic image space; and calculates the feature anchoring loss based on feature extraction and matching.

### Claim 6 (depends on 3)

The apparatus according to claim 3, wherein the error correction processor calculates the rotation regularizer loss based on a sum of losses between a rotation matrix of a residual pose of each of the images and an identity matrix; calculates the translation regularizer loss based on a sum of losses between a translation vector of the residual pose of each of the images and a zero vector; and calculates the GCC regularizer loss based on a sum of losses between a color correction matrix of each of the images and a truncated identity matrix.

### Claim 7 (depends on 1)

The apparatus according to claim 1, wherein the panorama processor derives a pixel value for the splatted images, measures a depth of 3D points for the derived pixel value, selects images to be used for the generated panoramic image from among the splatted images based on the measured depth, and performs the local color correction to correct a color difference for an overlapping area in the selected images.

### Claim 8 (depends on 1)

The apparatus according to claim 1, wherein the panorama processor performs the seam blending to correct a color difference for a boundary part within the generated panoramic image by correcting a color, which has been corrected after the local color correction, using a residual color related to a gradient of the image.

### Claim 9 (depends on 1)

The apparatus according to claim 1, further comprising an application processor configured to select at least one object in the panoramic image, delete the selected at least one object to process it into an Augmented Reality (AR) plane, and restore the processed AR plane into the panoramic image.

### Claim 10 (depends on 9)

The apparatus according to claim 9, wherein the application processor performs processing into the AR plane by performing orthographic projection of a texture of the panoramic image onto each plane and then performing inpainting on a part detected as a foreground area in each plane.

### Claim 11

A method of generating a 360-degree panoramic image, the method comprising:
by a depth data processor, processing resolution-related sampling using a color image for depth data of images acquired from a single camera stream through a camera, and constructing a depth map based on a deep learning model;
by an error correction processor, determining a virtual panoramic viewpoint considering different camera poses of the images, splatting the images into a panoramic image space based on the depth map of each of the images, deriving a Global Color Correction (GCC) parameter, related to color value correction of the splatted images, and a residual pose parameter related to a pose variation amount, and correcting the GCC parameter and the residual pose parameter by calculating at least one loss function for the splatted images; and
by a panorama processor, re-splatting images, to which corrected GCC parameter and the corrected residual pose parameter are applied, into the panoramic image space; stitching the re-splatted images, performing local color correction on overlapping regions in the stitched images, and performing seam blending to generate a panoramic image.

### Claim 12 (depends on 11)

The method according to claim 11, wherein the determining of a virtual panoramic viewpoint considering different camera poses of the images, the splatting of the images into a panoramic image space based on the depth map of each of the images, the deriving of a Global Color Correction (GCC) parameter, related to color value correction of the splatted images, and a residual pose parameter related to a pose variation amount, and the correcting of the GCC parameter and the residual pose parameter by calculating at least one loss function for the splatted images, by the error correction processor comprise:
back-projecting a pixel of each of the images into a 3D point based on the depth map, transforming the 3D point from an image coordinate system to a world coordinate system and from the world coordinate system to a panoramic coordinate system, projecting the 3D point into the panoramic image space to calculate coordinates to map the pixel to a panorama pixel, and splatting the images into the panoramic image space based on the calculated pixel mapping;
calculating at least one loss function among a photometric consistency loss, a gradient consistency loss, a depth consistency loss, and a feature anchoring loss in relation to the GCC parameter with respect to the splatted images, and calculating at least one loss function among a rotation regularizer loss, a translation regularizer loss, and a GCC regularizer loss in relation to the residual pose parameter; and
calculating a total loss based on a sum of the at least one loss function, and correcting the GCC parameter and the residual pose parameter by setting a weight for each of the at least one loss function such that the calculated total loss is minimized.

### Claim 13 (depends on 12)

The method according to claim 12, wherein the calculating of at least one loss function among a photometric consistency loss, a gradient consistency loss, a depth consistency loss, and a feature anchoring loss in relation to the GCC parameter with respect to the splatted images, and the calculating of at least one loss function among a rotation regularizer loss, a translation regularizer loss, and a GCC regularizer loss in relation to the residual pose parameter comprise:
calculating the photometric consistency loss based on a sum of losses relative to individual color values after calculating an average color value for all pixels where the splatted images overlap each other on the panoramic image space;
calculating the gradient consistency loss based on a sum of losses relative to individual gradient values after deriving gradient images for the images to splat the gradient images, and then calculating an average gradient value for all pixels overlapping each other;
calculating the depth consistency loss based on a sum of losses relative to individual values after calculating an average depth value using a reciprocal of a distance calculated when projecting back-projected 3D points into the panoramic image space; and
calculating the feature anchoring loss based on feature extraction and matching.

### Claim 14 (depends on 12)

The method according to claim 12, wherein the calculating of at least one loss function among a photometric consistency loss, a gradient consistency loss, a depth consistency loss, and a feature anchoring loss in relation to the GCC parameter with respect to the splatted images, and the calculating of at least one loss function among a rotation regularizer loss, a translation regularizer loss, and a GCC regularizer loss in relation to the residual pose parameter comprise:
calculating the rotation regularizer loss based on a sum of losses between a rotation matrix of a residual pose of each of the images and an identity matrix;
calculating the translation regularizer loss based on a sum of losses between a translation vector of a residual pose of each of the images and a zero vector; and
calculating the GCC regularizer loss based on a sum of losses between a color correction matrix of each of the images and a truncated identity matrix.

### Claim 15 (depends on 11)

The method according to claim 11, wherein the re-splatting of images, to which corrected GCC parameter and the corrected residual pose parameter are applied, into the panoramic image space; the stitching of the re-splatted images, the performing of local color correction on overlapping regions in the stitched images, and the performing of seam blending to generate a panoramic image comprises:
deriving a pixel value for the splatted images, measuring a depth of 3D points for the derived pixel value, selecting images, to be used for the generated panoramic image, from among the splatted images based on the measured depth, and performing the local color correction to correct a color difference for an overlapping area in the selected images; and
performing the seam blending to correct a color difference for a boundary part within the generated panoramic image by correcting a color, which has been corrected after the local color correction, using a residual color related to a gradient of the image.

### Claim 16 (depends on 11)

The method according to claim 11, further comprising: selecting, by an application processor, at least one object in the panoramic image, deleting the selected at least one object to process it into an Augmented Reality (AR) plane, and restoring the processed AR plane into the panoramic image.
