# US 2005/0089244 A1 · Panoramic maker engine for a low profile system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2005/0089244 A1
- Document ID: US20050089244A1
- Status: Published application
- Kind: A1
- Application number: 10/692,446
- Filed: 2003-10-22
- Published: 2005-04-28
- Earliest claimed: 2003-10-22
- Assignees: ArcSoft, Inc.
- Inventors: Yiqing Jin; Yushan Huang; Donghui Wu; Linxiang Zhou
- Web page: https://patentgrep.com/patent/US20050089244A1

## CPC

- G06T 3/4038: Image mosaicing, e.g. composing plane images from plane sub-images
- G06T 7/30: Determination of transform parameters for the alignment of images, i.e. image registration
- G06T 11/00: Two-dimensional [2D] image generation
- G06V 10/147: Details of sensors, e.g. sensor lenses (fingerprint or palmprint sensors G06V40/13; vascular sensors G06V40/145; eye sensors G06V40/19)
- H04N 1/3876: {Recombination of partial images to recreate the original image}
- G06V 10/16: {using multiple overlapping images; Image stitching}
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A method for generating a panoramic image includes receiving a first image, dividing the first image into a first portion and a second portion, rotating the first portion of the first image, saving the rotated first portion of the first image in a nonvolatile memory, receiving a second image, dividing the second image into a third portion and a fourth portion, matching an overlapping region between the second portion of the first image and the third portion of the second image, stitching the second portion of the first image and the third portion of the second image to form a first stitched image, rotating the first stitched image, and saving the first stitched image in the nonvolatile memory.

## Claims

### Claim 1

A method for generating a panoramic image, comprising:
receiving a first image;
dividing the first image into a first portion and a second portion;
rotating the first portion of the first image;
saving the rotated first portion of the first image in a nonvolatile memory;
receiving a second image;
dividing the second image into a third portion and a fourth portion;
matching an overlapping region between the second portion of the first image and the third portion of the second image;
stitching the second portion of the first image and the third portion of the second image to form a first stitched image;
rotating the first stitched image; and
saving the first stitched image in the nonvolatile memory.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
after said receiving a first image and prior to said dividing the first image, projecting the first image onto a cylinder to warp the first image; and
after said receiving a second image and prior to said dividing the second image, projecting the second image onto the cylinder to warp the second image.

### Claim 3 (depends on 2)

The method of claim 2, wherein said projecting the first image onto a cylinder and said projecting the second image onto the cylinder comprises calculating coordinates of points on the cylinder as follows:
x
′
=
f
⁢
⁢
arctan
⁢
⁢
x
f
;
and
y
′
=
y
⁢
⁢
sec
⁢
⁢
x
′
f
;
wherein x′ and y′ are the coordinates of each point on the cylinder, x and y are the coordinates of each points on the first image and the second image, and f is the focus length of the camera.

### Claim 4 (depends on 1)

The method of claim 1, wherein said matching the second portion of the first image and the third portion of the second image comprises matching shared features between the second portion of the first image and a sub-portion of the third portion of the second image.

### Claim 5 (depends on 4)

The method of claim 4, wherein matching shared features between the second portion of the first image and a sub-portion of the third portion of the second image comprises:
generating a first level of the second portion of the first image at a first resolution;
generating a second level of the third portion of the second image at the first resolution;
selecting at least a first feature on the first level of the first image;
searching the second level of the second image for the first feature; and
matching the first feature between the first layer of the first image and the second layer of the second image to determine a first relative motion between the first image and the second image.

### Claim 6 (depends on 5)

The method of claim 5, wherein matching shared features between the second portion of the first image and a portion of the third portion of the second image further comprises:
matching pixels in the second portion of the first image and the third portion of the second image based on the first relative motion between the first image and the second image.

### Claim 7 (depends on 5)

The method of claim 5, wherein matching shared features between the second portion of the first image and a portion of the third portion of the second image further comprises:
generating a third level of the second portion of the first image at a second resolution that is greater than the first resolution;
generating a fourth level of the third portion of the second image at the second resolution;
selecting at least a second feature on the third level of the first image;
searching an area on the fourth level of the second image for the second feature, wherein the area is selected based on the relative motion between the first image and the second image;
matching the second feature between the third level and the fourth level to determine a second relative motion between the first image and the second image; and
matching pixels in the second portion of the first image and the third portion of the second image based on the second relative motion between the first image and the second image.

### Claim 8 (depends on 1)

The method of claim 1, wherein said stitching the second portion of the first image and the third portion of the second image comprises:
determining a minimum color difference path in the overlapping region;
filling a first side of the minimum color difference path with color values from the first image; and
filling a second side of the minimum color difference path with color values from the second image.

### Claim 9 (depends on 8)

The method of claim 8, further comprising blending the overlapping region if a color difference between the first side and the second side of a scan line is less than a threshold, comprising:
blending the color values of the first image and the second image along a blending width of the minimum color difference path.

### Claim 10 (depends on 9)

The method of claim 9, wherein said blending the color values of the first image and the second image comprises:
adjusting the color values of the first image and the second image along the blending width using a value C(x) defined by:
C
⁡
(
x
)
=
d
ij
2
×
(
1
-
x
W
/
2
)
,
where C(x) is the color value to be added to or subtracted from a pixel located x away from pixel (i,j) on the minimum color difference path, dij is the color difference of pixel (i,j), and W is the blending width.

### Claim 11 (depends on 10)

The method of claim 10, wherein the value C(x) is (1) added to the color values of the first image and subtracted from the second image or (2) subtracted from the color values of the first image and added to the second image.

### Claim 12 (depends on 10)

The method of claim 10, wherein the width is the largest integer 2n that is less than the width of the second portion of the first image and division operations in calculating the parameter C(x) comprises shift operations.

### Claim 13 (depends on 1)

The method of claim 1, further comprising:
receiving a third image;
dividing the third image into a fifth portion and a sixth portion;
matching the fourth portion of the second image and the fifth portion of the third image;
stitching the fourth portion of the second image and the fifth portion of the third image to form a second stitched image;
rotating the second stitched image; and
saving the second stitched image in the nonvolatile memory.
