# US 2023/0412755 A1 · Image stitching in the presence of a full field of view reference image

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0412755 A1
- Document ID: US20230412755A1
- Status: Published application
- Kind: A1
- Application number: 18/366,849
- Filed: 2023-08-08
- Published: 2023-12-21
- Earliest claimed: 2020-05-17
- Assignees: Corephotonics Ltd.
- Applicants: Corephotonics Ltd.
- Inventors: Paz Ilan; Shai Vaisman; Ruthy Katz; Adi Teitel; Hagai Tzafrir; Gal Shabtay; Oded Gigushinski; Itamar Azoulai
- Web page: https://patentgrep.com/patent/US20230412755A1

## CPC

- H04N 5/2628: {Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation}
- G03B 37/04: with cameras or projectors providing touching or overlapping fields of view
- G06T 3/4038: Image mosaicing, e.g. composing plane images from plane sub-images
- H04N 5/2625: {for obtaining an image which is composed of images from a temporal image sequence, e.g. for a stroboscopic effect (sequence generated by event triggered capturing H04N7/188)}
- H04N 5/265: Mixing
- H04N 23/10: for generating image signals from different wavelengths
- H04N 23/69: Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
- H04N 23/698: for achieving an enlarged field of view, e.g. panoramic image capture
- H04N 23/81: for suppressing or minimising disturbance in the image signal generation
- H04N 23/90: Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
- H04N 23/951: by using two or more images to influence resolution, frame rate or aspect ratio
- G02B 13/02: Telephoto objectives, i.e. systems of the type + - in which the distance from the front vertex to the image plane is less than the equivalent focal length
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G03B: APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR (optical parts of such apparatus G02B; photosensitive materials or processes for photographic purposes G03C; apparatus for processing exposed photographic materials G03D)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS

## Abstract

Systems and methods for obtaining a seamless, high resolution, large field of view image comprise capturing a plurality of Tele images in a scene using a scanning Tele camera, each captured Tele image having an associated Tele field of view FOVT, retrieving a R image having a respective R image scene with a field of view greater than FOVT, analyzing the R image for defining an order of scanning positions according to which the folded Tele camera scans a scene to capture the plurality of Tele images, aligning the plurality of Tele images and the R image to obtain aligned Tele images, and composing the aligned Tele images into an output image. The output image may include at least parts of the R image and may be one of a stream of output images.

## Claims

### Claim 1

A method, comprising:
providing a folded Tele camera configured to scan and capture a plurality of Tele images, each captured Tele image having a Tele image resolution (REST), a Tele image signal-to-noise-ratio (SNRT) and a Tele field of view (FOVT);
obtaining and analyzing a reference (R) image with a R field of view FOVR>FOVT having a R image resolution RESR<REST, and/or a R signal-to-noise-ratio SNRR<SNRT;
determining an order of one or more scanning FOVT positions for consecutive captures of the Tele images;
capturing a Tele image at each respective scanning FOVT position;
immediately after the capture of a Tele image and prior to the capture of an immediately following Tele image at each respective scanning FOVT position aligning each captured Tele image with the R image to obtain aligned Tele images,
analyzing each Tele captured image for faults, and if faults are detected in the captured Tele image, re-capturing the Tele image at a same FOVT position, or, if faults are not detected in the Tele image, proceeding to capture an immediately following Tele image at a respective FOVT position; and
using the aligned Tele images and the R image to create a new image having a field of view FOVN≤FOVR and FOVN>FOVT, wherein the image resolution of the new image RESN>RESR and/or wherein the SNR of the new image SNRN>SNRR.

### Claim 2 (depends on 1)

The method of claim 1, wherein the R image is a Wide image having a FOVW>FOVT, and wherein the Wide image is captured by a Wide camera included a multi-camera together with the folded Tele camera.

### Claim 3 (depends on 1)

The method of claim 1, wherein the new image is a super image.

### Claim 4 (depends on 1)

The method of claim 1, wherein the new image is a super wide image having a field of view FOVSW and wherein a FOV segment within FOVR included in at least one FOVT of the captured Tele images has a field-of-view union-FOVT, and wherein union-FOVT<FOVSW≤FOVR.

### Claim 5 (depends on 1)

The method of claim 1, wherein the faults are selected from the group consisting of motion blur, electronic noise, rolling shutter, defocus blur and incorrect image alignment or obstructions.

### Claim 6 (depends on 1)

The method of claim 1, wherein the faults are mechanical faults.

### Claim 7 (depends on 1)

The method of claim 1, further comprising, by a user or an algorithm, selecting a size of FOVN and a position of FOVN within a scene included in FOVR.

### Claim 8 (depends on 1)

The method of claim 1, wherein the Tele camera has an effective focal length of 7-40 mm.

### Claim 9 (depends on 1)

The method of claim 1, wherein the determining an order of one or more scanning FOVT positions includes determining the order so that the d new image covers a maximal FOV according to a mechanical limitation of the scanning.

### Claim 10 (depends on 1)

The method of claim 1, wherein the determining an order of one or more scanning FOVT positions includes determining the order so that the new image covers a region of interest defined by an algorithm.

### Claim 11 (depends on 1)

The method of claim 1, wherein the determining an order of one or more scanning FOVT positions includes determining the order so that the capturing of the Tele image at each respective scanning FOVT position includes capturing first moving objects, and then stationary objects in the captured Tele image.

### Claim 12 (depends on 1)

The method of claim 1, wherein the determining an order of one or more FOVT positions so includes determining the order such that the capturing of the Tele image at each respective scanning FOVT position includes capturing a minimal number of Tele images.

### Claim 13 (depends on 1)

The method of claim 1, wherein the determining an order of one or more scanning FOVT positions includes determining an order to follow a moving object with an object tracker.

### Claim 14 (depends on 1)

The method of claim 1, performed by a smartphone.

### Claim 15

A method, comprising:
providing a folded Tele camera configured to scan and capture a plurality of Tele images, each captured Tele image having a Tele image resolution (REST), a Tele image signal-to-noise-ratio (SNRT) and a Tele field of view (FOVT);
obtaining and analyzing a reference (R) image with a R field of view FOVR>FOVT having a R image resolution RESR<REST, and/or a R signal-to-noise-ratio SNRR<SNRT;
determining an order of one or more scanning FOVT positions for consecutive captures of the Tele images so that the new image covers a region of interest selected by a user;
capturing a Tele image at each respective scanning FOVT position;
aligning the captured Tele images with segments of the R image to obtain aligned Tele images;
using the aligned Tele images and the R image to create a new image having a field of view FOVN≤FOVR and FOVN>FOVT, wherein the image resolution of the new image fulfills RESN>RESR and/or wherein the SNR of the new image fulfills SNRN>SNRR.

### Claim 16 (depends on 15)

The method of claim 15, wherein the R image is a Wide image having a FOVW, the Wide image captured by a Wide camera included a multi-camera together with the folded Tele camera.

### Claim 17 (depends on 15)

The method of claim 15, wherein the new image is a super image.

### Claim 18 (depends on 15)

The method of claim 15, wherein the new image is having a field of view FOVSW, and wherein a FOV segment within FOVR included in at least one FOVT of the captured Tele images has a field-of-view union-FOVT, and wherein union-FOVT<FOVSW≤FOVR.

### Claim 19 (depends on 15)

The method of claim 15, wherein a user or an algorithm selects a size of FOVN and a position of FOVN within a scene included in FOVR.

### Claim 20 (depends on 15)

The method of claim 15, wherein the Tele camera has an effective focal length of 7-40 mm.

### Claim 21 (depends on 15)

The method of claim 15, performed by a smartphone.
