# US 2024/0004171 A1 · Methods and apparatus for seamless transitions between lens projections

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0004171 A1
- Document ID: US20240004171A1
- Status: Published application
- Kind: A1
- Application number: 18/468,598
- Filed: 2023-09-15
- Published: 2024-01-04
- Earliest claimed: 2019-10-23
- Assignees: GoPro, Inc.
- Applicants: GoPro, Inc.
- Inventors: David A. Newman
- Web page: https://patentgrep.com/patent/US20240004171A1

## CPC

- G02B 13/16: for use in conjunction with image converters or intensifiers {, or for use with projectors, e.g. objectives for projection TV}
- G06T 3/12: Panospheric to cylindrical image transformations
- G02B 3/08: with discontinuous faces, e.g. Fresnel lens {(diffractive Fresnel lenses G02B5/1876)}
- G02B 13/06: Panoramic objectives; So-called "sky lenses" {including panoramic objectives having reflecting surfaces}
- H04N 23/698: for achieving an enlarged field of view, e.g. panoramic image capture
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Methods and apparatus for seamlessly transitioning between lens projections. In one exemplary embodiment, a piecewise lens projection is composed of three (3) functions: (i) a first polynomial-based lens projection, (ii) a second “joining” lens projection, and (iii) a trigonometric lens projection. The piecewise lens projection characterizes virtualized lens distortion as a function of FOV; image data can be dynamically projected based on the virtualized lens distortion, regardless of FOV. In this manner, a user may achieve the visually familiar effects associated with a first lens definition for a first FOV, while still smoothly animating transitions to other lens projections (e.g., a larger FOV using stereographic projections).

## Claims

### Claim 1

A computerized apparatus comprising:
a processor apparatus; and
a non-transitory computer-readable apparatus comprising a storage medium, the storage medium comprising a plurality of instructions configured to, when executed by the processor apparatus, cause the computerized apparatus to at least:
obtain image content;
obtain a piecewise lens projection that changes between a first lens projection, a second lens projection, and an intermediary lens projection between the first lens projection and the second lens projection as a function of a field of view associated with projection of the image content;
determine the field of view associated with the projection of the image content; and
project the image content based on the piecewise lens projection and the field of view.

### Claim 2 (depends on 1)

The computerized apparatus of claim 1, wherein:
the first lens projection is used for a first range of the field of view;
the second lens projection is used for a second range of the field of view; and
the intermediary lens projection is used for a third range of the field of view, the third range of the field of view between the first range of the field of view and the second range of the field of view.

### Claim 3 (depends on 2)

The computerized apparatus of claim 2, wherein:
the first lens projection is a polynomial-based lens projection;
the second lens projection is a trigonometric lens projection; and
the intermediary lens projection enables transition between the polynomial-based lens projection and the trigonometric lens projection.

### Claim 4 (depends on 2)

The computerized apparatus of claim 2, wherein the piecewise lens projection determines distortion of the image content based on the field of view.

### Claim 5 (depends on 4)

The computerized apparatus of claim 4, wherein the piecewise lens projection defines a virtual lens behavior as the function of the field of view.

### Claim 6 (depends on 4)

The computerized apparatus of claim 4, wherein the field of view is dynamically modified.

### Claim 7 (depends on 1)

The computerized apparatus of claim 1, wherein the projected image content is displayed via a mobile device user interface.

### Claim 8 (depends on 7)

The computerized apparatus of claim 7, wherein the image content includes spherical image content.

### Claim 9 (depends on 7)

The computerized apparatus of claim 7, wherein the image content includes a panoramic image.

### Claim 10

A method for seamlessly transitioning between lens projections, the method comprising:
obtaining image content;
obtaining a piecewise lens projection that changes between a first lens projection, a second lens projection, and an intermediary lens projection between the first lens projection and the second lens projection as a function of a field of view associated with projection of the image content;
determining the field of view associated with the projection of the image content; and
projecting the image content based on the piecewise lens projection and the field of view.

### Claim 11 (depends on 10)

The method of claim 10, wherein:
the first lens projection is used for a first range of the field of view;
the second lens projection is used for a second range of the field of view; and
the intermediary lens projection is used for a third range of the field of view, the third range of the field of view between the first range of the field of view and the second range of the field of view.

### Claim 12 (depends on 11)

The method of claim 11, wherein:
the first lens projection is a polynomial-based lens projection;
the second lens projection is a trigonometric lens projection; and
the intermediary lens projection enables transition between the polynomial-based lens projection and the trigonometric lens projection.

### Claim 13 (depends on 11)

The method of claim 11, wherein the piecewise lens projection determines distortion of the image content based on the field of view.

### Claim 14 (depends on 13)

The method of claim 13, wherein the piecewise lens projection defines a virtual lens behavior as the function of the field of view.

### Claim 15 (depends on 13)

The method of claim 13, wherein the field of view is dynamically modified.

### Claim 16 (depends on 10)

The method of claim 10, wherein the projected image content is displayed via a mobile device user interface.

### Claim 17 (depends on 16)

The method of claim 16, wherein the image content includes spherical image content.

### Claim 18 (depends on 16)

The method of claim 16, wherein the image content includes a panoramic image.

### Claim 19

A computerized apparatus comprising:
a processor apparatus; and
a non-transitory computer-readable apparatus comprising a storage medium, the storage medium comprising a plurality of instructions configured to, when executed by the processor apparatus, cause the computerized apparatus to at least:
obtain image content;
obtain a piecewise lens projection that changes between a polynomial-based lens projection, a trigonometric lens projection, and an intermediary lens projection between the polynomial-based lens projection and the trigonometric lens projection as a function of a field of view associated with projection of the image content, the intermediary lens projection enabling transition between the polynomial-based lens projection and the trigonometric lens projection;
determine the field of view associated with the projection of the image content; and
project the image content based on the piecewise lens projection and the field of view, wherein the polynomial-based lens projection is used for a first range of the field of view, the trigonometric lens projection is used for a second range of the field of view, and the intermediary lens projection is used for a third range of the field of view, the third range of the field of view between the first range of the field of view and the second range of the field of view.

### Claim 20 (depends on 19)

The computerized apparatus of claim 19, wherein:
the piecewise lens projection determines distortion of the image content based on the field of view; and
the piecewise lens projection defines a virtual lens behavior as the function of the field of view.
