# US 10,122,931 B2 · Digital viewfinder user interface for multiple cameras

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,122,931 B2
- Document ID: US10122931B2
- Status: Granted
- Kind: B2
- Application number: 15/863,369
- Filed: 2018-01-05
- Published: 2018-05-10
- Granted: 2018-11-06
- Earliest claimed: 2015-04-23
- Assignees: Apple Inc.
- Applicants: Apple Inc.
- Inventors: Jeffrey Traer Bernstein; Lukas Robert Tom Girling; Linda L. Dong; Henrique Penha; Paulo Michaelo Lopez; Behkish J. Manzari
- Web page: https://patentgrep.com/patent/US10122931B2

## CPC

- H04N 23/69: Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
- G03B 17/20: visible in viewfinder
- G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence)
- G06F 3/04883: for inputting data by handwriting, e.g. gesture or text
- H04N 13/25: using two or more image sensors with different characteristics other than in their location or field of view, e.g. having different resolutions or colour pickup characteristics; using image signals from one sensor to control the characteristics of another sensor
- H04N 23/632: {for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters}
- H04N 23/633: {for displaying additional information relating to control or operation of the camera}
- H04N 23/90: Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
- G06F 2203/04806: Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G03B: APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR (optical parts of such apparatus G02B; photosensitive materials or processes for photographic purposes G03C; apparatus for processing exposed photographic materials G03D)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

An electronic device has multiple cameras and displays a digital viewfinder user interface for previewing visual information provided by the cameras. The multiple cameras may have different properties such as focal lengths. When a single digital viewfinder is provided, the user interface allows zooming over a zoom range that includes the respective zoom ranges of both cameras. The zoom setting to determine which camera provides visual information to the viewfinder and which camera is used to capture visual information. The user interface also allows the simultaneous display of content provided by different cameras at the same time. When two digital viewfinders are provided, the user interface allows zooming, freezing, and panning of one digital viewfinder independently of the other. The device allows storing of a composite images and/or videos using both digital viewfinders and corresponding cameras.

## Claims

### Claim 1

A non-transitory computer readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device with a first camera, a second camera, and a display, the one or more programs including instructions for:
displaying, in a first portion of a display, a first digital viewfinder, the first digital viewfinder displaying content from the first camera, wherein the content from the first camera is dynamically updated based on movement of objects with respect to the first camera;
displaying, in a second portion of the display, a second digital viewfinder, the second digital viewfinder displaying content from the second camera, wherein the content from the second camera is dynamically updated based on movement of objects with respect to the second camera;
while concurrently displaying the first digital viewfinder and the second digital viewfinder:
detecting a first input representing an instruction to freeze the first digital viewfinder; and
in response to detecting the first input, freezing the first digital viewfinder independently of the second digital viewfinder; and
while the first digital viewfinder in the first portion of the display remains frozen:
continuing to display, in the second portion of the display, the second digital viewfinder, the second digital viewfinder displaying content from the second camera, wherein the content from the second camera is dynamically updated based on movement of objects with respect to the second camera.

### Claim 2 (depends on 1)

The non-transitory computer readable storage medium of claim 1,
wherein the electronic device has a touch-sensitive surface, and
wherein the first input is a tap input located on a portion of the touch-sensitive surface corresponding to the first digital viewfinder.

### Claim 3 (depends on 1)

The non-transitory computer readable storage medium of claim 1, wherein the electronic device has a touch-sensitive surface, the one or more programs further including instructions for:
detecting a second input at a location of the touch-sensitive surface corresponding to the first digital viewfinder; and
in response to detecting the second input, panning the first digital viewfinder independently of the second digital viewfinder.

### Claim 4 (depends on 1)

The non-transitory computer readable storage medium of claim 1, wherein freezing the first digital viewfinder comprises displaying in the first digital viewfinder a still image received using the first camera, the one or more programs further including instructions for:
detecting a third input; and
in response to detecting the third input, adding a combined digital image comprising the still image and a second image received from the second camera to a library of images.

### Claim 5 (depends on 4)

The non-transitory computer readable storage medium of claim 4, wherein the combined digital image is an image comprising the still image and the second image side-by-side.

### Claim 6 (depends on 1)

The non-transitory computer readable storage medium of claim 1, wherein the first camera has a first focal length and the second camera has a second focal length different from the first focal length.

### Claim 7 (depends on 1)

The non-transitory computer readable storage medium of claim 1, wherein the first camera has a fixed focal length and the second camera has a fixed focal length.

### Claim 8 (depends on 1)

The non-transitory computer readable storage medium of claim 1, wherein the first and second cameras have overlapping fields of view.

### Claim 9 (depends on 8)

The non-transitory computer readable storage medium of claim 8, wherein the fields of view of the first and second cameras overlap by at least fifty percent.

### Claim 10 (depends on 1)

The non-transitory computer readable storage medium of claim 1, wherein the electronic device has a touch-sensitive surface that forms a touch-sensitive display with the display.

### Claim 11 (depends on 1)

The non-transitory computer readable storage medium of claim 1, wherein the electronic device has a touch-sensitive surface, the one or more programs further including instructions for:
after freezing the first digital viewfinder, detecting a fourth input at a location of the touch-sensitive surface corresponding to the first digital viewfinder; and
in response to detecting the fourth input, unfreezing the first digital viewfinder and displaying content from the first camera in the first digital viewfinder.

### Claim 12

A method comprising:
at an electronic device with a first camera, a second camera, and a display:
displaying, in a first portion of a display, a first digital viewfinder, the first digital viewfinder displaying content from the first camera, wherein the content from the first camera is dynamically updated based on movement of objects with respect to the first camera;
displaying, in a second portion of the display, a second digital viewfinder, the second digital viewfinder displaying content from the second camera, wherein the content from the second camera is dynamically updated based on movement of objects with respect to the second camera;
while concurrently displaying the first digital viewfinder and the second digital viewfinder:
detecting a first input representing an instruction to freeze the first digital viewfinder; and
in response to detecting the first input, freezing the first digital viewfinder independently of the second digital viewfinder; and
while the first digital viewfinder in the first portion of the display remains frozen:
continuing to display, in the second portion of the display, the second digital viewfinder, the second digital viewfinder displaying content from the second camera, wherein the content from the second camera is dynamically updated based on movement of objects with respect to the second camera.

### Claim 13 (depends on 12)

The method of claim 12,
wherein the electronic device has a touch-sensitive surface, and
wherein the first input is a tap input located on a portion of the touch-sensitive surface corresponding to the first digital viewfinder.

### Claim 14 (depends on 12)

The method of claim 12, wherein the electronic device has a touch-sensitive surface, the method further comprising:
detecting a second input at a location of the touch-sensitive surface corresponding to the first digital viewfinder; and
in response to detecting the second input, panning the first digital viewfinder independently of the second digital viewfinder.

### Claim 15 (depends on 12)

The method of claim 12, wherein freezing the first digital viewfinder comprises displaying in the first digital viewfinder a still image received using the first camera, the method further comprising:
detecting a third input; and
in response to detecting the third input, adding a combined digital image comprising the still image and a second image received from the second camera to a library of images.

### Claim 16 (depends on 15)

The method of claim 15, wherein the combined digital image is an image comprising the still image and the second image side-by-side.

### Claim 17 (depends on 12)

The method of claim 12, wherein the first camera has a first focal length and the second camera has a second focal length different from the first focal length.

### Claim 18 (depends on 12)

The method of claim 12, wherein the first camera has a fixed focal length and the second camera has a fixed focal length.

### Claim 19 (depends on 12)

The method of claim 12, wherein the first and second cameras have overlapping fields of view.

### Claim 20 (depends on 19)

The method of claim 19, wherein the fields of view of the first and second cameras overlap by at least fifty percent.

### Claim 21 (depends on 12)

The method of claim 12, wherein the electronic device has a touch-sensitive surface that forms a touch-sensitive display with the display.

### Claim 22 (depends on 12)

The method of claim 12, wherein the electronic device has a touch-sensitive surface, the method further comprising:
after freezing the first digital viewfinder, detecting a fourth input at a location of the touch-sensitive surface corresponding to the first digital viewfinder; and
in response to detecting the fourth input, unfreezing the first digital viewfinder and displaying content from the first camera in the first digital viewfinder.

### Claim 23

An electronic device, comprising:
one or more processors;
a memory;
a first camera;
a second camera;
a display; and
computer-executable instructions, wherein the computer-executable instructions are stored in the memory and configured to be executed by the one or more processors, the computer-executable instructions including instructions for:
displaying, in a first portion of a display, a first digital viewfinder, the first digital viewfinder displaying content from the first camera, wherein the content from the first camera is dynamically updated based on movement of objects with respect to the first camera;
displaying, in a second portion of the display, a second digital viewfinder, the second digital viewfinder displaying content from the second camera, wherein the content from the second camera is dynamically updated based on movement of objects with respect to the second camera;
while concurrently displaying the first digital viewfinder and the second digital viewfinder:
detecting a first input representing an instruction to freeze the first digital viewfinder; and
in response to detecting the first input, freezing the first digital viewfinder independently of the second digital viewfinder; and
while the first digital viewfinder in the first portion of the display remains frozen:
continuing to display, in the second portion of the display, the second digital viewfinder, the second digital viewfinder displaying content from the second camera, wherein the content from the second camera is dynamically updated based on movement of objects with respect to the second camera.

### Claim 24 (depends on 23)

The electronic device of claim 23,
wherein the electronic device has a touch-sensitive surface, and
wherein the first input is a tap input located on a portion of the touch-sensitive surface corresponding to the first digital viewfinder.

### Claim 25 (depends on 23)

The electronic device of claim 23, wherein the electronic device has a touch-sensitive surface, the computer-executable instructions further including instructions for:
detecting a second input at a location of the touch-sensitive surface corresponding to the first digital viewfinder; and
in response to detecting the second input, panning the first digital viewfinder independently of the second digital viewfinder.

### Claim 26 (depends on 23)

The electronic device of claim 23, wherein freezing the first digital viewfinder comprises displaying in the first digital viewfinder a still image received using the first camera, the computer-executable instructions further including instructions for:
detecting a third input; and
in response to detecting the third input, adding a combined digital image comprising the still image and a second image received from the second camera to a library of images.

### Claim 27 (depends on 26)

The electronic device of claim 26, wherein the combined digital image is an image comprising the still image and the second image side-by-side.

### Claim 28 (depends on 23)

The electronic device of claim 23, wherein the first camera has a first focal length and the second camera has a second focal length different from the first focal length.

### Claim 29 (depends on 23)

The electronic device of claim 23, wherein the first camera has a fixed focal length and the second camera has a fixed focal length.

### Claim 30 (depends on 23)

The electronic device of claim 23, wherein the first and second cameras have overlapping fields of view.

### Claim 31 (depends on 30)

The electronic device of claim 30, wherein the fields of view of the first and second cameras overlap by at least fifty percent.

### Claim 32 (depends on 23)

The electronic device of claim 23, wherein the electronic device has a touch-sensitive surface that forms a touch-sensitive display with the display.

### Claim 33 (depends on 23)

The electronic device of claim 23, wherein the electronic device has a touch-sensitive surface, the computer-executable instructions further including instructions for:
after freezing the first digital viewfinder, detecting a fourth input at a location of the touch-sensitive surface corresponding to the first digital viewfinder; and
in response to detecting the fourth input, unfreezing the first digital viewfinder and displaying content from the first camera in the first digital viewfinder.
