# US 12,192,617 B2 · User interfaces for capturing and managing visual media

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,192,617 B2
- Document ID: US12192617B2
- Status: Granted
- Kind: B2
- Application number: 18/196,997
- Filed: 2023-05-12
- Published: 2023-10-05
- Granted: 2025-01-07
- Earliest claimed: 2019-05-06
- Assignees: Apple Inc.
- Applicants: Apple Inc.
- Inventors: Johnnie B. Manzari; Alan C. Dye; Martha E. Hankey; Grant R. Paul; William A. Sorrentino, III; Andre Souza Dos Santos
- Web page: https://patentgrep.com/patent/US12192617B2

## CPC

- H04N 23/632: {for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters}
- H04N 23/633: {for displaying additional information relating to control or operation of the camera}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Media user interfaces are described, including user interfaces for capturing media (e.g., capturing a photo, recording a video), displaying media (e.g., displaying a photo, playing a video), editing media (e.g., modifying a photo, modifying a video), accessing media controls or settings (e.g., accessing controls or settings to capture photos or videos to capture videos), automatically adjusting media (e.g., automatically modifying a photo, automatically modifying a video), and automatically managing a media capture mode (e.g., a photo media capturing mode, a portrait media capturing mode, a video media capturing mode) based on a set of conditions.

## Claims

### Claim 1

An electronic device, comprising:
a display device;
one or more cameras;
one or more processors; and
memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for:
receiving a request to display a camera user interface;
in response to receiving the request to display the camera user interface and in accordance with a determination that respective criteria are not satisfied:
displaying, via the display device, the camera user interface, the camera user interface including:
a first region, the first region including a representation of a first portion of a field-of-view of the one or more cameras; and
a second region, the second region including a representation of a second portion of the field-of-view of the one or more cameras, wherein the second portion of the field-of-view of the one or more cameras is visually distinguished from the first portion;
while the camera user interface is displayed, detecting an input corresponding to a request to capture media with the one or more cameras;
in response to detecting the input corresponding to the request to capture media with the one or more cameras, capturing, with the one or more cameras, a media item that includes visual content corresponding to the first portion of the field-of-view of the one or more cameras and visual content corresponding to the second portion of the field-of-view of the one or more cameras;
after capturing the media item, receiving a request to display the media item; and
in response to receiving the request to display the media item, displaying a first representation of the visual content corresponding to the first portion of the field-of-view of the one or more cameras without displaying a representation of at least a portion of the visual content corresponding to the second portion of the field-of-view of the one or more cameras.

### Claim 2 (depends on 1)

The electronic device of claim 1, the one or more programs further including instructions for:
while displaying the first representation of the visual content, detecting a set of one or more inputs corresponding to a request to modify the representation of the visual content; and
in response to detecting the set of one or more inputs, displaying a second representation of the visual content, wherein the second representation of the visual content includes visual content from at least a portion of the first portion of the field-of-view of the one or more cameras and visual content based on at least a portion of the visual content from the second portion of the field-of-view of the one or more cameras that was not included in the first representation of the visual content.

### Claim 3 (depends on 2)

The electronic device of claim 2, wherein:
the first representation of the visual content is a representation from a first visual perspective; and
the second representation of the visual content is a representation from a second visual perspective different from the first visual perspective that was generated based on the at least a portion of the visual content from the second portion of the field-of-view of the one or more cameras that was not included in the first representation of the visual content.

### Claim 4 (depends on 2)

The electronic device of claim 2, wherein:
the first representation of the visual content is a representation in a first orientation; and
the second representation of the visual content is a representation in a second orientation different from the first orientation that was generated based on the at least a portion of the visual content from the second portion of the field-of-view of the one or more cameras that was not included in the first representation of the visual content.

### Claim 5 (depends on 2)

The electronic device of claim 2, wherein the representation of the first portion of the field-of-view of the one or more cameras is displayed at a first zoom level, the one or more programs further including instructions for:
the first representation of the visual content is a representation at the first zoom level; and
the second representation of the visual content is a representation at a second zoom level different from the first zoom level that was generated based on the at least a portion of the visual content from the second portion of the field-of-view of the one or more cameras that was not included in the first representation of the visual content.

### Claim 6 (depends on 1)

The electronic device of claim 1, wherein the first representation of the visual content is generated based at least in part on a digital image stabilization operation using at least a second portion of the visual content from the second portion of the field-of-view of the one or more cameras.

### Claim 7 (depends on 1)

The electronic device of claim 1, the one or more programs further including instructions for:
after capturing the media item, performing an object tracking operation using at least a third portion of the visual content from the second portion of the field-of-view of the one or more cameras.

### Claim 8 (depends on 1)

The electronic device of claim 1, wherein the request to display the media item is a first request to display the media item, the one or more programs further including instructions for:
after displaying the first representation of the visual content corresponding to the first portion of the field-of-view of the one or more cameras without displaying the representation of at least a portion of the visual content corresponding to the second portion of the field-of-view of the one or more cameras, receiving a second request to display the media item; and
in response to receiving the second request to display the media item, displaying the first representation of the visual content corresponding to the first portion of the field-of-view of the one or more cameras and the representation of the visual content corresponding to the second portion of the field-of-view of the one or more cameras.

### Claim 9 (depends on 1)

The electronic device of claim 1, the one or more programs further including instructions for:
in response to receiving the request to display the camera user interface and in accordance with a determination that the respective criteria are satisfied, displaying, via the display device, a second camera user interface, the second camera user interface the including the representation of the first portion of the field-of-view of the one or more cameras without including the representation of the second portion of the field-of-view of the one or more cameras.

### Claim 10 (depends on 9)

The electronic device of claim 9, the one or more programs further including instructions for:
receiving a request to display a previously captured media item; and
in response to receiving the request to display the previously captured media item:
in accordance with a determination that the previously captured media item was captured when the respective criteria were not satisfied, displaying an indication of additional content; and
in accordance with a determination that the previously captured media item was captured when the respective criteria was satisfied, forgoing display of the indication of additional content.

### Claim 11 (depends on 9)

The electronic device of claim 9, wherein the respective criteria includes a criterion that is satisfied when the electronic device is configured to capture a media item with a resolution of four thousand horizontal pixels or greater.

### Claim 12 (depends on 9)

The electronic device of claim 9, wherein the respective criteria includes a criterion that is satisfied when the electronic device is configured to operate in a portrait mode at a predetermined zoom level.

### Claim 13 (depends on 9)

The electronic device of claim 9, wherein the respective criteria include a criterion that is satisfied when at least one camera of the one or more cameras cannot maintain a focus for a predetermined period of time.

### Claim 14 (depends on 1)

The electronic device of claim 1, wherein:
the input corresponding to the request to capture media with the one or more cameras is a first input corresponding to the request to capture media with the one or more cameras; and
the one or more programs further include instructions for:
while the camera user interface is displayed, detecting a second input corresponding to a request to capture media with the one or more cameras; and
in response to detecting the second input corresponding to the request to capture media with the one or more cameras:
in accordance with a determination that the electronic device is configured to capture visual content corresponding to the second portion of the field-of-view of the one or more cameras based on an additional content setting:
capturing the first representation of the visual content corresponding to the first portion of the field-of-view of the one or more cameras and capturing the representation of at least the portion of the visual content corresponding to the second portion of the field-of-view of the one or more cameras; and
in accordance with a determination that the electronic device is not configured to capture visual content corresponding to the second portion of the field-of-view of the one or more cameras based on the additional content setting:
capturing the first representation of the visual content corresponding to the first portion of the field-of-view of the one or more cameras without capturing the representation of at least the portion of the visual content corresponding to the second portion of the field-of-view of the one or more cameras.

### Claim 15

A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device with a display device and one or more cameras, the one or more programs including instructions for:
receiving a request to display a camera user interface;
in response to receiving the request to display the camera user interface and in accordance with a determination that respective criteria are not satisfied:
displaying, via the display device, the camera user interface, the camera user interface including:
a first region, the first region including a representation of a first portion of a field-of-view of the one or more cameras; and
a second region, the second region including a representation of a second portion of the field-of-view of the one or more cameras, wherein the second portion of the field-of-view of the one or more cameras is visually distinguished from the first portion;
while the camera user interface is displayed, detecting an input corresponding to a request to capture media with the one or more cameras;
in response to detecting the input corresponding to the request to capture media with the one or more cameras, capturing, with the one or more cameras, a media item that includes visual content corresponding to the first portion of the field-of-view of the one or more cameras and visual content corresponding to the second portion of the field-of-view of the one or more cameras;
after capturing the media item, receiving a request to display the media item; and
in response to receiving the request to display the media item, displaying a first representation of the visual content corresponding to the first portion of the field-of-view of the one or more cameras without displaying a representation of at least a portion of the visual content corresponding to the second portion of the field-of-view of the one or more cameras.

### Claim 16 (depends on 15)

The non-transitory computer-readable storage medium of claim 15, the one or more programs further including instructions for:
while displaying the first representation of the visual content, detecting a set of one or more inputs corresponding to a request to modify the representation of the visual content; and
in response to detecting the set of one or more inputs, displaying a second representation of the visual content, wherein the second representation of the visual content includes visual content from at least a portion of the first portion of the field-of-view of the one or more cameras and visual content based on at least a portion of the visual content from the second portion of the field-of-view of the one or more cameras that was not included in the first representation of the visual content.

### Claim 17 (depends on 16)

The non-transitory computer-readable storage medium of claim 16, wherein:
the first representation of the visual content is a representation from a first visual perspective; and
the second representation of the visual content is a representation from a second visual perspective different from the first visual perspective that was generated based on the at least a portion of the visual content from the second portion of the field-of-view of the one or more cameras that was not included in the first representation of the visual content.

### Claim 18 (depends on 16)

The non-transitory computer-readable storage medium of claim 16, wherein:
the first representation of the visual content is a representation in a first orientation; and
the second representation of the visual content is a representation in a second orientation different from the first orientation that was generated based on the at least a portion of the visual content from the second portion of the field-of-view of the one or more cameras that was not included in the first representation of the visual content.

### Claim 19 (depends on 16)

The non-transitory computer-readable storage medium of claim 16, wherein the representation of the first portion of the field-of-view of the one or more cameras is displayed at a first zoom level, the one or more programs further including instructions for:
the first representation of the visual content is a representation at the first zoom level; and
the second representation of the visual content is a representation at a second zoom level different from the first zoom level that was generated based on the at least a portion of the visual content from the second portion of the field-of-view of the one or more cameras that was not included in the first representation of the visual content.

### Claim 20 (depends on 15)

The non-transitory computer-readable storage medium of claim 15, wherein the first representation of the visual content is generated based at least in part on a digital image stabilization operation using at least a second portion of the visual content from the second portion of the field-of-view of the one or more cameras.

### Claim 21 (depends on 15)

The non-transitory computer-readable storage medium of claim 15, the one or more programs further including instructions for:
after capturing the media item, performing an object tracking operation using at least a third portion of the visual content from the second portion of the field-of-view of the one or more cameras.

### Claim 22 (depends on 15)

The non-transitory computer-readable storage medium of claim 15, wherein the request to display the media item is a first request to display the media item, the one or more programs further including instructions for:
after displaying the first representation of the visual content corresponding to the first portion of the field-of-view of the one or more cameras without displaying the representation of at least a portion of the visual content corresponding to the second portion of the field-of-view of the one or more cameras, receiving a second request to display the media item; and
in response to receiving the second request to display the media item, displaying the first representation of the visual content corresponding to the first portion of the field-of-view of the one or more cameras and the representation of the visual content corresponding to the second portion of the field-of-view of the one or more cameras.

### Claim 23 (depends on 15)

The non-transitory computer-readable storage medium of claim 15, the one or more programs further including instructions for:
in response to receiving the request to display the camera user interface and in accordance with a determination that the respective criteria are satisfied, displaying, via the display device, a second camera user interface, the second camera user interface the including the representation of the first portion of the field-of-view of the one or more cameras without including the representation of the second portion of the field-of-view of the one or more cameras.

### Claim 24 (depends on 23)

The non-transitory computer-readable storage medium of claim 23, the one or more programs further including instructions for:
receiving a request to display a previously captured media item; and
in response to receiving the request to display the previously captured media item:
in accordance with a determination that the previously captured media item was captured when the respective criteria were not satisfied, displaying an indication of additional content; and
in accordance with a determination that the previously captured media item was captured when the respective criteria was satisfied, forgoing display of the indication of additional content.

### Claim 25 (depends on 23)

The non-transitory computer-readable storage medium of claim 23, wherein the respective criteria includes a criterion that is satisfied when the electronic device is configured to capture a media item with a resolution of four thousand horizontal pixels or greater.

### Claim 26 (depends on 23)

The non-transitory computer-readable storage medium of claim 23, wherein the respective criteria includes a criterion that is satisfied when the electronic device is configured to operate in a portrait mode at a predetermined zoom level.

### Claim 27 (depends on 23)

The non-transitory computer-readable storage medium of claim 23, wherein the respective criteria include a criterion that is satisfied when at least one camera of the one or more cameras cannot maintain a focus for a predetermined period of time.

### Claim 28 (depends on 15)

The non-transitory computer-readable storage medium of claim 15, wherein:
the input corresponding to the request to capture media with the one or more cameras is a first input corresponding to the request to capture media with the one or more cameras; and
the one or more programs further include instructions for:
while the camera user interface is displayed, detecting a second input corresponding to a request to capture media with the one or more cameras; and
in response to detecting the second input corresponding to the request to capture media with the one or more cameras:
in accordance with a determination that the electronic device is configured to capture visual content corresponding to the second portion of the field-of-view of the one or more cameras based on an additional content setting:
capturing the first representation of the visual content corresponding to the first portion of the field-of-view of the one or more cameras and capturing the representation of at least the portion of the visual content corresponding to the second portion of the field-of-view of the one or more cameras; and
in accordance with a determination that the electronic device is not configured to capture visual content corresponding to the second portion of the field-of-view of the one or more cameras based on the additional content setting:
capturing the first representation of the visual content corresponding to the first portion of the field-of-view of the one or more cameras without capturing the representation of at least the portion of the visual content corresponding to the second portion of the field-of-view of the one or more cameras.

### Claim 29

A method, comprising:
at an electronic device having a display device and one or more cameras:
receiving a request to display a camera user interface;
in response to receiving the request to display the camera user interface and in accordance with a determination that respective criteria are not satisfied:
displaying, via the display device, the camera user interface, the camera user interface including:
a first region, the first region including a representation of a first portion of a field-of-view of the one or more cameras; and
a second region, the second region including a representation of a second portion of the field-of-view of the one or more cameras, wherein the second portion of the field-of-view of the one or more cameras is visually distinguished from the first portion;
while the camera user interface is displayed, detecting an input corresponding to a request to capture media with the one or more cameras;
in response to detecting the input corresponding to the request to capture media with the one or more cameras, capturing, with the one or more cameras, a media item that includes visual content corresponding to the first portion of the field-of-view of the one or more cameras and visual content corresponding to the second portion of the field-of-view of the one or more cameras;
after capturing the media item, receiving a request to display the media item; and
in response to receiving the request to display the media item, displaying a first representation of the visual content corresponding to the first portion of the field-of-view of the one or more cameras without displaying a representation of at least a portion of the visual content corresponding to the second portion of the field-of-view of the one or more cameras.

### Claim 30 (depends on 29)

The method of claim 29, further comprising:
while displaying the first representation of the visual content, detecting a set of one or more inputs corresponding to a request to modify the representation of the visual content; and
in response to detecting the set of one or more inputs, displaying a second representation of the visual content, wherein the second representation of the visual content includes visual content from at least a portion of the first portion of the field-of-view of the one or more cameras and visual content based on at least a portion of the visual content from the second portion of the field-of-view of the one or more cameras that was not included in the first representation of the visual content.

### Claim 31 (depends on 30)

The method of claim 30, wherein:
the first representation of the visual content is a representation from a first visual perspective; and
the second representation of the visual content is a representation from a second visual perspective different from the first visual perspective that was generated based on the at least a portion of the visual content from the second portion of the field-of-view of the one or more cameras that was not included in the first representation of the visual content.

### Claim 32 (depends on 30)

The method of claim 30, wherein:
the first representation of the visual content is a representation in a first orientation; and
the second representation of the visual content is a representation in a second orientation different from the first orientation that was generated based on the at least a portion of the visual content from the second portion of the field-of-view of the one or more cameras that was not included in the first representation of the visual content.

### Claim 33 (depends on 30)

The method of claim 30, wherein the representation of the first portion of the field-of-view of the one or more cameras is displayed at a first zoom level, the method further comprising:
the first representation of the visual content is a representation at the first zoom level; and
the second representation of the visual content is a representation at a second zoom level different from the first zoom level that was generated based on the at least a portion of the visual content from the second portion of the field-of-view of the one or more cameras that was not included in the first representation of the visual content.

### Claim 34 (depends on 29)

The method of claim 29, wherein the first representation of the visual content is generated based at least in part on a digital image stabilization operation using at least a second portion of the visual content from the second portion of the field-of-view of the one or more cameras.

### Claim 35 (depends on 29)

The method of claim 29, further comprising:
after capturing the media item, performing an object tracking operation using at least a third portion of the visual content from the second portion of the field-of-view of the one or more cameras.

### Claim 36 (depends on 29)

The method of claim 29, wherein the request to display the media item is a first request to display the media item, the method further comprising:
after displaying the first representation of the visual content corresponding to the first portion of the field-of-view of the one or more cameras without displaying the representation of at least a portion of the visual content corresponding to the second portion of the field-of-view of the one or more cameras, receiving a second request to display the media item; and
in response to receiving the second request to display the media item, displaying the first representation of the visual content corresponding to the first portion of the field-of-view of the one or more cameras and the representation of the visual content corresponding to the second portion of the field-of-view of the one or more cameras.

### Claim 37 (depends on 29)

The method of claim 29, further comprising:
in response to receiving the request to display the camera user interface and in accordance with a determination that the respective criteria are satisfied, displaying, via the display device, a second camera user interface, the second camera user interface the including the representation of the first portion of the field-of-view of the one or more cameras without including the representation of the second portion of the field-of-view of the one or more cameras.

### Claim 38 (depends on 37)

The method of claim 37, further comprising:
receiving a request to display a previously captured media item; and
in response to receiving the request to display the previously captured media item:
in accordance with a determination that the previously captured media item was captured when the respective criteria were not satisfied, displaying an indication of additional content; and
in accordance with a determination that the previously captured media item was captured when the respective criteria was satisfied, forgoing display of the indication of additional content.

### Claim 39 (depends on 37)

The method of claim 37, wherein the respective criteria includes a criterion that is satisfied when the electronic device is configured to capture a media item with a resolution of four thousand horizontal pixels or greater.

### Claim 40 (depends on 37)

The method of claim 37, wherein the respective criteria includes a criterion that is satisfied when the electronic device is configured to operate in a portrait mode at a predetermined zoom level.

### Claim 41 (depends on 37)

The method of claim 37, wherein the respective criteria include a criterion that is satisfied when at least one camera of the one or more cameras cannot maintain a focus for a predetermined period of time.

### Claim 42 (depends on 29)

The method of claim 29, wherein:
the input corresponding to the request to capture media with the one or more cameras is a first input corresponding to the request to capture media with the one or more cameras; and
the method further comprises:
while the camera user interface is displayed, detecting a second input corresponding to a request to capture media with the one or more cameras; and
in response to detecting the second input corresponding to the request to capture media with the one or more cameras:
in accordance with a determination that the electronic device is configured to capture visual content corresponding to the second portion of the field-of-view of the one or more cameras based on an additional content setting:
capturing the first representation of the visual content corresponding to the first portion of the field-of-view of the one or more cameras and capturing the representation of at least the portion of the visual content corresponding to the second portion of the field-of-view of the one or more cameras; and
in accordance with a determination that the electronic device is not configured to capture visual content corresponding to the second portion of the field-of-view of the one or more cameras based on the additional content setting:
capturing the first representation of the visual content corresponding to the first portion of the field-of-view of the one or more cameras without capturing the representation of at least the portion of the visual content corresponding to the second portion of the field-of-view of the one or more cameras.