# US 2020/0396375 A1 · Devices and Methods for Capturing and Interacting with Enhanced Digital Images

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0396375 A1
- Document ID: US20200396375A1
- Status: Published application
- Kind: A1
- Application number: 17/003,869
- Filed: 2020-08-26
- Published: 2020-12-17
- Earliest claimed: 2015-06-07
- Assignees: Apple Inc.
- Applicants: Apple Inc.
- Inventors: Henrique D. Penha; Behkish J. Manzari; Britt S. Miura; Justin S. Titi; Paulo M. Lopez
- Web page: https://patentgrep.com/patent/US20200396375A1

## CPC

- G06F 3/0487: using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F 3/04817: using icons (graphical or visual programming using iconic symbols G06F8/34)
- G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence)
- G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour
- G06F 3/0485: Scrolling or panning
- G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F 3/04883: for inputting data by handwriting, e.g. gesture or text
- G06V 10/10: Image acquisition (document image scanning and transmission H04N1/00; control of digital cameras H04N23/60)
- G06V 20/00: Scenes; Scene-specific elements (control of digital cameras H04N23/60)
- G11B 27/005: {Reproducing at a different information rate from the information rate of recording (for television signals H04N5/783)}
- G11B 27/031: Electronic editing of digitised analogue information signals, e.g. audio or video signals
- G11B 27/034: on discs (G11B27/036, G11B27/038 take precedence)
- G11B 27/105: {of operating discs}
- G11B 27/34: Indicating arrangements {(indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D)}
- H04N 1/00204: {with a digital computer or a digital computer system, e.g. an internet server (programmed control between transmitter and receiver or between image input and image output device H04N1/32561)}
- H04N 1/2112: {using still video cameras}
- H04N 1/2125: {Display of information relating to the still picture recording}
- H04N 1/2145: {of a sequence of images for selection of a single frame before final recording, e.g. from a continuous sequence captured before and after shutter-release}
- H04N 23/62: Control of parameters via user interfaces
- H04N 23/632: {for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters}
- H04N 23/634: {Warning indications}
- H04N 23/64: {Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image}
- H04N 23/73: by influencing the exposure time
- G06T 2207/10016: Video; Image sequence
- H04N 2101/00: Still video cameras
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

An electronic device, while in a first media acquisition mode, captures media and performs scene recognition. If the scene recognition meets first criteria, the media is displayed as a sequence of images acquired by the camera in temporal proximity to a single activation of a shutter button of the device at the first time. The sequence of images includes a plurality of images acquired by the camera prior to detecting activation of the shutter button at the first time, a representative image that represents the sequence of images and was acquired by the camera after one or more other images in the sequence of images, and a plurality of images acquired by the camera after acquiring the representative image. If the scene recognition does not meet the first criteria, the media is displayed as a single image in temporal proximity to the activation of the shutter button.

## Claims

### Claim 1

An electronic device, comprising:
a display;
a camera;
one or more processors;
memory; and
one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for:
while a first media acquisition mode is active on the electronic device, in response to detecting a single activation of a shutter button at a first time, capturing media corresponding to a scene;
performing scene recognition on the scene;
in response to detecting a user input:
in accordance with a determination that the scene recognition meets first criteria, displaying the media as a sequence of images acquired by the camera in temporal proximity to the single activation of the shutter button at the first time, wherein the sequence of images includes:
a plurality of images acquired by the camera prior to detecting activation of the shutter button at the first time;
a representative image that represents the sequence of images and was acquired by the camera after one or more other images in the sequence of images; and
a plurality of images acquired by the camera after acquiring the representative image; and,
in accordance with a determination that the scene recognition does not meet the first criteria, displaying the media as a single image in temporal proximity to the activation of the shutter button at the first time.

### Claim 2 (depends on 1)

The electronic device of claim 1, wherein the first criteria are action capture criteria.

### Claim 3 (depends on 1)

The electronic device of claim 1, wherein:
the first criteria include recognizing one or more faces in the scene.

### Claim 4 (depends on 1)

The electronic device of claim 1, wherein:
the first criteria include recognizing motion in the scene.

### Claim 5 (depends on 1)

The electronic device of claim 1, wherein:
the first criteria include detecting movement of the electronic device above a predetermined threshold value.

### Claim 6 (depends on 1)

The electronic device of claim 1, wherein:
performing scene recognition on the scene includes recognizing text in the scene; and
the first criteria include a criterion that is met when an amount of text in the scene is below a predefined threshold.

### Claim 7 (depends on 1)

The electronic device of claim 1, wherein the one or more programs further include instructions for:
in accordance with a determination that the first criteria are met, in response to detecting the single activation of the shutter button, retaining the sequence of images acquired by the camera in temporal proximity to the activation of the shutter button; and
in accordance with a determination that the first criteria are not met, in response to detecting the single activation of the shutter button, retaining the single image acquired by the camera in temporal proximity to the activation of the shutter button.

### Claim 8 (depends on 7)

The electronic device of claim 7, wherein:
performing scene recognition on the scene includes determining an amount of motion in the scene; and
retaining the sequence of images acquired by the camera in temporal proximity to the activation of the shutter button at the first time includes:
in accordance with a determination that the amount of motion is a first amount, retaining images at a first frame rate; and
in accordance with a determination that the amount of motion is a second amount that is greater than the first amount, retaining images at a second frame rate that is higher than the first frame rate.

### Claim 9 (depends on 1)

The electronic device of claim 1, wherein a number of images in the sequence of images depends on detected movement of the electronic device while the plurality of images was acquired.

### Claim 10 (depends on 1)

The electronic device of claim 1, wherein the electronic device includes default image capture parameters for acquiring images, and the one or more programs further include instructions for:
determining that the scene contains a single face in portrait orientation, the single face occupying more than a predetermined amount of the display;
in response to determining that the scene contains the single face in portrait orientation, the single face occupying more than a predetermined amount of the display:
acquiring the sequence of images with image capture parameters that are distinct from the default image capture parameters.

### Claim 11

A computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by an electronic device with a display and a camera, cause the electronic device to:
while a first media acquisition mode is active on the electronic device, in response to detecting a single activation of a shutter button at a first time, capture media corresponding to a scene;
perform scene recognition on the scene;
in response to detecting a user input:
in accordance with a determination that the scene recognition meets first criteria, display the media as a sequence of images acquired by the camera in temporal proximity to the single activation of the shutter button at the first time, wherein the sequence of images includes:
a plurality of images acquired by the camera prior to detecting activation of the shutter button at the first time;
a representative image that represents the sequence of images and was acquired by the camera after one or more other images in the sequence of images; and
a plurality of images acquired by the camera after acquiring the representative image; and,
in accordance with a determination that the scene recognition does not meet the first criteria, display the media as a single image in temporal proximity to the activation of the shutter button at the first time.

### Claim 12 (depends on 11)

The computer readable storage medium of claim 11, wherein the first criteria are action capture criteria.

### Claim 13 (depends on 11)

The computer readable storage medium of claim 11, wherein:
the first criteria include recognizing one or more faces in the scene.

### Claim 14 (depends on 11)

The computer readable storage medium of claim 11, wherein:
the first criteria include recognizing motion in the scene.

### Claim 15 (depends on 11)

The computer readable storage medium of claim 11, wherein:
the first criteria include detecting movement of the electronic device above a predetermined threshold value.

### Claim 16 (depends on 11)

The computer readable storage medium of claim 11, wherein:
performing scene recognition on the scene includes recognizing text in the scene; and
the first criteria include a criterion that is met when an amount of text in the scene is below a predefined threshold.

### Claim 17 (depends on 11)

The computer readable storage medium of claim 11, wherein the one or more programs comprise instructions that cause the electronic device to:
in accordance with a determination that the first criteria are met, in response to detecting the single activation of the shutter button, retain the sequence of images acquired by the camera in temporal proximity to the activation of the shutter button; and
in accordance with a determination that the first criteria are not met, in response to detecting the single activation of the shutter button, retain the single image acquired by the camera in temporal proximity to the activation of the shutter button.

### Claim 18 (depends on 27)

The computer readable storage medium of claim 27, wherein:
performing scene recognition on the scene includes determining an amount of motion in the scene; and
retaining the sequence of images acquired by the camera in temporal proximity to the activation of the shutter button at the first time includes:
in accordance with a determination that the amount of motion is a first amount, retaining images at a first frame rate; and
in accordance with a determination that the amount of motion is a second amount that is greater than the first amount, retaining images at a second frame rate that is higher than the first frame rate.

### Claim 19 (depends on 11)

The computer readable storage medium of claim 11, wherein a number of images in the sequence of images depends on detected movement of the electronic device while the plurality of images was acquired.

### Claim 20 (depends on 11)

The computer readable storage medium of claim 11, wherein the electronic device includes default image capture parameters for acquiring images, and the one or more programs comprise instructions that cause the electronic device to:
determine that the scene contains a single face in portrait orientation, the single face occupying more than a predetermined amount of the display;
in response to determining that the scene contains the single face in portrait orientation, the single face occupying more than a predetermined amount of the display:
acquire the sequence of images with image capture parameters that are distinct from the default image capture parameters.

### Claim 21

A method for displaying images, comprising:
at an electronic device with a display, a camera, one or more processors, and memory:
while a first media acquisition mode is active on the electronic device, in response to detecting a single activation of a shutter button at a first time, capturing media corresponding to a scene;
performing scene recognition on the scene;
in response to detecting a user input:
in accordance with a determination that the scene recognition meets first criteria, displaying the media as a sequence of images acquired by the camera in temporal proximity to the single activation of the shutter button at the first time, wherein the sequence of images includes:
a plurality of images acquired by the camera prior to detecting activation of the shutter button at the first time;
a representative image that represents the sequence of images and was acquired by the camera after one or more other images in the sequence of images; and
a plurality of images acquired by the camera after acquiring the representative image; and,
in accordance with a determination that the scene recognition does not meet the first criteria, displaying the media as a single image in temporal proximity to the activation of the shutter button at the first time.
