# US 2018/0324357 A1 · Modeless Video and Still Frame Capture

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0324357 A1
- Document ID: US20180324357A1
- Status: Published application
- Kind: A1
- Application number: 16/019,906
- Filed: 2018-06-27
- Published: 2018-11-08
- Earliest claimed: 2013-11-18
- Assignees: Apple Inc.
- Applicants: Apple Inc.
- Inventors: D. Amnon Silverstein; Shun Wai Go; Suk Hwan Lim; Timothy J. Millet; Ting Chen; Bin Ni
- Web page: https://patentgrep.com/patent/US20180324357A1

## CPC

- H04N 23/667: Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
- H04N 1/212: {Motion video recording combined with still video recording (television signal recording H04N5/76)}
- H04N 7/007: {Systems with supplementary picture signal insertion during a portion of the active part of a television signal, e.g. during top and bottom lines in a HDTV letter-box system}
- H04N 7/0122: {the input and the output signals having different aspect ratios}
- H04N 9/87: Regeneration of colour television signals (H04N9/80 takes precedence)
- H04N 23/62: Control of parameters via user interfaces
- H04N 23/63: by using electronic viewfinders
- H04N 23/632: {for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters}
- H04N 23/951: by using two or more images to influence resolution, frame rate or aspect ratio
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

In an embodiment, an electronic device may be configured to capture still frames during video capture but may capture the still frames in the 4×3 aspect ratio and at higher resolution than the 16×9 aspect ratio video frames. The device may interleave high resolution, 4×3 frames and lower resolution 16×9 frames in the video sequence, and may capture the nearest higher resolution, 4×3 frame when the user indicates the capture of a still frame. Alternatively, the device may display 16×9 frames in the video sequence, and then expand to 4×3 frames when a shutter button is pressed. The device may capture the still frame and return to the 16×9 video frames responsive to a release of the shutter button.

## Claims

### Claim 1

A device comprising:
at least one image sensor;
a display device; and
an integrated circuit coupled to the image sensor and the display device, wherein:
the integrated circuit is configured to receive a first plurality of frames from the image sensor;
the integrated circuit is configured to output a first video sequence based on the first plurality of frames;
the first video sequence includes a second plurality frames having a first aspect ratio associated with still frames and a first resolution, and
the first video sequence further includes a third plurality of frames having a second aspect ratio different from the first aspect ratio;
the integrated circuit is configured to output a second video sequence, based on the first plurality of frames, to be displayed on the display device;
the second video sequence includes a fourth plurality of frames at a second resolution that is less than the first resolution;
the integrated circuit is configured to capture a first frame of the second plurality of frames responsive to a user input on the device; and
the first frame is nearest in time in the first video sequence to a second frame of the second video sequence that is displayed on the display device at a time that the user input is received.

### Claim 2 (depends on 1)

The device as recited in claim 1 wherein the second aspect ratio is associated with video frames.

### Claim 3 (depends on 2)

The device as recited in claim 2 wherein the second aspect ratio is specified by a video display standard.

### Claim 4 (depends on 2)

The device as recited in claim 2 wherein the first aspect ratio is 4×3 and the second aspect ratio is 16x9.

### Claim 5 (depends on 1)

The device as recited in claim 1 wherein the integrated circuit is configured to interleave the second plurality of frames and the third plurality of frames in the first video sequence.

### Claim 6 (depends on 1)

The device as recited in claim 1 wherein the first resolution is provided by the image sensor and the third plurality of frames have a third resolution less than the first resolution.

### Claim 7 (depends on 6)

The device as recited in claim 6 wherein the third resolution is greater than the second resolution.

### Claim 8 (depends on 6)

The device as recited in claim 6 wherein the third resolution is specified by a display standard.

### Claim 9

In a device including an image sensor, a display device, and an integrated circuit coupled to the image sensor and the display device, a method comprising:
receiving, in the integrated circuit, a first plurality of frames from the image sensor;
outputting, from the integrated circuit a first video sequence based on the first plurality of frames, wherein the first video sequence includes a second plurality frames having a first aspect ratio associated with still frames and a first resolution, and wherein the first video sequence further includes a third plurality of frames having a second aspect ratio different from the first aspect ratio;
displaying a second video sequence on the display device, the second video sequence based on the first plurality of frames and including a fourth plurality of frames at a second resolution that is less than the first resolution;
receiving user input on the device during a time that a first frame of the fourth plurality of frames is displayed on the display device; and
capturing, by the integrated circuit, a second frame of the second plurality of frames responsive to the user input, wherein the second frame is nearest in time in the first video sequence to the second frame.

### Claim 10 (depends on 9)

The method as recited in claim 9 wherein the second aspect ratio is associated with video frames.

### Claim 11 (depends on 10)

The method as recited in claim 10 wherein the second aspect ratio is specified by a video display standard.

### Claim 12 (depends on 10)

The method as recited in claim 10 wherein the first aspect ratio is 4×3 and the second aspect ratio is 16×9.

### Claim 13 (depends on 9)

The method as recited in claim 9 further comprising interleaving, by the integrated circuit, the second plurality of frames and the third plurality of frames in the first video sequence.

### Claim 14 (depends on 9)

The method as recited in claim 9 wherein the first resolution is provided by the image sensor and the third plurality of frames have a third resolution less than the first resolution.

### Claim 15 (depends on 14)

The method as recited in claim 14 wherein the third resolution is greater than the second resolution.

### Claim 16 (depends on 14)

The method as recited in claim 14 wherein the third resolution is specified by a display standard.

### Claim 17

An integrated circuit comprising:
a memory controller coupled to a memory during use;
a display controller coupled to the memory controller and coupled to a display during use; and
an image signal processor (ISP) coupled to the memory controller and having a sensor interface configured to receive a first plurality of frames from an image sensor, wherein:
the ISP is configured to output a first video sequence based on the first plurality of frames to the memory controller to store in the memory;
the first video sequence includes a second plurality frames having a first aspect ratio associated with still frames and a first resolution, and the first video sequence further includes a third plurality of frames having a second aspect ratio different from the first aspect ratio;
the ISP is configured to output a second video sequence, based on the first plurality of frames, to be displayed on the display device;
the second video sequence includes a fourth plurality of frames at a second resolution that is less than the first resolution;
the integrated circuit is configured to capture a first frame of the second plurality of frames responsive to a user input on the device; and
the first frame is nearest in time in the first video sequence to a second frame of the second video sequence that is displayed on the display device at a time that the user input is received.

### Claim 18 (depends on 17)

The integrated circuit as recited in claim 17 wherein the ISP is configured to interleave the second plurality of frames and the third plurality of frames in the first video sequence.

### Claim 19 (depends on 17)

The integrated circuit as recited in claim 17 wherein the first resolution is provided by the image sensor and the third plurality of frames have a third resolution less than the first resolution.

### Claim 20 (depends on 19)

The integrated circuit as recited in claim 19 wherein the third resolution is greater than the second resolution.
