# US 10,873,752 B2 · Adaptive camera resolution for compression matching

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,873,752 B2
- Document ID: US10873752B2
- Status: Granted
- Kind: B2
- Application number: 15/258,761
- Filed: 2016-09-07
- Published: 2017-11-16
- Granted: 2020-12-22
- Earliest claimed: 2016-05-11
- Assignees: Intel Corporation
- Applicants: Intel Corporation
- Inventors: Richmond Hicks; Jill M. Boyce
- Web page: https://patentgrep.com/patent/US10873752B2

## CPC

- H04N 19/31: in the temporal domain
- H04N 19/124: Quantisation
- H04N 19/132: Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
- H04N 19/159: Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
- H04N 19/172: the region being a picture, frame or field
- H04N 19/187: the unit being a scalable video layer
- H04N 19/30: using hierarchical techniques, e.g. scalability (H04N19/63 takes precedence)
- H04N 19/59: involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution
- H04N 23/65: Control of camera operation in relation to power supply
- H04N 23/667: Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
- H04N 23/951: by using two or more images to influence resolution, frame rate or aspect ratio
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An adaptive camera resolution system is described for use with matching resolution with compression. In one example, the a method includes capturing a first set of frames of a video sequence at an image sensor at a first resolution, capturing a second set of frames of the video sequence at the image sensor at a second lower resolution, wherein the first and second sets of frames are interleaved, receiving the captured frames at a video encoder, and combining the frames at the video encoder to generate an encoded video sequence of frames with the first resolution.

## Claims

### Claim 1

A method comprising:
capturing a first set of frames, including I frames, of a video sequence at an image sensor at a first resolution;
capturing a second set of frames of the video sequence at the image sensor including capturing referenced B frames at a second resolution lower than the first resolution and capturing non-referenced B frames at a resolution lower than the second resolution, wherein the first set of frames and the second set of frames are interleaved;
receiving the captured first set of frames and the second set of frames at a video encoder; and
combining the first set of frames and the second set of frames at the video encoder to generate an encoded video sequence of frames with the first resolution.

### Claim 2 (depends on 1)

The method of claim 1, further comprising capturing P frames of the scene at the image sensor after capturing at least one I frame using a third resolution lower than the first resolution.

### Claim 3 (depends on 2)

The method of claim 2, wherein the second and third resolution is the same and is one fourth of the first resolution.

### Claim 4 (depends on 1)

The method of claim 1, further comprising upscaling the second set of frames to the first resolution at an image signal processor after capturing and before combining the frames in the video encoder.

### Claim 5 (depends on 4)

The method of claim 4, further comprising converting the upscaled images to YUV images at the image signal processor before combining the frames in the video encoder.

### Claim 6 (depends on 1)

The method of claim 1, further comprising sending an indication of a desired capture resolution from the video encoder to a camera controller and wherein the camera controller sets the resolution at the image sensor for captured images.

### Claim 7 (depends on 6)

The method of claim 6, wherein the sending of the indication includes receiving an instruction from an application at an image signal processor, configuring the video encoder, and configuring the camera controller.

### Claim 8 (depends on 7)

The method of claim 7, wherein the configuring of the camera controller includes sending instructions from the video encoder to a camera driver through the image signal processor.

### Claim 9

An apparatus comprising:
an image sensor to capture a first set of frames, including I frames, of a video sequence at a first resolution and to capture a second set of frames of the video sequence including capturing referenced B frames at a second resolution lower than the first resolution and capturing non-referenced B frames at a resolution lower than the second resolution, wherein the first set of frames and the second set of frames are interleaved;
an image input interface to receive the captured first set of frames and second set of frames from the image sensor; and
a video encoder to receive the captured first set of frames and second set of frames from the image input interface and to combine the frames to generate an encoded video sequence of frames with the first resolution.

### Claim 10 (depends on 9)

The apparatus of claim 9, further comprising a camera capture controller coupled to the video encoder to receive instructions from the video encoder to set the image sensor to capture at the first and the second resolutions.

### Claim 11 (depends on 9)

The apparatus of claim 9, further comprising an image signal processor coupled to the video encoder to upsample the second set of frames to the first resolution after they are captured.

### Claim 12

A portable device comprising:
a display to show an encoded video;
an image sensor to capture a first set of frames, including I frames, of a video sequence at a first resolution and to capture a second set of frames of the video sequence including capturing referenced B frames at a second resolution, lower than the first resolution and capturing non-referenced B-frames at a resolution lower than the second resolution, wherein the first set of frames and the second set of frames are interleaved;
an image input interface to receive the captured first set of frames and second set of frames from the image sensor; and
a video encoder to receive the captured first set of frames and second set of frames from the image input interface and to combine the frames to generate the encoded video as a sequence of frames with the first resolution to show on the display.

### Claim 13 (depends on 12)

The device of claim 12, wherein the video encoder is a High Efficiency Video Coded (HEVC).

### Claim 14 (depends on 13)

The device of claim 13, further comprising a control bus from the video encoder to the image sensor and wherein the video encoder controls the resolution used to capture the frames of the video sequence.
