# US 2021/0084294 A1 · Encoding video using two-stage intra search

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0084294 A1
- Document ID: US20210084294A1
- Status: Published application
- Kind: A1
- Application number: 17/107,258
- Filed: 2020-11-30
- Published: 2021-03-18
- Earliest claimed: 2019-06-13
- Assignees: Intel Corporation
- Applicants: Intel Corporation
- Inventors: James M. Holland; Srinivasan Embar Raghukrishnan; Zhijun Lei; Dmitry E. Ryzhov; Lidong Xu; Satya N. Yedidi
- Web page: https://patentgrep.com/patent/US20210084294A1

## CPC

- H04N 19/11: among a plurality of spatial predictive coding modes
- H04N 19/12: Selection from among a plurality of transforms or standards, e.g. selection between discrete cosine transform [DCT] and sub-band transform or selection between H.263 and H.264
- H04N 19/147: according to rate distortion criteria (rate-distortion as a criterion for motion estimation H04N19/567)
- H04N 19/156: Availability of hardware or computational resources, e.g. encoding based on power-saving criteria
- H04N 19/159: Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
- H04N 19/176: the region being a block, e.g. a macroblock
- H04N 19/33: in the spatial domain
- H04N 19/533: Motion estimation using multistep search, e.g. two-dimensional [2D]-log search or one-at-a-time search [OTS]
- H04N 19/593: involving spatial prediction techniques
- H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards
- H04N 19/88: involving rearrangement of data among different coding units, e.g. shuffling, interleaving, scrambling or permutation of pixel data or permutation of transform coefficient data among different blocks
- H04N 19/60: using transform coding
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Example apparatus to encode video disclosed herein include an encoder to perform an intra search first stage based on source pixels of a source video frame to determine first intra candidates to predict a block of the source video frame. In disclosed examples, the encoder is also to perform an intra search second stage based on reconstructed pixels of neighboring blocks associated with the first intra candidates to determine a second intra candidate. In disclosed examples, the encoder is further to encode the block of the source video frame based on the second intra candidate.

## Claims

### Claim 1

An apparatus to encode video, the apparatus comprising:
memory; and
an encoder to:
perform an intra search first stage based on source pixels of a source video frame to determine first intra candidates to predict a block of the source video frame;
perform an intra search second stage based on reconstructed pixels of neighboring blocks associated with the first intra candidates to determine a second intra candidate; and
encode the block of the source video frame based on the second intra candidate.

### Claim 2 (depends on 1)

The apparatus of claim 1, wherein the source pixels of the source video frame include respective source pixels of the neighboring blocks associated with the first intra candidates, and the reconstructed pixels of the neighboring blocks associated with the first intra candidates are different from the source pixels of the neighboring blocks associated with the first intra candidates.

### Claim 3 (depends on 2)

The apparatus of claim 2, wherein the reconstructed pixels of the neighboring blocks are based on previously encoded versions of the neighboring blocks.

### Claim 4 (depends on 1)

The apparatus of claim 1, wherein the intra search first stage is to use a plurality of prediction angles to determine the first intra candidates, and the intra search second stage is to use a subset of the plurality of prediction angles to determine the second intra candidate from the first intra candidates.

### Claim 5 (depends on 1)

The apparatus of claim 1, wherein the intra search second stage is to determine the second intra candidate based on evaluation of a coding cost, and the intra search first stage is not to use the coding cost to determine the first intra candidates.

### Claim 6 (depends on 1)

The apparatus of claim 1, wherein the block of the source video frame corresponds to a coding unit.

### Claim 7 (depends on 1)

The apparatus of claim 1, wherein the intra search first stage is to use a prediction type of a different codec than the intra search second stage.

### Claim 8

At least one storage device comprising computer readable instructions that, when executed, cause one or more processors to at least:
execute an intra search first stage based on source pixels of a source video frame to determine first intra candidates to predict a block of the source video frame;
execute an intra search second stage based on reconstructed pixels of neighboring blocks associated with the first intra candidates to determine a second intra candidate; and
encode the block of the source video frame based on the second intra candidate.

### Claim 9 (depends on 8)

The at least one storage device of claim 8, wherein the source pixels of the source video frame include respective source pixels of the neighboring blocks associated with the first intra candidates, and the reconstructed pixels of the neighboring blocks associated with the first intra candidates are different from the source pixels of the neighboring blocks associated with the first intra candidates.

### Claim 10 (depends on 9)

The at least one storage device of claim 9, wherein the reconstructed pixels of the neighboring blocks are based on previously encoded versions of the neighboring blocks.

### Claim 11 (depends on 8)

The at least one storage device of claim 8, wherein the intra search first stage is to use a plurality of prediction angles to determine the first intra candidates, and the intra search second stage is to use a subset of the plurality of prediction angles to determine the second intra candidate from the first intra candidates.

### Claim 12 (depends on 8)

The at least one storage device of claim 8, wherein the intra search second stage is to determine the second intra candidate based on evaluation of a coding cost, and the intra search first stage is not to use the coding cost to determine the first intra candidates.

### Claim 13 (depends on 8)

The at least one storage device of claim 8, wherein the block of the source video frame corresponds to a coding unit.

### Claim 14 (depends on 8)

The at least one storage device of claim 8, wherein the intra search first stage is to use a prediction type of a different codec than the intra search second stage.

### Claim 15

A system to encode video, the system comprising:
memory; and
at least one processor to:
execute an intra search first stage on a video frame to determine first intra candidates to predict a block of the video frame;
perform an intra search second stage on the first intra candidates to determine a second intra candidate, the intra search first stage to use a prediction type of a different codec than the intra search second stage; and
encode the block of the video frame based on the second intra candidate.

### Claim 16 (depends on 15)

The system of claim 15, wherein the processor is to perform the intra search first stage based on a plurality of prediction angles to determine the first intra candidates, and the processor is to perform the intra search second stage based on a subset of the plurality of prediction angles to determine the second intra candidate from the first intra candidates.

### Claim 17 (depends on 15)

The system of claim 15, wherein the processor is to perform the intra search first stage based on source pixels of the video frame, and the processor is to perform the intra search second stage based on reconstructed pixels of neighboring blocks associated with the first intra candidates.

### Claim 18 (depends on 17)

The system of claim 17, wherein the source pixels of the video frame include respective source pixels of the neighboring blocks associated with the first intra candidates, and the reconstructed pixels of the neighboring blocks associated with the first intra candidates are different from the source pixels of the neighboring blocks associated with the first intra candidates.

### Claim 19 (depends on 18)

The system of claim 18, wherein the reconstructed pixels of the neighboring blocks are based on previously encoded versions of the neighboring blocks.

### Claim 20 (depends on 15)

The system of claim 15, wherein the intra search second stage is based on a coding cost, and the intra search first stage is not based on the coding cost.
