# US 2024/0205423 A1 · Orientation-aware encoding for higher video quality

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0205423 A1
- Document ID: US20240205423A1
- Status: Published application
- Kind: A1
- Application number: 18/430,393
- Filed: 2024-02-01
- Published: 2024-06-20
- Earliest claimed: 2023-10-19
- Inventors: Nader Mahdi
- Web page: https://patentgrep.com/patent/US20240205423A1

## CPC

- H04N 19/172: the region being a picture, frame or field
- G06T 3/60: Rotation of whole images or parts thereof
- G06V 10/242: {by image rotation, e.g. by 90 degrees}
- H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards
- H04N 19/85: using pre-processing or post-processing specially adapted for video compression
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

An encoder may be tuned to handle video where most of the motion is horizontal. Re-tuning an encoder to content with non-horizontal motion is a difficult process. Instead of re-tuning the process, a solution for coding video content may include rotating a video before encoding it and rotating it back after decoding its compressed bitstream. This solution can allow encoders to consider the suitable orientation of each shot and apply different encoding parameters based on whether the shot needs to be rotated. Similarly, the solution may allow decoders to correctly display the video by rotating the decoded video data to the original orientation. Rotation information may be written into the encoded video bitstream, such as in a sequence header Open Bitstream Unit.

## Claims

### Claim 1

A method, comprising:
receiving an encoded bitstream, wherein:
the encoded bitstream comprises a first packet and frame packets having a first sequence of encoded video frames;
the first packet comprises a first header, and a first payload;
the first payload comprises one or more first syntax elements that are to be applied to the first sequence of encoded video frames; and
the one or more first syntax elements comprise a first sequence rotation index value;
decoding the first sequence of encoded video frames according to the one or more first syntax elements to obtain a first sequence of decoded video frames; and
rotating the first sequence of decoded video frames according to the first sequence rotation index value.

### Claim 2 (depends on 1)

The method of claim 1, wherein the first packet and the frame packets are in an Open Bitstream Unit format.

### Claim 3 (depends on 1)

The method of claim 1, wherein:
the first sequence of encoded video frames forms a first shot of a video; and
the first shot comprises a subset of video frames of the video having one or more uniform spatial-temporal characteristics.

### Claim 4 (depends on 1)

The method of claim 1, wherein the first header indicates that the first packet is a sequence header packet.

### Claim 5 (depends on 1)

The method of claim 1, wherein the first sequence rotation index value comprises an index value selected from two possible index values.

### Claim 6 (depends on 5)

The method of claim 5, wherein the two possible index values comprises:
a first index value indicating a clockwise rotation of 90 degrees; and
a second index value indicating a counter-clockwise rotation of 90 degrees.

### Claim 7 (depends on 1)

The method of claim 1, wherein the first sequence rotation index value comprises an index value selected from four possible index values.

### Claim 8 (depends on 7)

The method of claim 7, wherein the four possible index values comprises:
a first index value indicating no rotation;
a second index value indicating a clockwise rotation of 90 degrees;
a third index value indicating a clockwise rotation of 180 degrees; and
a fourth index value indicating a clockwise rotation of 270 degrees.

### Claim 9 (depends on 1)

The method of claim 1, wherein the one or more first syntax elements further comprise:
a sequence profile index value indicating a sequence profile having one or more of: bit depth, monochrome support, chroma subsampling.

### Claim 10 (depends on 1)

The method of claim 1, wherein the one or more first syntax elements further comprise:
a sequence level index value indicating a sequence level having one or more of: maximum picture size, maximum H size, maximum V size, maximum display rate, maximum decode rate, maximum header rate, main megabits per second, high megabits per second, main compressed ratio, high compressed ratio, maximum tiles, and maximum tile columns.

### Claim 11 (depends on 10)

The method of claim 10, wherein the one or more first syntax elements further comprise:
a sequence tier index value indicating a sequence tier within the sequence level.

### Claim 12 (depends on 1)

The method of claim 1, wherein:
the encoded bitstream comprises a second packet and further frame packets having a second sequence of encoded video frames;
the second packet comprises a second header, and a second payload;
the second payload comprises one or more second syntax elements that are to be applied to the second sequence of encoded video frames;
the one or more second syntax elements comprise a second sequence rotation index value that is different from the first sequence rotation index value;
decoding the second sequence of encoded video frames according to the one or more second syntax elements to obtain a second sequence of decoded video frames; and
rotating the second sequence of decoded video frames according to the second sequence rotation index value.

### Claim 13

One or more non-transitory computer-readable media storing instructions that, when executed by one or more processors, cause the one or more processors to:
receive an encoded bitstream, wherein:
the encoded bitstream comprises a first packet and frame packets having a first sequence of encoded video frames;
the first packet comprises a first header, and a first payload;
the first payload comprises one or more first syntax elements that are to be applied to the first sequence of encoded video frames; and
the one or more first syntax elements comprise a first sequence rotation index value;
decode the first sequence of encoded video frames according to the one or more first syntax elements to obtain a first sequence of decoded video frames; and
rotate the first sequence of decoded video frames according to the first sequence rotation index value.

### Claim 14 (depends on 13)

The one or more non-transitory computer-readable media of claim 13, wherein:
the first sequence of encoded video frames forms a first shot of a video;
the first shot comprises a subset of video frames of the video having one or more uniform spatial-temporal characteristics; and
the first header indicates that the first packet is a sequence header packet.

### Claim 15 (depends on 14)

The one or more non-transitory computer-readable media of claim 14, wherein the first sequence rotation index value comprises an index value selected from two possible index values.

### Claim 16 (depends on 15)

The one or more non-transitory computer-readable media of claim 15, wherein the two possible index values comprises:
a first index value indicating a clockwise rotation of 90 degrees; and
a second index value indicating a counter-clockwise rotation of 90 degrees.

### Claim 17 (depends on 13)

The one or more non-transitory computer-readable media of claim 13, wherein the first sequence rotation index value comprises an index value selected from four possible index values.

### Claim 18 (depends on 17)

The one or more non-transitory computer-readable media of claim 17, wherein the four possible index values comprises:
a first index value indicating no rotation;
a second index value indicating a clockwise rotation of 90 degrees;
a third index value indicating a clockwise rotation of 180 degrees; and
a fourth index value indicating a clockwise rotation of 270 degrees.

### Claim 19

An apparatus, comprising:
one or more processors for executing instructions; and
one or more non-transitory computer-readable media storing the instructions, the instructions causing the one or more processors to:
receive an encoded bitstream, wherein:
the encoded bitstream comprises a first packet and frame packets having a first sequence of encoded video frames;
the first packet comprises a first header, and a first payload;
the first payload comprises one or more first syntax elements that are to be applied to the first sequence of encoded video frames; and
the one or more first syntax elements comprise a first sequence rotation index value;
decode the first sequence of encoded video frames according to the one or more first syntax elements to obtain a first sequence of decoded video frames; and
rotate the first sequence of decoded video frames according to the first sequence rotation index value.

### Claim 20 (depends on 19)

The apparatus of claim 19, wherein:
the encoded bitstream comprises a second packet and further frame packets having a second sequence of encoded video frames;
the second packet comprises a second header, and a second payload;
the second payload comprises one or more second syntax elements that are to be applied to the second sequence of encoded video frames;
the one or more second syntax elements comprise a second sequence rotation index value that is different from the first sequence rotation index value;
decoding the second sequence of encoded video frames according to the one or more second syntax elements to obtain a second sequence of decoded video frames; and
rotating the second sequence of decoded video frames according to the second sequence rotation index value.
