# US 12,113,974 B2 · High-level syntax for signaling neural networks within a media bitstream

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,113,974 B2
- Document ID: US12113974B2
- Status: Granted
- Kind: B2
- Application number: 17/934,734
- Filed: 2022-09-23
- Published: 2023-04-13
- Granted: 2024-10-08
- Earliest claimed: 2021-09-30
- Assignees: Nokia Technologies Oy
- Applicants: Nokia Technologies Oy
- Inventors: Miska Matias Hannuksela; Emre Baris Aksu; Francesco Cricrì; Hamed Rezazadegan Tavakoli
- Web page: https://patentgrep.com/patent/US12113974B2

## CPC

- H04N 19/117: Filters, e.g. for pre-processing or post-processing (sub-band filter banks H04N19/635)
- H04N 19/184: the unit being bits, e.g. of the compressed video stream
- H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards
- H04N 19/85: using pre-processing or post-processing specially adapted for video compression
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A method, an apparatus, and a computer program product are provided. An example method includes defining an enhancement message comprising at least one of the following: an identifying number for identifying a post-processing filter; a mode identity (idc) field used of indicating association of a post-processing filter with the identifying number; a flag for specifying the enhancement message being used for a current layer; and the payload byte comprising a bitstream; and using the enhancement message for at least one of specifying a neural network that is used as a post-processing filter or cancelling a use of a previous post-processing filter with the same identifying number.

## Claims

### Claim 1

A method comprising:
creating one or more prefix indications in or along a bitstream;
including, in the one or more prefix indications, an initial part of an information message, wherein the information message describes one or more post-filtering operations or related information, and wherein the initial part describes one or more post-filter properties;
using the one or more prefix indications to declare the one or more post-filter properties of the bitstream so as to enable selection of the bitstream to be received or decoded;
making the one or more prefix indications accessible through a media description describing the bitstream, wherein the one or more prefix indications are contained in at least one of the following:
one or more media parameters in the media description; or
one or more syntax elements or one or more syntax structures in a file encapsulating the bitstream, wherein the file is accessible via the media description.

### Claim 2 (depends on 1)

The method according to claim 1, wherein the one or more post-filter properties comprise one or more of the following:
filtering purpose;
one or more complexity measures of executing the one or more post-filtering operations; or
an identification of or a reference to a post-filter neural network.

### Claim 3 (depends on 1)

The method according to claim 1, wherein the one or more prefix indications comprise one or more supplemental enhancement information (SEI) prefix indications, the information message comprises a SEI information message, and the bitstream comprises a video bitstream.

### Claim 4

A method comprising:
receiving one or more prefix indications for a bitstream;
parsing, from the one or more prefix indications, an initial part of an information message, wherein the information message describes one or more post-filtering operations or related information, and wherein the initial part describes one or more post-filter properties, wherein the one or more prefix indications declare the one or more post-filter properties of the bitstream so as to enable selection of the bitstream to be received or decoded;
parsing through a media description describing the bitstream to access the one or more prefix indications, wherein the one or more prefix indications are contained in at least one of the following:
one or more media parameters in the media description; or
one or more syntax elements or one or more syntax structures in a file encapsulating the bitstream, wherein the file is accessible via the media description;
determining, based on the declared one or more post-filter properties, one or more of the following:
whether to fetch the bitstream;
whether to fetch the information message; or
whether to fetch a neural network referenced by the one or more post-filter properties.

### Claim 5 (depends on 4)

The method according to claim 4, wherein the one or more post-filter properties comprise one or more of the following:
a filtering purpose;
one or more complexity measures of executing the one or more post-filtering operations; or
an identification of or a reference to a post-filter neural network.

### Claim 6 (depends on 4)

The method according to claim 4, wherein the one or more prefix indications comprise one or more supplemental enhancement information (SEI) prefix indications, the information message comprises a SEI information message, and the bitstream comprises a video bitstream.

### Claim 7

An apparatus comprising at least one processor; and at least one non-transitory memory storing instructions that, when executed by the at least one processor, cause the apparatus at least to perform:
creating one or more prefix indications in or along a bitstream;
including, in the one or more prefix indications, an initial part of an information message, wherein the information message describes one or more post-filtering operations or related information, and wherein the initial part describes one or more post-filter properties;
using the one or more prefix indications to declare the one or more post-filter properties of the bitstream so as to enable selection of the bitstream to be received or decoded;
making the one or more prefix indications accessible through a media description describing the bitstream, wherein the one or more prefix indications are contained in at least one of the following:
one or more media parameters in the media description; or
one or more syntax elements or one or more syntax structures in a file encapsulating the bitstream, wherein the file is accessible via the media description.

### Claim 8 (depends on 7)

The apparatus according to claim 7, wherein the one or more post-filter properties comprise one or more of the following:
filtering purpose;
one or more complexity measures of executing the one or more post-filtering operations; or
an identification of or a reference to a post-filter neural network.

### Claim 9 (depends on 7)

The apparatus according to claim 7, wherein the one or more prefix indications comprise one or more supplemental enhancement information (SEI) prefix indications, the information message comprises a SEI information message, and the bitstream comprises a video bitstream.

### Claim 10

An apparatus comprising at least one processor; and at least one non-transitory memory storing instructions that, with when executed by the at least one processor, cause the apparatus at least to perform:
receiving one or more prefix indications for a bitstream;
parsing, from the one or more prefix indications, an initial part of an information message, wherein the information message describes one or more post-filtering operations or related information, and wherein the initial part describes one or more post-filter properties, wherein the one or more prefix indications declare the one or more post-filter properties of the bitstream so as to enable selection of the bitstream to be received or decoded;
parsing through a media description describing the bitstream to access the one or more prefix indications, wherein the one or more prefix indications are contained in at least one of the following:
one or more media parameters in the media description; or
one or more syntax elements or one or more syntax structures in a file encapsulating the bitstream, wherein the file is accessible via the media description;
determining, based on the declared one or more post-filter properties, one or more of the following:
whether to fetch the bitstream;
whether to fetch the information message; or, or
whether to fetch a neural network referenced by the one or more post-filter properties.

### Claim 11 (depends on 10)

The apparatus according to claim 10, wherein the one or more post-filter properties comprise one or more of the following:
a filtering purpose;
one or more complexity measures of executing the one or more post-filtering operations; or
an identification of or a reference to a post-filter neural network.

### Claim 12 (depends on 10)

The apparatus according to claim 10, wherein the one or more prefix indications comprise one or more supplemental enhancement information (SEI) prefix indications, the information message comprises a SEI information message, and the bitstream comprises a video bitstream.

### Claim 13 (depends on 1)

The method according to claim 1, wherein the one or more prefix indications are contained at least in the one or more media parameters in the media description.

### Claim 14 (depends on 1)

The method according to claim 1, wherein the one or more prefix indications are contained at least in the one or more syntax elements or the syntax structures in the file encapsulating the bitstream, wherein the file is accessible via the media description.

### Claim 15 (depends on 4)

The method according to claim 4, wherein the one or more prefix indications are contained at least in the one or more media parameters in the media description.

### Claim 16 (depends on 4)

The method according to claim 4, wherein the one or more prefix indications are contained at least in the one or more syntax elements or the syntax structures in the file encapsulating the bitstream, wherein the file is accessible via the media description.

### Claim 17 (depends on 7)

The apparatus according to claim 7, wherein the one or more prefix indications are contained at least in the one or more media parameters in the media description.

### Claim 18 (depends on 7)

The apparatus according to claim 7, wherein the one or more prefix indications are contained at least in the one or more syntax elements or the syntax structures in the file encapsulating the bitstream, wherein the file is accessible via the media description.

### Claim 19 (depends on 10)

The apparatus according to claim 10, wherein the one or more prefix indications are contained at least in the one or more media parameters in the media description.

### Claim 20 (depends on 10)

The apparatus according to claim 10, wherein the one or more prefix indications are contained at least in the one or more syntax elements or the syntax structures in the file encapsulating the bitstream, wherein the file is accessible via the media description.
