# US 2026/0099953 A1 · Mixing analog and digital neural networks implementations in video coding processes

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0099953 A1
- Document ID: US20260099953A1
- Status: Published application
- Kind: A1
- Application number: 19/115,151
- Filed: 2023-09-14
- Published: 2026-04-09
- Earliest claimed: 2022-09-26
- Assignees: InterDigital CE Patent Holdings, SAS
- Applicants: InterDigital CE Patent Holdings, SAS
- Inventors: Edouard Francois; Franck Galpin; Thierry Dumas; Fabrice Urban
- Web page: https://patentgrep.com/patent/US20260099953A1

## CPC

- G06T 9/002: {using neural networks}
- G06N 3/0455: Auto-encoder networks; Encoder-decoder networks
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06N 3/0495: Quantised networks; Sparse networks; Compressed networks
- G06N 3/065: Analogue means
- G06N 3/08: Learning methods
- H04N 19/30: using hierarchical techniques, e.g. scalability (H04N19/63 takes precedence)
- H04N 19/46: Embedding additional information in the video signal during the compression process (H04N19/517, H04N19/68, H04N19/70 take precedence)
- H04N 19/89: involving methods or arrangements for detection of transmission errors at the decoder
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A method comprising obtaining (611) video data comprising meta-data representative of a level of reliability of a neural network inference process implemented by an analog device, the neural network inference process being applied to decode the video data, an analog device being an electronic circuitry unable to ensure a repeatability of an output result of said electronic circuitry when said electronic circuitry receives same input data; and, decoding (612) the video data, the implementation of the neural network inference process by the analog device depending on the metadata.

## Claims

### Claim 1

A method comprising:
obtaining video data comprising metadata representative of information indicative of a reliability of a neural network inference process implemented by an analog device, the neural network inference process being applied to decode the video data, an analog device being an electronic circuitry unable to ensure a repeatability of an output result of the electronic circuitry when the electronic circuitry receives same input data; and
decoding the video data, the implementation of the neural network inference process depending on the metadata.

### Claim 2 (depends on 1)

The method of claim 1, wherein the metadata comprise a flag indicating a presence in the metadata of a first checksum representative of an expected output of the neural network inference process or of a first statistical parameter representative of an expected output of the neural network inference process.

### Claim 3 (depends on 1)

The method of claim 1 wherein the metadata comprise a first checksum or a first statistical parameter representative of an expected output of the neural network inference process.

### Claim 4 (depends on 3)

The method of claim 3 wherein the implementation of the neural network inference process by the analog device comprises executing at least one time the neural network inference process using the analog device and determining that a second checksum or a second statistical parameter computed on an output of one of the at least one execution of the neural network inference process by the analog device is equal respectively to the first checksum or to the first statistical parameter comprised in the metadata, and
the decoding of the video data comprises decoding the video data using the output of the execution of the neural network inference process by the analog device responsive to the second checksum is equal to the first checksum or responsive to the second statistical parameter is equal to the first statistical parameter.

### Claim 5 (depends on 4)

The method of claim 4, wherein the decoding of the video data comprises decoding the video data using an output of an execution of the neural network inference process by a digital device responsive to each second checksum or each second statistical parameter computed on the output of each execution of the neural network inference process by the analog device is different respectively from the first checksum or from the first statistical parameter, a digital device being an electronic circuitry ensuring a repeatability of an output result of the electronic circuitry when the electronic circuitry receives same input data.

### Claim 6 (depends on 4)

The method of claim 4, wherein, the neural network inference process is executed a plurality of times and responsive to each second checksum or second statistical parameter computed on the output of each execution of the neural network inference process by the analog device is different respectively from the first checksum or the first statistical parameter, the decoding of the video data comprises decoding the video data using an output corresponding to one of:
a median of the outputs of the plurality of executions of the neural network inference process by the analog device;
an arithmetic or a geometric average of the outputs of the plurality of executions of the neural network inference process by the analog device; or
an output selected among the outputs of the plurality of executions of the neural network inference process by the analog device such that the second statistical parameter computed from the output is the closest to the first statistical parameter.

### Claim 7 (depends on 4)

The method of claim 4 wherein the video data are representative of a scalable video comprising a base layer and at least one enhancement layer and the neural network inference process is comprised in a part of a decoding process related to a decoding of an enhancement layer and wherein, responsive to each second checksum or second statistical parameter computed on the output of each execution of the neural network inference process by the analog device is different respectively from the first checksum or the first statistical parameter, the decoding of the video data comprises decoding the video data by replacing each output of the execution of the neural network inference process by the analog device by an output generated from data computed for the base layer.

### Claim 8 (depends on 2)

The method of claim 2 wherein, responsive to the flag indicating an absence of the first checksum from the metadata or an absence of the first statistical parameter from the metadata, the neural network inference process is executed by the analog device.

### Claim 9 (depends on 1)

The method of claim 1, wherein the metadata comprise a flag indicating which device using for executing the neural network inference process among an analog device and a digital device, a digital device being an electronic circuitry ensuring a repeatability of an output result of the electronic circuitry when the electronic circuitry receives same input data.

### Claim 10

A method comprising:
encoding video data using an encoding process comprising a neural network inference process, the neural network inference process being executed by a digital device, a digital device being an electronic circuitry ensuring a repeatability of an output result of the electronic circuitry when the electronic circuitry receives same input data;
computing metadata representative of information indicative of a reliability of the neural network inference process implemented by an analog device using an output of the execution of the neural network inference process by the digital device, an analog device being an electronic circuitry unable to ensure a repeatability of an output result of the electronic circuitry when the electronic circuitry receives same input data; and
signaling the metadata in the encoded video data.

### Claim 11 (depends on 10)

The method according to claim 10 wherein the metadata are signaled in one of:
a picture header;
a slice header;
an adaptive parameter set;
before a first coding tree unit of an area for which the metadata apply;
after a last coding tree unit of an area for which the metadata apply;
in a supplemental enhancement information (SEI) message attached to the encoded video data; or
in a manifest file compliant with a streaming protocol.

### Claim 12 (depends on 10)

The method of claim 10 wherein the metadata is computed per group of pictures or per picture or per slice or per tile or per sub-picture.

### Claim 13 (depends on 10)

The method of claim 10 wherein the metadata comprise a checksum or a statistical parameter representative of an expected output of the neural network inference process.

### Claim 14 (depends on 10)

The method of claim 10 wherein the method further comprises:
analyzing a consistency of an execution of the neural network inference process by an analog device by executing multiple times the neural network inference process using the analog device and comparing outputs of the multiple execution of the neural network inference process by the analog device to the output of the execution of the neural network inference process by the digital device; and,
responsive to a number of outputs of the multiple executions of the neural network inference process by the analog device equal to the output of execution of the neural network inference process by the digital device is below a value, inserting a flag in the metadata indicating that the metadata comprise a checksum or a statistical parameter and otherwise, the flag indicates that the checksum or the statistical parameter is absent from the metadata.

### Claim 15 (depends on 14)

The method of claim 14 wherein the flag indicates that the checksum or the statistical parameter is absent from the metadata if all outputs of the multiple executions of the neural network inference process by the analog device are equal to the output of the execution of the neural network inference process by the digital device.

### Claim 16

A device comprising a processor configured for:
obtaining video data comprising metadata representative of information indicative of a reliability of a neural network inference process implemented by an analog device, the neural network inference process being applied to decode the video data, an analog device being an electronic circuitry unable to ensure a repeatability of an output result of the electronic circuitry when the electronic circuitry receives same input data; and
decoding the video data, the implementation of the neural network inference process depending on the metadata.

### Claim 17 (depends on 16)

The device of claim 16, wherein the metadata comprise a flag indicating a presence in the metadata of a first checksum representative of an expected output of the neural network inference process or of a first statistical parameter representative of an expected output of the neural network inference process.

### Claim 18 (depends on 16)

The device of claim 16 wherein the metadata comprise a first checksum or a first statistical parameter representative of an expected output of the neural network inference process.

### Claim 19 (depends on 18)

The device of claim 18 wherein the implementation of the neural network inference process by the analog device comprises executing at least one time the neural network inference process using the analog device and determining that a second checksum or a second statistical parameter computed on an output of one of the at least one execution of the neural network inference process by the analog device is equal respectively to the first checksum or to the first statistical parameter comprised in the metadata, and
the decoding of the video data comprises decoding the video data using the output of the execution of the neural network inference process by the analog device responsive to the second checksum is equal to the first checksum or responsive to the second statistical parameter is equal to the first statistical parameter.

### Claim at position 20

20-24. (canceled)

### Claim 25

A device comprising electronic circuitry configured for:
encoding video data using an encoding process comprising a neural network inference process, the neural network inference process being executed by a digital device, a digital device being an electronic circuitry ensuring a repeatability of an output result of the electronic circuitry when the electronic circuitry receives same input data;
computing metadata representative of information indicative of a reliability of the neural network inference process implemented by an analog device using an output of the execution of the neural network inference process by the digital device, an analog device being an electronic circuitry unable to ensure a repeatability of an output result of the electronic circuitry when the electronic circuitry receives same input data; and
signaling the metadata in the encoded video data.

### Claim at position 22

26-33. (canceled)
