# US 2026/0073477 A1 · Image reconstruction using frequency domain prediction for image processing systems and applications

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0073477 A1
- Document ID: US20260073477A1
- Status: Published application
- Kind: A1
- Application number: 18/830,219
- Filed: 2024-09-10
- Published: 2026-03-12
- Earliest claimed: 2024-09-10
- Assignees: NVIDIA Corporation
- Applicants: NVIDIA Corporation
- Inventors: Aviral AGRAWAL; Ankitesh Kumar SINGH; Manindra PARHY
- Web page: https://patentgrep.com/patent/US20260073477A1

## CPC

- G06T 5/10: using non-spatial domain filtering
- G06T 3/4046: using neural networks
- G06T 3/4053: based on super-resolution, i.e. the output image resolution being higher than the sensor resolution
- G06T 3/4084: in the transform domain, e.g. fast Fourier transform [FFT] domain scaling
- G06T 5/60: using machine learning, e.g. neural networks
- G06T 2207/20064: Wavelet transform [DWT]
- G06T 2207/20081: Training; Learning
- G06T 2207/20084: Artificial neural networks [ANN]
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

In various examples, wavelet prediction-based image reconstruction for image processing systems and applications is provided. A deep learning model may use derived frequency bands to predict sub-pixel-level information to perform predictive resampling as well as image/video artifact removal. The model may learn to predict missing frequency components while removing artifacts to generate resampled resolution image predictions based on the original input image. The model may comprise distinct frequency domain and spatial domain paths. The frequency domain path may process frequency domain sub-band images to introduce individualized non-linearity. Spatial domain prediction data may be generated based on the upsampled original input image. Substantive corrections may be applied by mapping the spatial domain prediction data into frequency sub-band images and the correcting sub-band images based on frequency domain prediction data. The resulting corrected sub-band images may be applied to an inverse DWT to reconstruct a resampled version.

## Claims

### Claim 1

One or more processors comprising processing circuitry to:
compute one or more frequency domain predictions based at least on one or more first adjustments applied to one or more sub-band images derived from at least one wavelet frequency representation of a resampled image input;
compute a spatial domain prediction based at least on applying one or more second adjustments to the resampled image input;
compute a corrected wavelet frequency representation of the spatial domain prediction based at least on the one or more frequency domain predictions; and
generate a reconstructed image based at least on the corrected wavelet frequency representation; and
produce a resampled image prediction output using the reconstructed image.

### Claim 2 (depends on 1)

The one or more processors of claim 1, wherein the one or more processors are further to compute the at least one wavelet frequency representation of the resampled image input based at least on a multi-level decomposition of the resampled image input.

### Claim 3 (depends on 1)

The one or more processors of claim 1, wherein the resampled image input comprises an upsampled image or a downsampled image, based at least on an image data input.

### Claim 4 (depends on 1)

The one or more processors of claim 1, wherein the one or more processors are further to compute the one or more frequency domain predictions based at least on a discrete wavelet transform, wherein the one or more frequency domain predictions comprise at least one of:
a low-low sub-band prediction, a high-high sub-band prediction, a low-high sub-band prediction, and a high-low sub-band prediction.

### Claim 5 (depends on 4)

The one or more processors of claim 4, wherein the one or more frequency domain predictions include at least the low-low sub-band prediction and the high-high sub-band prediction.

### Claim 6 (depends on 1)

The one or more processors of claim 1, wherein the one or more frequency domain predictions are individually derived based at least on one or more non-linear corrections computed by one or more residual block-based frameworks of a frequency domain path of a machine learning model.

### Claim 7 (depends on 1)

The one or more processors of claim 1, wherein the spatial domain prediction is derived based at least on one or more non-linear corrections computed using a residual block-based framework of a spatial domain path of a neural network model.

### Claim 8 (depends on 1)

The one or more processors of claim 1, wherein the one or more first adjustments and the one or more second adjustments are based at least on two-dimensional convolution operations.

### Claim 9 (depends on 1)

The one or more processors of claim 1, wherein the one or more processors compute the one or more frequency domain predictions based at least on a wavelet frequency decomposition algorithm comprising a discrete wavelet transform (DWT); and
generate the reconstructed image based at least on applying the corrected wavelet frequency representation to an inverse DWT.

### Claim 10 (depends on 1)

The one or more processors of claim 1, wherein the one or more frequency domain predictions and the spatial domain prediction are generated based at least on a machine learning model trained based at least on a loss function comprising at least a first loss component for a frequency sub-band prediction loss, and at least a second loss component for a resampled image prediction loss.

### Claim 11 (depends on 1)

The one or more processors of claim 1, wherein the processing circuitry is comprised in at least one of:
a control system for an autonomous or semi-autonomous machine;
a perception system for an autonomous or semi-autonomous machine;
a system for performing simulation operations;
a system for performing digital twin operations;
a system for performing light transport simulation;
a system for performing collaborative content creation for three-dimensional assets;
a system for performing deep learning operations;
a system for performing remote operations;
a system for performing real-time streaming;
a system for generating or presenting one or more of augmented reality content, virtual reality content, or mixed reality content;
a system implemented using an edge device;
a system implemented using a robot;
a system for performing conversational AI operations;
a system implementing one or more language models;
a system implementing one or more large language models (LLMs);
a system implementing one or more vision language models (VLMs);
a system for generating synthetic data;
a system for generating synthetic data using AI;
a system incorporating one or more virtual machines (VMs);
a system implemented at least partially in a data center; or
a system implemented at least partially using cloud computing resources.

### Claim 12

A system comprising one or more processors to:
compute a corrected wavelet frequency representation for a resampled image input based at least on one or more frequency domain predictions individually computed based at least on one or more first adjustments applied to one or more sub-band images derived from at least one initial wavelet frequency representation of the resampled image input; and
generate a reconstructed image based at least on the corrected wavelet frequency representation to produce a resampled image prediction output.

### Claim 13 (depends on 12)

The system of claim 12, the one or more processors further to:
compute a spatial domain prediction based at least on applying one or more second adjustments to the resampled image input; and
wherein the corrected wavelet frequency representation is based at least on a correction of the spatial domain prediction based at least on the one or more frequency domain predictions.

### Claim 14 (depends on 13)

The system of claim 13, wherein the spatial domain prediction is derived based at least on one or more non-linear corrections computed using a residual block-based framework of a spatial domain path of a neural network model.

### Claim 15 (depends on 12)

The system of claim 12, wherein the one or more processors are further to compute the at least one wavelet frequency representation of the resampled image input based at least on a multi-level decomposition of the resampled image input.

### Claim 16 (depends on 12)

The system of claim 12, wherein the one or more processors are further to execute a machine learning model, wherein the one or more frequency domain predictions are individually derived based at least on one or more non-linear corrections computed by one or more residual block-based frameworks of a frequency domain path of the machine learning model.

### Claim 17 (depends on 12)

The system of claim 12, wherein the one or more processors are further to compute the one or more frequency domain predictions based at least on a wavelet frequency decomposition algorithm comprising a discrete wavelet transform (DWT); and
generate the reconstructed image based at least on applying the corrected wavelet frequency representation to an inverse DWT.

### Claim 18 (depends on 12)

The system of claim 12, wherein the one or more processors are further to compute the one or more frequency domain predictions based at least on a discrete wavelet transform, wherein the one or more frequency domain predictions comprise a combination of one or more of:
a low-low sub-band prediction, a high-high sub-band prediction, a low-high sub-band prediction, and a high-low sub-band prediction.

### Claim 19 (depends on 12)

The system of claim 12, wherein the system is comprised in at least one of:
a control system for an autonomous or semi-autonomous machine;
a perception system for an autonomous or semi-autonomous machine;
a system for performing simulation operations;
a system for performing digital twin operations;
a system for performing light transport simulation;
a system for performing collaborative content creation for three-dimensional assets;
a system for performing deep learning operations;
a system for performing remote operations;
a system for performing real-time streaming;
a system for generating or presenting one or more of augmented reality content, virtual reality content, or mixed reality content;
a system implemented using an edge device;
a system implemented using a robot;
a system for performing conversational AI operations;
a system implementing one or more language models;
a system implementing one or more large language models (LLMs);
a system implementing one or more vision language models (VLMs);
a system for generating synthetic data;
a system for generating synthetic data using AI;
a system incorporating one or more virtual machines (VMs);
a system implemented at least partially in a data center; or
a system implemented at least partially using cloud computing resources.

### Claim 20

A method comprising:
generating image data representing resampled image data based at least on one or more non-linear adjustments applied to one or more sub-band images derived from at least one wavelet frequency representation of the resampled image data to produce a corrected set of one or more sub-band images, and generating a reconstructed image from the corrected set of one or more sub-band images based at least on an inverse wavelet frequency operation.
