# US 2026/0073201 A1 · Post-training quantization for diffusion transformers

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0073201 A1
- Document ID: US20260073201A1
- Status: Published application
- Kind: A1
- Application number: 19/258,874
- Filed: 2025-07-02
- Published: 2026-03-12
- Earliest claimed: 2024-09-09
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Mostafa EL-KHAMY; Qingfeng LIU; Sanghyun YI
- Web page: https://patentgrep.com/patent/US20260073201A1

## CPC

- G06N 3/0495: Quantised networks; Sparse networks; Compressed networks
- G06N 3/045: Combinations of networks
- G06N 3/0475: Generative networks
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

A technique for quantization in diffusion transformers is disclosed. A weight quantizer is configured to quantize a weight matrix of a layer in a diffusion transformer block to generate a quantized weight matrix. An activation quantizer is configured to quantize an activation matrix of the layer to generate a quantized activation matrix. A time-step quantizer is configured to estimate a quantization parameter based on at least one of the quantized weight matrix or the quantized activation matrix for a time step based on a per-step calibration set.

## Claims

### Claim 1

An apparatus comprising:
a weight quantizer configured to quantize a weight matrix of a layer in a diffusion transformer block to generate a quantized weight matrix;
an activation quantizer configured to quantize an activation matrix of the layer to generate a quantized activation matrix; and
a time-step quantizer configured to estimate a quantization parameter based on at least one of the quantized weight matrix or the quantized activation matrix for a time step based on a per-step calibration set.

### Claim 2 (depends on 1)

The apparatus of claim 1, further comprising:
a smooth quantizer configured to smooth a weight value in the weight matrix and an activation in the activation matrix to generate a smoothed weight value and a smoothed activation value.

### Claim 3 (depends on 2)

The apparatus of claim 2,
wherein the weight quantizer quantizes the weight matrix having the smoothed weight value to generate the quantized weight matrix, and
wherein the activation quantizer quantizes the activation matrix having the smoothed activation value to generate the quantized activation matrix.

### Claim 4 (depends on 1)

The apparatus of claim 1,
wherein the weight and activation quantizers quantize the weight and activation matrices, respectively, in post-training quantization (PTQ) during a calibration period different from an inference period.

### Claim 5 (depends on 1)

The apparatus of claim 1, wherein the layer is one of a spatial self-attention layer, a temporal self-attention layer, a prompt cross attention layer, and a pointwise feed forward layer.

### Claim 6 (depends on 1)

The apparatus of claim 1, wherein the weight quantizer comprises:
a bin size calculator that calculates a bin size based on a weight maximum, a weight minimum, and a bit width; and
a zero calculator that calculates a zero point based on a weight minimum and the bin size.

### Claim 7 (depends on 1)

The apparatus of claim 1, wherein the activation quantizer comprises:
a bin size calculator that calculates a bin size based on an activation maximum, an activation minimum, and a bit width; and
a zero calculator that calculates a zero point based on an activation minimum and the bin size.

### Claim 8 (depends on 2)

The apparatus of claim 2, wherein the smooth quantizer comprises:
a scaling term calculator that calculates a scaling term based on a ratio between an activation absolute maximum and a weight absolute maximum;
a smoothed weight calculator that calculates the smoothed weight value based on the weight and an inverse the scaling term; and
a smoothed activation calculator that calculates the smoothed activation value based on the activation and the scaling term.

### Claim 9 (depends on 4)

The apparatus of claim 4, wherein the time step is grouped into one or more ranges in which the quantization parameter is estimated.

### Claim 10 (depends on 6)

The apparatus of claim 6, wherein the bit width is one of 4, 6, 8, or 16.

### Claim 11

A method comprising:
quantizing a weight matrix of a layer in a diffusion transformer block to generate a quantized weight matrix;
quantizing an activation matrix of the layer to generate a quantized activation matrix; and
estimating a quantization parameter based on at least one of the quantized weight matrix or the quantized activation matrix for a time step based on a per-step calibration set.

### Claim 12 (depends on 11)

The method of claim 11, further comprising:
smoothing a weight value in the weight matrix and an activation in the activation matrix to generate a smoothed weight value and a smoothed activation value.

### Claim 13 (depends on 12)

The method of claim 12, wherein
quantizing the weight matrix comprises quantizing the weight matrix having the smoothed weight value to generate the quantized weight matrix, and
quantizing the activation matrix comprises quantizing the activation matrix having the smoothed activation value to generate the quantized activation matrix.

### Claim 14 (depends on 11)

The method of claim 11,
wherein quantizing the weight and activation matrices comprises quantizing in post-training quantization (PTQ) during a calibration period different from an inference period.

### Claim 15 (depends on 11)

The method of claim 11, wherein the layer is one of a spatial self-attention layer, a temporal self-attention layer, a prompt cross attention layer, and a pointwise feed forward layer.

### Claim 16 (depends on 11)

The method of claim 11, wherein quantizing the weight matrix comprises:
calculating a bin size based on a weight maximum, a weight minimum, and a bit width; and
calculating a zero point based on a weight minimum and the bin size.

### Claim 17 (depends on 11)

The method of claim 11, wherein quantizing the activation matrix comprises:
calculating a bin size based on an activation maximum, an activation minimum, and a bit width; and
calculating a zero point based on an activation minimum and the bin size.

### Claim 18 (depends on 12)

The method of claim 12, wherein smoothing comprises:
calculating a scaling term based on a ratio between an activation absolute maximum and a weight absolute maximum;
calculating the smoothed weight value based on the weight and an inverse the scaling term; and
calculating the smoothed activation value based on the activation and the scaling term.

### Claim 19 (depends on 14)

The method of claim 14, wherein the time step is grouped into one or more ranges in which the quantization parameter is estimated.

### Claim 20

A system comprising:
a layer in a diffusion transformer block; and
a layer quantizer configured to quantize the layer, the layer quantizer comprising:
a weight quantizer configured to quantize a weight matrix of a layer in a diffusion transformer block to generate a quantized weight matrix;
an activation quantizer configured to quantize an activation matrix of the layer to generate a quantized activation matrix; and
a time-step quantizer configured to estimate a quantization parameter based on at least one of the quantized weight matrix or the quantized activation matrix for a time step based on a per-step calibration set.
